[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:05:26.260363 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:45227
I20260709 13:05:26.261943 15321 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:05:26.263028 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:26.279861 15328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.279866 15327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:26.279909 15330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.515164 15329 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:05:27.515267 15321 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:05:27.519840 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.520112 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.520316 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602327520297 us; error 0 us; skew 500 ppm
I20260709 13:05:27.521200 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.527670 15321 webserver.cc:533] Webserver started at http://127.14.246.126:44611/ using document root <none> and password file <none>
I20260709 13:05:27.528528 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.528801 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.529299 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.535027 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "295bed0b74dc49e6bc6585f1da98248f"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-bhv2"
I20260709 13:05:27.543095 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:05:27.548256 15336 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.549661 15321 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:05:27.550060 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "295bed0b74dc49e6bc6585f1da98248f"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-bhv2"
I20260709 13:05:27.550464 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.607173 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.608866 15321 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:05:27.609372 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.679913 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:45227
I20260709 13:05:27.680001 15387 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:45227 every 8 connection(s)
I20260709 13:05:27.687671 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:27.711915 15388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: Bootstrap starting.
I20260709 13:05:27.718463 15388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:27.720633 15388 log.cc:826] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: Log is configured to *not* fsync() on all Append() calls
I20260709 13:05:27.725737 15388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: No bootstrap required, opened a new log
I20260709 13:05:27.746532 15388 raft_consensus.cc:359] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER }
I20260709 13:05:27.747102 15388 raft_consensus.cc:385] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:27.747408 15388 raft_consensus.cc:740] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 295bed0b74dc49e6bc6585f1da98248f, State: Initialized, Role: FOLLOWER
I20260709 13:05:27.748361 15388 consensus_queue.cc:260] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER }
I20260709 13:05:27.748910 15388 raft_consensus.cc:399] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:27.749217 15388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:27.749588 15388 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:27.753938 15388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER }
I20260709 13:05:27.754904 15388 leader_election.cc:304] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 295bed0b74dc49e6bc6585f1da98248f; no voters: 
I20260709 13:05:27.756896 15388 leader_election.cc:290] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:27.757211 15391 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:27.760141 15391 raft_consensus.cc:697] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 1 LEADER]: Becoming Leader. State: Replica: 295bed0b74dc49e6bc6585f1da98248f, State: Running, Role: LEADER
I20260709 13:05:27.761162 15391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER }
I20260709 13:05:27.762420 15388 sys_catalog.cc:565] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:27.772396 15393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "295bed0b74dc49e6bc6585f1da98248f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER } }
I20260709 13:05:27.773300 15393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.772383 15392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 295bed0b74dc49e6bc6585f1da98248f. Latest consensus state: current_term: 1 leader_uuid: "295bed0b74dc49e6bc6585f1da98248f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "295bed0b74dc49e6bc6585f1da98248f" member_type: VOTER } }
I20260709 13:05:27.774173 15392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:27.777483 15399 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:27.790163 15399 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:27.792500 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:27.807772 15399 catalog_manager.cc:1383] Generated new cluster ID: c3031dc3bf72497e8bc69449460feb57
I20260709 13:05:27.808113 15399 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:27.828553 15399 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:27.830681 15399 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:27.847098 15399 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: Generated new TSK 0
I20260709 13:05:27.848227 15399 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:27.859052 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:27.867996 15410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.869359 15411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:27.872897 15413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:27.874822 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:27.875651 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:27.875880 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:27.876096 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602327876056 us; error 0 us; skew 500 ppm
I20260709 13:05:27.876868 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:27.881780 15321 webserver.cc:533] Webserver started at http://127.14.246.65:45997/ using document root <none> and password file <none>
I20260709 13:05:27.882381 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:27.882908 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:27.883236 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:27.884573 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "48a5e07331bd4dfeaa911af27e181436"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-bhv2"
I20260709 13:05:27.891026 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:05:27.896294 15418 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.897318 15321 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:05:27.897701 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "48a5e07331bd4dfeaa911af27e181436"
format_stamp: "Formatted at 2026-07-09 13:05:27 on dist-test-slave-bhv2"
I20260709 13:05:27.898079 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:27.922674 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:27.924439 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:27.927361 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:27.932921 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:27.933298 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:27.933632 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:27.933862 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.031297 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:33963
I20260709 13:05:28.031384 15480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:33963 every 8 connection(s)
I20260709 13:05:28.039098 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.048277 15485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:28.057670 15486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.062729 15321 server_base.cc:1061] running on GCE node
W20260709 13:05:28.063292 15488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.064545 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.064864 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.065096 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602328065075 us; error 0 us; skew 500 ppm
I20260709 13:05:28.065833 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.070019 15321 webserver.cc:533] Webserver started at http://127.14.246.66:37335/ using document root <none> and password file <none>
I20260709 13:05:28.070333 15481 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45227
I20260709 13:05:28.070595 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.070863 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.070835 15481 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.071929 15481 heartbeater.cc:507] Master 127.14.246.126:45227 requested a full tablet report, sending...
I20260709 13:05:28.073066 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.074640 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "e83b335ba7eb4a9eb371be030165eed2"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-bhv2"
I20260709 13:05:28.075505 15353 ts_manager.cc:194] Registered new tserver with Master: 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963)
I20260709 13:05:28.078641 15353 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52742
I20260709 13:05:28.082293 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:28.087316 15493 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.088270 15321 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:05:28.088591 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "e83b335ba7eb4a9eb371be030165eed2"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-bhv2"
I20260709 13:05:28.088945 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.113507 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.114836 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.117408 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.120338 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.120528 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.120864 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.121042 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.223642 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:44303
I20260709 13:05:28.223774 15555 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:44303 every 8 connection(s)
I20260709 13:05:28.235739 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:28.243820 15559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.249253 15556 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45227
I20260709 13:05:28.249784 15556 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.251210 15556 heartbeater.cc:507] Master 127.14.246.126:45227 requested a full tablet report, sending...
I20260709 13:05:28.254669 15353 ts_manager.cc:194] Registered new tserver with Master: e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:28.256843 15353 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52754
W20260709 13:05:28.258875 15560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.259903 15321 server_base.cc:1061] running on GCE node
W20260709 13:05:28.261653 15562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:28.262724 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:28.263001 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:28.263207 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602328263185 us; error 0 us; skew 500 ppm
I20260709 13:05:28.263933 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:28.266703 15321 webserver.cc:533] Webserver started at http://127.14.246.67:44547/ using document root <none> and password file <none>
I20260709 13:05:28.267311 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:28.267553 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:28.267858 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:28.269387 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "398fd9d7a289406ba89eb1007f05b391"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-bhv2"
I20260709 13:05:28.275180 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:28.278674 15567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.279624 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:28.279970 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "398fd9d7a289406ba89eb1007f05b391"
format_stamp: "Formatted at 2026-07-09 13:05:28 on dist-test-slave-bhv2"
I20260709 13:05:28.280329 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:28.318948 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:28.320565 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:28.322232 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:28.325887 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:28.326146 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.326397 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:28.326581 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:28.411702 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:44853
I20260709 13:05:28.411765 15629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:44853 every 8 connection(s)
I20260709 13:05:28.429373 15630 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45227
I20260709 13:05:28.429766 15630 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:28.430548 15630 heartbeater.cc:507] Master 127.14.246.126:45227 requested a full tablet report, sending...
I20260709 13:05:28.432396 15353 ts_manager.cc:194] Registered new tserver with Master: 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:28.432615 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015313869s
I20260709 13:05:28.433837 15353 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52768
I20260709 13:05:28.485399 15353 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52772:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:28.488948 15353 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:28.581385 15446 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7bf500422d4a9eb71378f748a0abcc (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.581974 15444 tablet_service.cc:1511] Processing CreateTablet for tablet cdd9417ca27d42edaca29a12289aa189 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.583150 15446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7bf500422d4a9eb71378f748a0abcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.583738 15444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd9417ca27d42edaca29a12289aa189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.586602 15445 tablet_service.cc:1511] Processing CreateTablet for tablet 8d442026517747dd9fa820995d4df153 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.589977 15443 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdb7b51609c46cd84a305ce37fd71df (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.592125 15445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d442026517747dd9fa820995d4df153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.593392 15443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdb7b51609c46cd84a305ce37fd71df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.597568 15442 tablet_service.cc:1511] Processing CreateTablet for tablet 72e34516a2e54c0aa78eab3d9936c864 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.599483 15442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e34516a2e54c0aa78eab3d9936c864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.633908 15521 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7bf500422d4a9eb71378f748a0abcc (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.635020 15520 tablet_service.cc:1511] Processing CreateTablet for tablet 8d442026517747dd9fa820995d4df153 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.636526 15521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7bf500422d4a9eb71378f748a0abcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.641238 15519 tablet_service.cc:1511] Processing CreateTablet for tablet cdd9417ca27d42edaca29a12289aa189 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.641778 15518 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdb7b51609c46cd84a305ce37fd71df (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.647323 15520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d442026517747dd9fa820995d4df153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.650882 15517 tablet_service.cc:1511] Processing CreateTablet for tablet 72e34516a2e54c0aa78eab3d9936c864 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.654964 15595 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7bf500422d4a9eb71378f748a0abcc (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:28.661818 15517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e34516a2e54c0aa78eab3d9936c864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.647751 15441 tablet_service.cc:1511] Processing CreateTablet for tablet 6070fc1b68a6420c8589e15bb12ba927 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.666568 15516 tablet_service.cc:1511] Processing CreateTablet for tablet 6070fc1b68a6420c8589e15bb12ba927 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.670436 15441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6070fc1b68a6420c8589e15bb12ba927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.664518 15593 tablet_service.cc:1511] Processing CreateTablet for tablet cdd9417ca27d42edaca29a12289aa189 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:28.672811 15594 tablet_service.cc:1511] Processing CreateTablet for tablet 8d442026517747dd9fa820995d4df153 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:28.673581 15592 tablet_service.cc:1511] Processing CreateTablet for tablet 8cdb7b51609c46cd84a305ce37fd71df (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:28.673907 15595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7bf500422d4a9eb71378f748a0abcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.681914 15519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd9417ca27d42edaca29a12289aa189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.673502 15591 tablet_service.cc:1511] Processing CreateTablet for tablet 72e34516a2e54c0aa78eab3d9936c864 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:28.682214 15592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdb7b51609c46cd84a305ce37fd71df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.684126 15590 tablet_service.cc:1511] Processing CreateTablet for tablet 6070fc1b68a6420c8589e15bb12ba927 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:28.692205 15440 tablet_service.cc:1511] Processing CreateTablet for tablet 85bb563836fe4311a2769a9563c2c292 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.694029 15440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bb563836fe4311a2769a9563c2c292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.696422 15516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6070fc1b68a6420c8589e15bb12ba927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.697146 15594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d442026517747dd9fa820995d4df153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.698004 15518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cdb7b51609c46cd84a305ce37fd71df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.699469 15593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdd9417ca27d42edaca29a12289aa189. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.701078 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6070fc1b68a6420c8589e15bb12ba927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.703382 15648 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:28.706566 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72e34516a2e54c0aa78eab3d9936c864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.724967 15515 tablet_service.cc:1511] Processing CreateTablet for tablet 85bb563836fe4311a2769a9563c2c292 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.738533 15515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bb563836fe4311a2769a9563c2c292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.781092 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 85bb563836fe4311a2769a9563c2c292 (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:28.784018 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85bb563836fe4311a2769a9563c2c292. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:28.784466 15401 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:28.799865 15648 tablet_bootstrap.cc:654] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.807237 15446 tablet_service.cc:1511] Processing CreateTablet for tablet 895309ab347d4de79c7dfafe70f4c86d (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.809335 15446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895309ab347d4de79c7dfafe70f4c86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.851409 15521 tablet_service.cc:1511] Processing CreateTablet for tablet 895309ab347d4de79c7dfafe70f4c86d (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.852731 15521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895309ab347d4de79c7dfafe70f4c86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.875910 15517 tablet_service.cc:1511] Processing CreateTablet for tablet ab720634a5fb4d67a3c400c046f8fa8f (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.877244 15517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab720634a5fb4d67a3c400c046f8fa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.885499 15650 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:28.888161 15595 tablet_service.cc:1511] Processing CreateTablet for tablet ab720634a5fb4d67a3c400c046f8fa8f (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.890619 15595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab720634a5fb4d67a3c400c046f8fa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.891541 15440 tablet_service.cc:1511] Processing CreateTablet for tablet ab720634a5fb4d67a3c400c046f8fa8f (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:28.897045 15440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab720634a5fb4d67a3c400c046f8fa8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.884895 15594 tablet_service.cc:1511] Processing CreateTablet for tablet 895309ab347d4de79c7dfafe70f4c86d (DEFAULT_TABLE table=test-workload [id=d74188daa46b418eaf93ef3fa320e4de]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:28.907389 15648 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:28.919211 15594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 895309ab347d4de79c7dfafe70f4c86d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.921204 15651 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:28.914836 15648 ts_tablet_manager.cc:1403] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.213s	user 0.020s	sys 0.011s
I20260709 13:05:28.931090 15650 tablet_bootstrap.cc:654] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.936792 15650 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:28.937286 15650 ts_tablet_manager.cc:1403] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.005s
I20260709 13:05:28.936681 15648 raft_consensus.cc:359] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.940697 15648 raft_consensus.cc:385] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.941075 15648 raft_consensus.cc:740] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.941835 15648 consensus_queue.cc:260] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.944460 15651 tablet_bootstrap.cc:654] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.944988 15481 heartbeater.cc:499] Master 127.14.246.126:45227 was elected leader, sending a full tablet report...
I20260709 13:05:28.950325 15648 ts_tablet_manager.cc:1434] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:28.951069 15651 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:28.951152 15648 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:28.951542 15651 ts_tablet_manager.cc:1403] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:05:28.954670 15651 raft_consensus.cc:359] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.955448 15651 raft_consensus.cc:385] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.955761 15651 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.956598 15651 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.958446 15650 raft_consensus.cc:359] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.959525 15650 raft_consensus.cc:385] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.959830 15650 raft_consensus.cc:740] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.960511 15650 consensus_queue.cc:260] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.964257 15648 tablet_bootstrap.cc:654] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.965668 15630 heartbeater.cc:499] Master 127.14.246.126:45227 was elected leader, sending a full tablet report...
I20260709 13:05:28.966408 15651 ts_tablet_manager.cc:1434] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:05:28.967447 15651 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:28.974069 15651 tablet_bootstrap.cc:654] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:28.980235 15648 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:28.980705 15648 ts_tablet_manager.cc:1403] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:05:28.985410 15648 raft_consensus.cc:359] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:28.986143 15648 raft_consensus.cc:385] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:28.986433 15648 raft_consensus.cc:740] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:28.986981 15651 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:28.987363 15556 heartbeater.cc:499] Master 127.14.246.126:45227 was elected leader, sending a full tablet report...
I20260709 13:05:28.987452 15651 ts_tablet_manager.cc:1403] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:05:28.987974 15650 ts_tablet_manager.cc:1434] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.050s	user 0.018s	sys 0.000s
I20260709 13:05:29.002817 15651 raft_consensus.cc:359] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
W20260709 13:05:28.988340 15557 tablet.cc:2406] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:29.006388 15651 raft_consensus.cc:385] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.006729 15651 raft_consensus.cc:740] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.007452 15651 consensus_queue.cc:260] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.009931 15651 ts_tablet_manager.cc:1434] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 13:05:29.010859 15651 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.003932 15650 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.015906 15651 tablet_bootstrap.cc:654] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.019914 15650 tablet_bootstrap.cc:654] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.026968 15655 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.027505 15655 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.030889 15655 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.004506 15648 consensus_queue.cc:260] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.032287 15651 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.033115 15651 ts_tablet_manager.cc:1403] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.009s
I20260709 13:05:29.034523 15648 ts_tablet_manager.cc:1434] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 13:05:29.036046 15651 raft_consensus.cc:359] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.042217 15651 raft_consensus.cc:385] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.042907 15651 raft_consensus.cc:740] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.043674 15651 consensus_queue.cc:260] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.042385 15650 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.038888 15648 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.044860 15650 ts_tablet_manager.cc:1403] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.004s
I20260709 13:05:29.047813 15650 raft_consensus.cc:359] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.048568 15650 raft_consensus.cc:385] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.048892 15650 raft_consensus.cc:740] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.049598 15650 consensus_queue.cc:260] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.051661 15650 ts_tablet_manager.cc:1434] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:29.052142 15648 tablet_bootstrap.cc:654] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.052634 15650 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.058393 15651 ts_tablet_manager.cc:1434] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.009s
I20260709 13:05:29.059305 15651 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.066072 15651 tablet_bootstrap.cc:654] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.071970 15650 tablet_bootstrap.cc:654] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.080705 15653 raft_consensus.cc:493] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.081277 15653 raft_consensus.cc:515] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.085876 15653 leader_election.cc:290] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.105929 15655 raft_consensus.cc:493] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.105803 15648 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.106766 15655 raft_consensus.cc:515] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.107213 15648 ts_tablet_manager.cc:1403] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.018s
I20260709 13:05:29.109776 15655 leader_election.cc:290] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.104945 15651 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.110515 15651 ts_tablet_manager.cc:1403] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.006s
I20260709 13:05:29.111459 15648 raft_consensus.cc:359] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.112208 15648 raft_consensus.cc:385] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.112556 15648 raft_consensus.cc:740] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.113196 15651 raft_consensus.cc:359] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.115784 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
W20260709 13:05:29.118297 15570 leader_election.cc:343] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.113389 15648 consensus_queue.cc:260] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.117676 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.119668 15650 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.119874 15455 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 0.
I20260709 13:05:29.120106 15650 ts_tablet_manager.cc:1403] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.012s
I20260709 13:05:29.122570 15570 leader_election.cc:304] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:29.123569 15655 raft_consensus.cc:2804] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.123931 15655 raft_consensus.cc:493] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.124276 15655 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.115995 15651 raft_consensus.cc:385] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.125525 15651 raft_consensus.cc:740] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.122915 15650 raft_consensus.cc:359] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.130824 15650 raft_consensus.cc:385] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.132143 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.131510 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.132351 15651 consensus_queue.cc:260] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
W20260709 13:05:29.135314 15570 leader_election.cc:343] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.136865 15570 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391; no voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.137403 15648 ts_tablet_manager.cc:1434] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:05:29.133010 15650 raft_consensus.cc:740] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.140650 15656 raft_consensus.cc:493] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.141197 15648 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.141433 15656 raft_consensus.cc:515] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.142289 15650 consensus_queue.cc:260] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.136854 15655 raft_consensus.cc:515] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.149370 15656 leader_election.cc:290] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.160189 15669 raft_consensus.cc:2749] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.162387 15655 leader_election.cc:290] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
W20260709 13:05:29.162710 15570 leader_election.cc:343] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.170979 15651 ts_tablet_manager.cc:1434] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.060s	user 0.014s	sys 0.011s
I20260709 13:05:29.176683 15651 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.179133 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:29.179740 15455 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.182482 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.192781 15650 ts_tablet_manager.cc:1434] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.072s	user 0.021s	sys 0.011s
I20260709 13:05:29.194739 15650 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.194784 15648 tablet_bootstrap.cc:654] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.203037 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
W20260709 13:05:29.206058 15421 leader_election.cc:343] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.211434 15455 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 1.
I20260709 13:05:29.215322 15650 tablet_bootstrap.cc:654] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.215338 15651 tablet_bootstrap.cc:654] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.226404 15670 raft_consensus.cc:493] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.225545 15570 leader_election.cc:343] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.227348 15670 raft_consensus.cc:515] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.229096 15570 leader_election.cc:304] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.230031 15655 raft_consensus.cc:2804] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.230470 15655 raft_consensus.cc:697] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:29.231643 15655 consensus_queue.cc:237] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.232115 15670 leader_election.cc:290] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.233690 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.234459 15530 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.236552 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.236630 15421 leader_election.cc:304] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:29.238546 15653 raft_consensus.cc:2804] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.238919 15653 raft_consensus.cc:493] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.239238 15653 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.240592 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
W20260709 13:05:29.240878 15570 leader_election.cc:343] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.241681 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.242304 15605 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 0.
I20260709 13:05:29.239749 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
W20260709 13:05:29.243748 15570 leader_election.cc:343] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.244257 15570 leader_election.cc:304] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391; no voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.245980 15670 raft_consensus.cc:2749] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:29.246039 15496 leader_election.cc:343] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.247134 15496 leader_election.cc:304] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:29.248353 15671 raft_consensus.cc:2804] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.248908 15671 raft_consensus.cc:493] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.249328 15671 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.249963 15653 raft_consensus.cc:515] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.253700 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
W20260709 13:05:29.255115 15421 leader_election.cc:343] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.258486 15650 tablet_bootstrap.cc:492] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.258751 15651 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.259022 15650 ts_tablet_manager.cc:1403] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.005s
I20260709 13:05:29.259222 15651 ts_tablet_manager.cc:1403] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.020s
I20260709 13:05:29.260555 15648 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.261049 15648 ts_tablet_manager.cc:1403] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.009s
I20260709 13:05:29.262151 15650 raft_consensus.cc:359] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.262925 15650 raft_consensus.cc:385] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.263240 15650 raft_consensus.cc:740] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.263953 15650 consensus_queue.cc:260] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.264180 15648 raft_consensus.cc:359] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.264998 15648 raft_consensus.cc:385] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.265362 15648 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.266156 15650 ts_tablet_manager.cc:1434] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:05:29.266345 15648 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.252588 15653 leader_election.cc:290] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.270167 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.270726 15530 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.271106 15651 raft_consensus.cc:359] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.271869 15651 raft_consensus.cc:385] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.272164 15651 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.273437 15651 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.275489 15351 catalog_manager.cc:5697] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.267187 15671 raft_consensus.cc:515] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.283023 15671 leader_election.cc:290] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.277833 15530 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.285095 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
W20260709 13:05:29.286648 15496 leader_election.cc:343] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.267118 15650 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.286923 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.287479 15605 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.280218 15648 ts_tablet_manager.cc:1434] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.006s
I20260709 13:05:29.280318 15651 ts_tablet_manager.cc:1434] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:05:29.292097 15648 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.292116 15651 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.293102 15421 leader_election.cc:304] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:29.294348 15679 raft_consensus.cc:2804] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.294865 15679 raft_consensus.cc:697] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:29.295672 15679 consensus_queue.cc:237] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.296624 15605 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 1.
I20260709 13:05:29.298820 15496 leader_election.cc:304] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:29.299999 15671 raft_consensus.cc:2804] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.300716 15671 raft_consensus.cc:697] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:29.300884 15651 tablet_bootstrap.cc:654] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.301769 15671 consensus_queue.cc:237] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.302493 15650 tablet_bootstrap.cc:654] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.307183 15648 tablet_bootstrap.cc:654] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.317288 15650 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.316756 15353 catalog_manager.cc:5697] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.317764 15650 ts_tablet_manager.cc:1403] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.001s
I20260709 13:05:29.322945 15648 tablet_bootstrap.cc:492] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.323387 15648 ts_tablet_manager.cc:1403] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:05:29.329183 15650 raft_consensus.cc:359] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.330664 15650 raft_consensus.cc:385] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.330966 15650 raft_consensus.cc:740] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.326881 15648 raft_consensus.cc:359] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.331686 15651 tablet_bootstrap.cc:492] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.331696 15648 raft_consensus.cc:385] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.331949 15650 consensus_queue.cc:260] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.332237 15651 ts_tablet_manager.cc:1403] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
I20260709 13:05:29.332217 15648 raft_consensus.cc:740] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.332890 15655 raft_consensus.cc:493] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.333360 15648 consensus_queue.cc:260] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.333495 15655 raft_consensus.cc:515] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.334620 15650 ts_tablet_manager.cc:1434] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:05:29.335538 15650 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.335879 15655 leader_election.cc:290] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.336562 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.336024 15651 raft_consensus.cc:359] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.337296 15648 ts_tablet_manager.cc:1434] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.008s
I20260709 13:05:29.337215 15455 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 0.
I20260709 13:05:29.338259 15648 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.338235 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.339480 15570 leader_election.cc:304] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:29.339359 15350 catalog_manager.cc:5697] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:29.340371 15570 leader_election.cc:343] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.340677 15655 raft_consensus.cc:2804] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.337167 15651 raft_consensus.cc:385] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.345206 15651 raft_consensus.cc:740] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.346366 15650 tablet_bootstrap.cc:654] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.345995 15651 consensus_queue.cc:260] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.347623 15648 tablet_bootstrap.cc:654] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.348227 15651 ts_tablet_manager.cc:1434] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:05:29.349205 15651 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.345221 15655 raft_consensus.cc:493] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.353222 15655 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.357369 15648 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.359647 15648 ts_tablet_manager.cc:1403] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:05:29.362816 15651 tablet_bootstrap.cc:654] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.364437 15648 raft_consensus.cc:359] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.365201 15648 raft_consensus.cc:385] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.365494 15648 raft_consensus.cc:740] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.366211 15648 consensus_queue.cc:260] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.366847 15655 raft_consensus.cc:515] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.368671 15648 ts_tablet_manager.cc:1434] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:05:29.368997 15655 leader_election.cc:290] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.370024 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.370024 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:29.371405 15455 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.371541 15650 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.372047 15650 ts_tablet_manager.cc:1403] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.004s
I20260709 13:05:29.375034 15650 raft_consensus.cc:359] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.375741 15650 raft_consensus.cc:385] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.376046 15650 raft_consensus.cc:740] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.377802 15455 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 1.
I20260709 13:05:29.377640 15650 consensus_queue.cc:260] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
W20260709 13:05:29.379539 15570 leader_election.cc:343] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.379935 15650 ts_tablet_manager.cc:1434] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:29.380201 15570 leader_election.cc:304] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.380990 15655 raft_consensus.cc:2804] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.381456 15655 raft_consensus.cc:697] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:29.382365 15648 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.382239 15655 consensus_queue.cc:237] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.390527 15648 tablet_bootstrap.cc:654] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.404821 15650 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.406253 15648 tablet_bootstrap.cc:492] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.406734 15648 ts_tablet_manager.cc:1403] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 13:05:29.409488 15648 raft_consensus.cc:359] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.410166 15648 raft_consensus.cc:385] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.410513 15648 raft_consensus.cc:740] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.411345 15650 tablet_bootstrap.cc:654] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.411192 15648 consensus_queue.cc:260] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.413755 15679 raft_consensus.cc:493] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.414183 15679 raft_consensus.cc:515] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.414935 15651 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.415362 15651 ts_tablet_manager.cc:1403] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.014s
I20260709 13:05:29.416345 15648 ts_tablet_manager.cc:1434] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:29.416826 15679 leader_election.cc:290] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.417562 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.418164 15530 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.418283 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
W20260709 13:05:29.419391 15421 leader_election.cc:343] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.420040 15421 leader_election.cc:304] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:29.420871 15679 raft_consensus.cc:2804] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.421211 15679 raft_consensus.cc:493] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.421521 15679 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.421641 15648 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.429071 15670 raft_consensus.cc:493] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.429538 15670 raft_consensus.cc:515] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.430792 15648 tablet_bootstrap.cc:654] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.431474 15670 leader_election.cc:290] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.428345 15679 raft_consensus.cc:515] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.433068 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.433521 15679 leader_election.cc:290] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.435232 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.435246 15651 raft_consensus.cc:359] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.436264 15651 raft_consensus.cc:385] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.436597 15651 raft_consensus.cc:740] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.437390 15651 consensus_queue.cc:260] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.438519 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.439715 15651 ts_tablet_manager.cc:1434] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:05:29.440683 15651 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.440627 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.441243 15531 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.442574 15351 catalog_manager.cc:5697] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.436030 15530 raft_consensus.cc:2393] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398fd9d7a289406ba89eb1007f05b391 in current term 1: Already voted for candidate 48a5e07331bd4dfeaa911af27e181436 in this term.
I20260709 13:05:29.446430 15570 leader_election.cc:304] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391; no voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.447492 15651 tablet_bootstrap.cc:654] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.453292 15655 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.454555 15421 leader_election.cc:343] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.463651 15671 raft_consensus.cc:493] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.464112 15671 raft_consensus.cc:515] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.466068 15671 leader_election.cc:290] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.467908 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.468511 15605 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 0.
I20260709 13:05:29.470163 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.470721 15455 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 0.
I20260709 13:05:29.474140 15531 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.474248 15496 leader_election.cc:304] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.476106 15671 raft_consensus.cc:2804] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.476634 15671 raft_consensus.cc:493] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.477216 15671 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.480029 15656 raft_consensus.cc:493] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.480851 15656 raft_consensus.cc:515] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.481482 15421 leader_election.cc:304] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:29.482191 15679 raft_consensus.cc:2804] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.482640 15679 raft_consensus.cc:697] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:29.482798 15656 leader_election.cc:290] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.483445 15679 consensus_queue.cc:237] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.485035 15655 raft_consensus.cc:2749] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.485119 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
W20260709 13:05:29.486598 15496 leader_election.cc:343] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.487005 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.487784 15605 raft_consensus.cc:2468] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 0.
I20260709 13:05:29.491786 15650 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.492367 15650 ts_tablet_manager.cc:1403] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.112s	user 0.027s	sys 0.049s
I20260709 13:05:29.493199 15496 leader_election.cc:304] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:29.494139 15656 raft_consensus.cc:2804] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.494481 15656 raft_consensus.cc:493] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.494833 15656 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.496894 15650 raft_consensus.cc:359] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.497614 15650 raft_consensus.cc:385] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.497912 15650 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.499837 15650 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.503109 15648 tablet_bootstrap.cc:492] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.512490 15656 raft_consensus.cc:515] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.507540 15650 ts_tablet_manager.cc:1434] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:05:29.514142 15650 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.510211 15671 raft_consensus.cc:515] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.509748 15351 catalog_manager.cc:5697] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.513137 15648 ts_tablet_manager.cc:1403] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.005s
I20260709 13:05:29.518988 15648 raft_consensus.cc:359] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.519637 15648 raft_consensus.cc:385] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.519877 15648 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.520107 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.520681 15605 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.520696 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:29.520597 15648 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.521414 15455 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.522655 15648 ts_tablet_manager.cc:1434] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:05:29.523466 15648 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: Bootstrap starting.
I20260709 13:05:29.527222 15605 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 1.
I20260709 13:05:29.528431 15496 leader_election.cc:304] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.528713 15648 tablet_bootstrap.cc:654] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.504256 15651 tablet_bootstrap.cc:492] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.533278 15651 ts_tablet_manager.cc:1403] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.016s
I20260709 13:05:29.535897 15651 raft_consensus.cc:359] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.536550 15651 raft_consensus.cc:385] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.536836 15651 raft_consensus.cc:740] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.543174 15455 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 1.
I20260709 13:05:29.543720 15650 tablet_bootstrap.cc:654] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.554586 15656 leader_election.cc:290] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.515898 15671 leader_election.cc:290] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.557130 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:29.558216 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.558759 15605 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.561096 15496 leader_election.cc:343] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.544193 15698 raft_consensus.cc:2804] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.562222 15698 raft_consensus.cc:697] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:29.548969 15651 consensus_queue.cc:260] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.550026 15648 tablet_bootstrap.cc:492] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: No bootstrap required, opened a new log
I20260709 13:05:29.564272 15648 ts_tablet_manager.cc:1403] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.004s
I20260709 13:05:29.566162 15651 ts_tablet_manager.cc:1434] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:05:29.567220 15651 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: Bootstrap starting.
I20260709 13:05:29.567108 15605 raft_consensus.cc:2468] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 1.
I20260709 13:05:29.569231 15671 raft_consensus.cc:493] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.569731 15671 raft_consensus.cc:515] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.566840 15648 raft_consensus.cc:359] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.571110 15648 raft_consensus.cc:385] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.571383 15648 raft_consensus.cc:740] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.572158 15671 leader_election.cc:290] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.572070 15648 consensus_queue.cc:260] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.569110 15496 leader_election.cc:304] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:29.574297 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.574782 15604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.575150 15455 raft_consensus.cc:2393] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e83b335ba7eb4a9eb371be030165eed2 in current term 1: Already voted for candidate 398fd9d7a289406ba89eb1007f05b391 in this term.
I20260709 13:05:29.576290 15671 raft_consensus.cc:2804] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.563158 15698 consensus_queue.cc:237] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.577205 15671 raft_consensus.cc:697] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:29.577775 15496 leader_election.cc:304] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e83b335ba7eb4a9eb371be030165eed2; no voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:29.578716 15648 ts_tablet_manager.cc:1434] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:29.581341 15656 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.583348 15650 tablet_bootstrap.cc:492] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.583813 15650 ts_tablet_manager.cc:1403] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.002s
I20260709 13:05:29.587646 15650 raft_consensus.cc:359] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.588300 15650 raft_consensus.cc:385] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.584395 15671 consensus_queue.cc:237] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.588550 15650 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.596004 15651 tablet_bootstrap.cc:654] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.597587 15656 raft_consensus.cc:2749] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.597687 15350 catalog_manager.cc:5697] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.601878 15650 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.613442 15655 raft_consensus.cc:493] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.614661 15655 raft_consensus.cc:515] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.615351 15650 ts_tablet_manager.cc:1434] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:05:29.616180 15650 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: Bootstrap starting.
I20260709 13:05:29.618893 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a5e07331bd4dfeaa911af27e181436" is_pre_election: true
I20260709 13:05:29.621261 15655 leader_election.cc:290] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.621693 15650 tablet_bootstrap.cc:654] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.623200 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.624043 15531 raft_consensus.cc:2393] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398fd9d7a289406ba89eb1007f05b391 in current term 1: Already voted for candidate 48a5e07331bd4dfeaa911af27e181436 in this term.
I20260709 13:05:29.624927 15679 raft_consensus.cc:493] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.625156 15570 leader_election.cc:304] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391; no voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.625475 15679 raft_consensus.cc:515] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:29.626543 15655 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.627900 15679 leader_election.cc:290] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:29.629379 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.631213 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.631991 15605 raft_consensus.cc:2393] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48a5e07331bd4dfeaa911af27e181436 in current term 1: Already voted for candidate e83b335ba7eb4a9eb371be030165eed2 in this term.
I20260709 13:05:29.633106 15421 leader_election.cc:304] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436; no voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:29.634136 15679 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.637130 15655 raft_consensus.cc:2749] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.640653 15679 raft_consensus.cc:2749] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.643875 15650 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: No bootstrap required, opened a new log
I20260709 13:05:29.644325 15650 ts_tablet_manager.cc:1403] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.002s
I20260709 13:05:29.646445 15651 tablet_bootstrap.cc:492] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: No bootstrap required, opened a new log
I20260709 13:05:29.646937 15651 ts_tablet_manager.cc:1403] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.009s
I20260709 13:05:29.647259 15350 catalog_manager.cc:5697] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.647280 15650 raft_consensus.cc:359] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.649047 15650 raft_consensus.cc:385] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.649330 15650 raft_consensus.cc:740] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.649983 15650 consensus_queue.cc:260] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.650050 15651 raft_consensus.cc:359] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.650951 15651 raft_consensus.cc:385] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.651288 15651 raft_consensus.cc:740] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.652230 15650 ts_tablet_manager.cc:1434] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:29.652068 15651 consensus_queue.cc:260] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.654112 15651 ts_tablet_manager.cc:1434] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:29.685825 15655 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.698738 15679 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.704262 15669 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:29.714017 15671 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:29.714962 15679 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.715582 15679 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.719146 15604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.719398 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.719776 15604 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.719975 15531 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.721309 15421 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.721632 15679 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.722116 15653 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.722581 15653 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.722961 15653 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.729465 15653 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.732147 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.732717 15531 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.739230 15531 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.740434 15421 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.741204 15679 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.744587 15698 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.748185 15679 raft_consensus.cc:697] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:29.749082 15679 consensus_queue.cc:237] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.757462 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.758091 15605 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.764444 15653 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.768954 15605 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.772001 15351 catalog_manager.cc:5697] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.777511 15653 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:29.782896 15530 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.792330 15669 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:05:29.793481 15401 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:29.807843 15655 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.852523 15653 raft_consensus.cc:493] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.853199 15653 raft_consensus.cc:515] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.855562 15653 leader_election.cc:290] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.856431 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2" is_pre_election: true
I20260709 13:05:29.856563 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391" is_pre_election: true
I20260709 13:05:29.857340 15605 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.857232 15530 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 0.
I20260709 13:05:29.858536 15421 leader_election.cc:304] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.859184 15653 raft_consensus.cc:2804] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.859583 15653 raft_consensus.cc:493] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.859951 15653 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.867172 15653 raft_consensus.cc:515] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.869445 15653 leader_election.cc:290] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:29.870254 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:29.870430 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:29.870967 15605 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.871436 15530 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.876463 15530 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.877648 15421 leader_election.cc:304] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:29.878335 15653 raft_consensus.cc:2804] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.878842 15605 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 1.
I20260709 13:05:29.878749 15653 raft_consensus.cc:697] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:29.880100 15653 consensus_queue.cc:237] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:29.887702 15350 catalog_manager.cc:5697] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.919770 15653 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.933050 15653 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:29.980737 15698 consensus_queue.cc:1048] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:29.992131 15456 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.001300 15698 consensus_queue.cc:1048] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.013406 15698 consensus_queue.cc:1048] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.017393 15530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:59692
I20260709 13:05:30.018198 15530 raft_consensus.cc:606] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:30.041322 15656 consensus_queue.cc:1048] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.050151 15605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d442026517747dd9fa820995d4df153"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:37030
I20260709 13:05:30.050805 15605 raft_consensus.cc:606] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:30.057772 15605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:37030
I20260709 13:05:30.058439 15605 raft_consensus.cc:606] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:30.076737 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:30.077394 15455 raft_consensus.cc:606] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:30.083379 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:30.083997 15455 raft_consensus.cc:606] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:30.091956 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:30.092535 15455 raft_consensus.cc:606] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:30.097729 15530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:59692
I20260709 13:05:30.098238 15530 raft_consensus.cc:606] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Received request to transfer leadership to TS 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:30.191613 15653 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.202478 15653 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.211469 15671 raft_consensus.cc:993] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.211953 15656 raft_consensus.cc:1081] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.214416 15715 raft_consensus.cc:993] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.214212 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48094
I20260709 13:05:30.214895 15455 raft_consensus.cc:493] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.214859 15653 raft_consensus.cc:1081] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.215391 15455 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.219195 15530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:30.219780 15530 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.220157 15530 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.220490 15455 raft_consensus.cc:515] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:30.222434 15455 leader_election.cc:290] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Requested vote from peers 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:30.223021 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.223563 15605 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.223919 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:30.224488 15531 raft_consensus.cc:3055] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.224844 15531 raft_consensus.cc:740] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:30.225669 15531 consensus_queue.cc:260] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:30.227012 15531 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.229926 15605 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.230554 15530 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.231184 15421 leader_election.cc:304] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:30.231956 15653 raft_consensus.cc:2804] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.232395 15653 raft_consensus.cc:697] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.233215 15653 consensus_queue.cc:237] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:30.234575 15604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.235117 15604 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.238909 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:30.233232 15530 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:30.239532 15455 raft_consensus.cc:3055] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.239733 15531 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.239926 15455 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.240849 15455 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.242048 15455 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.242882 15351 catalog_manager.cc:5697] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 1 to 2, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.245445 15604 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.246565 15496 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:30.247421 15656 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.247869 15656 raft_consensus.cc:697] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:30.248651 15656 consensus_queue.cc:237] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.249436 15455 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.255426 15351 catalog_manager.cc:5697] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 1 to 2, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.267937 15655 raft_consensus.cc:993] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.268388 15655 raft_consensus.cc:1081] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.270057 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d442026517747dd9fa820995d4df153"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48090
I20260709 13:05:30.270969 15455 raft_consensus.cc:493] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.271286 15455 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.276242 15455 raft_consensus.cc:515] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.278172 15455 leader_election.cc:290] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:30.279997 15669 raft_consensus.cc:993] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.280107 15531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:30.280474 15669 raft_consensus.cc:1081] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:30.280671 15531 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.281848 15653 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.282315 15455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48090
I20260709 13:05:30.282945 15455 raft_consensus.cc:493] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.283283 15455 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.283324 15604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.284067 15604 raft_consensus.cc:3055] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.284444 15604 raft_consensus.cc:740] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:30.285245 15604 consensus_queue.cc:260] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.286437 15604 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.289873 15455 raft_consensus.cc:515] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.292609 15455 leader_election.cc:290] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:30.293562 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:30.294140 15530 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.295269 15531 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.297545 15604 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.298833 15421 leader_election.cc:304] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:30.299638 15653 raft_consensus.cc:2804] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.300091 15653 raft_consensus.cc:697] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.300877 15653 consensus_queue.cc:237] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.301211 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.302073 15603 raft_consensus.cc:3055] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.302482 15603 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:30.303448 15603 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.309026 15530 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.304723 15603 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.310035 15421 leader_election.cc:304] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:30.309741 15350 catalog_manager.cc:5697] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 1 to 2, leader changed from 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.311071 15715 raft_consensus.cc:2804] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.311515 15715 raft_consensus.cc:697] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.312311 15715 consensus_queue.cc:237] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.320057 15603 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:30.325661 15350 catalog_manager.cc:5697] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 1 to 2, leader changed from 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.326333 15715 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.337314 15716 raft_consensus.cc:993] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.337759 15715 raft_consensus.cc:1081] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.340422 15530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:30.341012 15530 raft_consensus.cc:493] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.341401 15530 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.347337 15530 raft_consensus.cc:515] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.348855 15530 leader_election.cc:290] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:30.349611 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:30.349989 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.350214 15455 raft_consensus.cc:3055] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.350517 15605 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.350556 15455 raft_consensus.cc:740] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.352228 15455 consensus_queue.cc:260] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.353464 15455 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.357254 15712 raft_consensus.cc:993] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.357249 15605 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.357860 15653 raft_consensus.cc:1081] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:30.358572 15496 leader_election.cc:304] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:30.359299 15656 raft_consensus.cc:2804] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.359716 15656 raft_consensus.cc:697] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:30.360885 15531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:30.360497 15656 consensus_queue.cc:237] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.361420 15531 raft_consensus.cc:493] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.361775 15531 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.368189 15455 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.368273 15531 raft_consensus.cc:515] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.371629 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:30.371306 15351 catalog_manager.cc:5697] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 1 to 2, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.372138 15456 raft_consensus.cc:3055] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.372507 15456 raft_consensus.cc:740] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:30.373322 15456 consensus_queue.cc:260] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.374197 15456 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.380517 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:30.381194 15603 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.380533 15456 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.380743 15531 leader_election.cc:290] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:30.384378 15496 leader_election.cc:304] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:30.385215 15656 raft_consensus.cc:2804] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.385665 15656 raft_consensus.cc:697] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:30.386445 15656 consensus_queue.cc:237] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.386904 15603 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 2.
I20260709 13:05:30.393389 15350 catalog_manager.cc:5697] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 1 to 2, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.790307 15605 raft_consensus.cc:1275] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.791512 15603 raft_consensus.cc:1275] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.791903 15712 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.797210 15716 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.800644 15603 raft_consensus.cc:1275] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.803758 15456 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.806283 15604 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.806784 15531 raft_consensus.cc:1275] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.807852 15530 raft_consensus.cc:1275] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.810437 15671 raft_consensus.cc:993] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:30.810945 15671 raft_consensus.cc:1081] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Signalling peer 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:30.815917 15716 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.824340 15698 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.829941 15456 raft_consensus.cc:1275] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.841552 15716 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.843974 15715 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.845430 15604 raft_consensus.cc:1275] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.848124 15604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:37026
I20260709 13:05:30.848695 15604 raft_consensus.cc:493] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.849103 15604 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.859848 15604 raft_consensus.cc:515] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.862515 15698 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.863874 15698 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.865274 15671 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.866879 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:30.867574 15456 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.870107 15605 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.876959 15530 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.888370 15716 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.889825 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab720634a5fb4d67a3c400c046f8fa8f" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:30.890810 15530 raft_consensus.cc:3055] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.891366 15530 raft_consensus.cc:740] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:30.892666 15530 consensus_queue.cc:260] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:30.894191 15530 raft_consensus.cc:3060] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.897284 15604 leader_election.cc:290] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 2 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:30.899974 15456 raft_consensus.cc:2468] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 2.
I20260709 13:05:30.900974 15455 raft_consensus.cc:1240] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Rejecting Update request from peer e83b335ba7eb4a9eb371be030165eed2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.906021 15671 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:30.947296 15570 leader_election.cc:304] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:30.948551 15669 raft_consensus.cc:2804] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.979537 15456 raft_consensus.cc:1275] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:30.983464 15743 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.987486 15530 raft_consensus.cc:2468] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 2.
I20260709 13:05:30.991118 15669 raft_consensus.cc:697] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:30.992007 15669 consensus_queue.cc:237] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:31.004963 15353 catalog_manager.cc:5697] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 1 to 2, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:31.460652 15530 raft_consensus.cc:1275] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.461944 15669 consensus_queue.cc:1048] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.471103 15456 raft_consensus.cc:1275] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.472337 15752 consensus_queue.cc:1048] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:31.516363 15384 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 15324
W20260709 13:05:31.517166 15384 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 15387
W20260709 13:05:31.517836 15384 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3980 after lost signal to thread 15480
W20260709 13:05:31.518415 15384 debug-util.cc:398] Leaking SignalData structure 0x7b0800133a80 after lost signal to thread 15555
W20260709 13:05:31.518966 15384 debug-util.cc:398] Leaking SignalData structure 0x7b080014d680 after lost signal to thread 15629
I20260709 13:05:33.157828 15321 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:05:33.158648 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.182329 15530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:33.182891 15530 raft_consensus.cc:606] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Received request to transfer leadership to TS 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:33.194742 15456 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:44606
I20260709 13:05:33.195441 15456 raft_consensus.cc:606] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Received request to transfer leadership to TS 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:33.196815 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:33.197306 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.501223 15758 raft_consensus.cc:993] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:33.501792 15656 raft_consensus.cc:1081] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Signalling peer 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:33.503539 15604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:37026
I20260709 13:05:33.504163 15604 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.504518 15604 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.509560 15604 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.511382 15604 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:33.512158 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:33.512356 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:33.512753 15456 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.512970 15530 raft_consensus.cc:3055] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:33.513409 15530 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:33.514165 15530 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.515020 15530 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:33.519603 15530 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 3.
I20260709 13:05:33.519825 15456 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 3.
I20260709 13:05:33.521299 15570 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:33.522183 15752 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:33.523620 15752 raft_consensus.cc:697] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:33.524441 15752 consensus_queue.cc:237] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.533797 15353 catalog_manager.cc:5697] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 2 to 3, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.657176 15765 raft_consensus.cc:993] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:33.657640 15712 raft_consensus.cc:1081] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Signalling peer 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:33.659091 15604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:37024
I20260709 13:05:33.659703 15604 raft_consensus.cc:493] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.660084 15604 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.667889 15604 raft_consensus.cc:515] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.670123 15604 leader_election.cc:290] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 2 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:33.671012 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:33.671356 15530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:33.671912 15455 raft_consensus.cc:3055] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:33.671952 15530 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.672360 15455 raft_consensus.cc:740] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:33.673269 15455 consensus_queue.cc:260] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.674237 15455 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:33.679157 15455 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 2.
I20260709 13:05:33.680315 15570 leader_election.cc:304] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:33.680408 15530 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 2.
I20260709 13:05:33.681139 15752 raft_consensus.cc:2804] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.681646 15752 raft_consensus.cc:697] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:33.682569 15752 consensus_queue.cc:237] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:33.690723 15353 catalog_manager.cc:5697] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 1 to 2, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.973565 15530 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:33.974807 15752 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.990593 15455 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:33.992267 15752 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.161490 15530 raft_consensus.cc:1275] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.163034 15759 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:34.172896 15455 raft_consensus.cc:1275] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:34.175920 15770 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.198083 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:34.207845 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:34.208364 15455 raft_consensus.cc:606] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:34.213289 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d442026517747dd9fa820995d4df153"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:34.213797 15455 raft_consensus.cc:606] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:34.218550 15455 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:05:34.219045 15455 raft_consensus.cc:606] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:34.223719 15604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:37030
I20260709 13:05:34.224399 15604 raft_consensus.cc:606] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:34.233316 15604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
mode: GRACEFUL
new_leader_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:37030
I20260709 13:05:34.233857 15604 raft_consensus.cc:606] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Received request to transfer leadership to TS e83b335ba7eb4a9eb371be030165eed2
I20260709 13:05:34.416558 15759 raft_consensus.cc:993] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.417042 15770 raft_consensus.cc:1081] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.418525 15530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59676
I20260709 13:05:34.419147 15530 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.419533 15530 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.422386 15775 raft_consensus.cc:993] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.422837 15712 raft_consensus.cc:1081] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.424190 15529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d442026517747dd9fa820995d4df153"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:34.424640 15529 raft_consensus.cc:493] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.424993 15529 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.426719 15530 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.428786 15530 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 4 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:34.429425 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:34.429988 15455 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.429888 15529 raft_consensus.cc:515] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.431509 15604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:34.431844 15529 leader_election.cc:290] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:34.432276 15604 raft_consensus.cc:3055] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:34.432675 15604 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:34.433605 15604 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.435014 15604 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:34.435257 15455 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 4.
I20260709 13:05:34.439664 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:34.439661 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d442026517747dd9fa820995d4df153" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:34.440596 15605 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.441308 15496 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48a5e07331bd4dfeaa911af27e181436, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:34.442117 15758 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:34.444047 15604 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 4.
I20260709 13:05:34.445446 15455 raft_consensus.cc:3055] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.445812 15455 raft_consensus.cc:740] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:34.446635 15455 consensus_queue.cc:260] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.448029 15455 raft_consensus.cc:3060] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.449527 15605 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.451552 15496 leader_election.cc:304] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:34.455853 15455 raft_consensus.cc:2468] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.457317 15758 raft_consensus.cc:697] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:34.458220 15776 raft_consensus.cc:2804] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.458774 15776 raft_consensus.cc:697] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:34.458633 15758 consensus_queue.cc:237] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.459777 15776 consensus_queue.cc:237] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.470189 15350 catalog_manager.cc:5697] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 3 to 4, leader changed from 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.486122 15350 catalog_manager.cc:5697] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 2 to 3, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.617268 15775 raft_consensus.cc:993] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.617698 15712 raft_consensus.cc:1081] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.618954 15529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:34.619417 15529 raft_consensus.cc:493] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.619740 15529 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.623991 15529 raft_consensus.cc:515] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:34.625506 15529 leader_election.cc:290] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:34.626538 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:34.626884 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a7bf500422d4a9eb71378f748a0abcc" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:34.627125 15605 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.627462 15455 raft_consensus.cc:3055] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.627768 15455 raft_consensus.cc:740] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:34.628449 15455 consensus_queue.cc:260] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:34.629119 15759 raft_consensus.cc:993] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.629554 15770 raft_consensus.cc:1081] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.629576 15455 raft_consensus.cc:3060] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.631213 15529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59676
I20260709 13:05:34.631712 15529 raft_consensus.cc:493] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.632038 15529 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.633011 15605 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.634084 15496 leader_election.cc:304] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:34.634383 15455 raft_consensus.cc:2468] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.634940 15776 raft_consensus.cc:2804] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.635394 15776 raft_consensus.cc:697] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:34.636130 15776 consensus_queue.cc:237] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } }
I20260709 13:05:34.637236 15529 raft_consensus.cc:515] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.639591 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:34.640035 15529 leader_election.cc:290] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:34.640348 15775 raft_consensus.cc:993] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: : Instructing follower e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.640151 15455 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.641289 15712 raft_consensus.cc:1081] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Signalling peer e83b335ba7eb4a9eb371be030165eed2 to start an election
I20260709 13:05:34.642858 15529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
 from {username='slave'} at 127.0.0.1:59686
I20260709 13:05:34.643385 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cdb7b51609c46cd84a305ce37fd71df" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:34.643548 15529 raft_consensus.cc:493] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.643903 15605 raft_consensus.cc:3055] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.644068 15529 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.644268 15605 raft_consensus.cc:740] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:34.645020 15605 consensus_queue.cc:260] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.646112 15605 raft_consensus.cc:3060] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.648149 15455 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.651687 15605 raft_consensus.cc:2468] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.653910 15496 leader_election.cc:304] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:34.654639 15776 raft_consensus.cc:2804] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.655113 15776 raft_consensus.cc:697] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:34.655920 15776 consensus_queue.cc:237] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.656869 15529 raft_consensus.cc:515] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.656704 15350 catalog_manager.cc:5697] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 2 to 3, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:34.658668 15529 leader_election.cc:290] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:34.659667 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:34.659721 15455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "e83b335ba7eb4a9eb371be030165eed2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:34.660310 15605 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.660377 15455 raft_consensus.cc:3055] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.660733 15455 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:34.661422 15455 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.662479 15455 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.664855 15605 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.666162 15496 leader_election.cc:304] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, e83b335ba7eb4a9eb371be030165eed2; no voters: 
I20260709 13:05:34.666829 15776 raft_consensus.cc:2804] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.667285 15776 raft_consensus.cc:697] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Becoming Leader. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:34.667999 15455 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e83b335ba7eb4a9eb371be030165eed2 in term 3.
I20260709 13:05:34.668066 15776 consensus_queue.cc:237] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:34.675604 15350 catalog_manager.cc:5697] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 2 to 3, leader changed from 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.676595 15350 catalog_manager.cc:5697] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 reported cstate change: term changed from 2 to 3, leader changed from 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65) to e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "e83b335ba7eb4a9eb371be030165eed2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.842254 15605 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:34.843621 15758 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:34.844682 15605 raft_consensus.cc:1275] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.846221 15758 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:34.856535 15455 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:34.859758 15776 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:34.863046 15456 raft_consensus.cc:1275] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:34.866822 15777 consensus_queue.cc:1048] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.044229 15605 raft_consensus.cc:1275] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.045588 15758 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.050380 15455 raft_consensus.cc:1275] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.052985 15777 consensus_queue.cc:1048] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.083119 15605 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.084288 15777 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.093597 15455 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.096289 15758 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.118731 15456 raft_consensus.cc:1275] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.119958 15758 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.128400 15605 raft_consensus.cc:1275] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Refusing update from remote peer e83b335ba7eb4a9eb371be030165eed2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.130790 15778 consensus_queue.cc:1048] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.245045 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:37.253106 15529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:37.253835 15529 raft_consensus.cc:606] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:37.256551 15529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:37.257098 15529 raft_consensus.cc:606] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Received request to transfer leadership to TS 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:37.259186 15529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:37.259631 15529 raft_consensus.cc:606] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:37.261976 15529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:37.262487 15529 raft_consensus.cc:606] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Received request to transfer leadership to TS 48a5e07331bd4dfeaa911af27e181436
I20260709 13:05:37.264969 15529 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
mode: GRACEFUL
new_leader_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:58592
I20260709 13:05:37.265348 15529 raft_consensus.cc:606] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Received request to transfer leadership to TS 398fd9d7a289406ba89eb1007f05b391
I20260709 13:05:37.266180 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:37.266600 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.336915 15778 raft_consensus.cc:993] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.337509 15796 raft_consensus.cc:1081] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.339087 15456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48094
I20260709 13:05:37.339614 15456 raft_consensus.cc:493] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.339936 15456 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.345402 15456 raft_consensus.cc:515] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.347184 15456 leader_election.cc:290] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 3 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:37.348230 15529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:37.348721 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "895309ab347d4de79c7dfafe70f4c86d" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:37.349036 15529 raft_consensus.cc:3055] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.349303 15605 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.349341 15529 raft_consensus.cc:740] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:37.350241 15529 consensus_queue.cc:260] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.351202 15529 raft_consensus.cc:3060] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.354673 15605 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 3.
I20260709 13:05:37.355942 15421 leader_election.cc:304] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:37.356283 15529 raft_consensus.cc:2468] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 3.
I20260709 13:05:37.357736 15797 raft_consensus.cc:2804] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.358582 15797 raft_consensus.cc:697] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 3 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:37.359566 15797 consensus_queue.cc:237] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.366500 15353 catalog_manager.cc:5697] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 2 to 3, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.453229 15778 raft_consensus.cc:993] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:37.453737 15796 raft_consensus.cc:1081] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Signalling peer 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:37.455328 15605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:37026
I20260709 13:05:37.455891 15605 raft_consensus.cc:493] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.456228 15605 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.460294 15605 raft_consensus.cc:515] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.461658 15605 leader_election.cc:290] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 3 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:37.462495 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:37.462759 15529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72e34516a2e54c0aa78eab3d9936c864" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:37.463063 15456 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.463328 15529 raft_consensus.cc:3055] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:37.463632 15529 raft_consensus.cc:740] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:37.464370 15529 consensus_queue.cc:260] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.465327 15529 raft_consensus.cc:3060] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.467746 15456 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 3.
I20260709 13:05:37.468940 15570 leader_election.cc:304] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:37.469679 15770 raft_consensus.cc:2804] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:37.469673 15529 raft_consensus.cc:2468] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 3.
I20260709 13:05:37.471189 15770 raft_consensus.cc:697] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:37.471971 15770 consensus_queue.cc:237] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.478159 15353 catalog_manager.cc:5697] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 2 to 3, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.506829 15778 raft_consensus.cc:993] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:37.507267 15796 raft_consensus.cc:1081] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Signalling peer 398fd9d7a289406ba89eb1007f05b391 to start an election
I20260709 13:05:37.508628 15605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189"
dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
 from {username='slave'} at 127.0.0.1:37026
I20260709 13:05:37.509057 15605 raft_consensus.cc:493] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.509325 15605 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.513089 15605 raft_consensus.cc:515] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.514367 15605 leader_election.cc:290] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 4 election: Requested vote from peers 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963), e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303)
I20260709 13:05:37.515314 15456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
I20260709 13:05:37.515532 15529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdd9417ca27d42edaca29a12289aa189" candidate_uuid: "398fd9d7a289406ba89eb1007f05b391" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:37.515782 15456 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.516062 15529 raft_consensus.cc:3055] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.516376 15529 raft_consensus.cc:740] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:37.517004 15529 consensus_queue.cc:260] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.517902 15529 raft_consensus.cc:3060] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.519965 15456 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 4.
I20260709 13:05:37.520869 15570 leader_election.cc:304] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:37.521521 15770 raft_consensus.cc:2804] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:37.521898 15770 raft_consensus.cc:697] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 4 LEADER]: Becoming Leader. State: Replica: 398fd9d7a289406ba89eb1007f05b391, State: Running, Role: LEADER
I20260709 13:05:37.522548 15529 raft_consensus.cc:2468] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398fd9d7a289406ba89eb1007f05b391 in term 4.
I20260709 13:05:37.522687 15770 consensus_queue.cc:237] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.528862 15353 catalog_manager.cc:5697] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 reported cstate change: term changed from 3 to 4, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67). New cstate: current_term: 4 leader_uuid: "398fd9d7a289406ba89eb1007f05b391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.577952 15778 raft_consensus.cc:993] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.578406 15796 raft_consensus.cc:1081] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.579749 15456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48094
I20260709 13:05:37.580168 15456 raft_consensus.cc:493] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.580456 15456 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.584148 15456 raft_consensus.cc:515] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.585636 15456 leader_election.cc:290] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:37.586330 15529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:37.586705 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85bb563836fe4311a2769a9563c2c292" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:37.586920 15529 raft_consensus.cc:3055] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:37.587219 15605 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.587278 15529 raft_consensus.cc:740] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:37.588168 15529 consensus_queue.cc:260] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.589107 15529 raft_consensus.cc:3060] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:37.591696 15605 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:37.592624 15421 leader_election.cc:304] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:37.593349 15797 raft_consensus.cc:2804] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:37.593750 15529 raft_consensus.cc:2468] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 2.
I20260709 13:05:37.593762 15797 raft_consensus.cc:697] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:37.594847 15797 consensus_queue.cc:237] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.601787 15353 catalog_manager.cc:5697] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 1 to 2, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.606544 15778 raft_consensus.cc:993] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: : Instructing follower 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.607033 15796 raft_consensus.cc:1081] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 LEADER]: Signalling peer 48a5e07331bd4dfeaa911af27e181436 to start an election
I20260709 13:05:37.608336 15456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927"
dest_uuid: "48a5e07331bd4dfeaa911af27e181436"
 from {username='slave'} at 127.0.0.1:48094
I20260709 13:05:37.608754 15456 raft_consensus.cc:493] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:37.609115 15456 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.612824 15456 raft_consensus.cc:515] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.614436 15456 leader_election.cc:290] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 5 election: Requested vote from peers e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303), 398fd9d7a289406ba89eb1007f05b391 (127.14.246.67:44853)
I20260709 13:05:37.615427 15605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "398fd9d7a289406ba89eb1007f05b391"
I20260709 13:05:37.615582 15529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6070fc1b68a6420c8589e15bb12ba927" candidate_uuid: "48a5e07331bd4dfeaa911af27e181436" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e83b335ba7eb4a9eb371be030165eed2"
I20260709 13:05:37.615929 15605 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.616209 15529 raft_consensus.cc:3055] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:37.616508 15529 raft_consensus.cc:740] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e83b335ba7eb4a9eb371be030165eed2, State: Running, Role: LEADER
I20260709 13:05:37.617192 15529 consensus_queue.cc:260] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.618108 15529 raft_consensus.cc:3060] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.620024 15605 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 5.
I20260709 13:05:37.620940 15421 leader_election.cc:304] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398fd9d7a289406ba89eb1007f05b391, 48a5e07331bd4dfeaa911af27e181436; no voters: 
I20260709 13:05:37.621589 15797 raft_consensus.cc:2804] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.621987 15797 raft_consensus.cc:697] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 5 LEADER]: Becoming Leader. State: Replica: 48a5e07331bd4dfeaa911af27e181436, State: Running, Role: LEADER
I20260709 13:05:37.622709 15529 raft_consensus.cc:2468] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48a5e07331bd4dfeaa911af27e181436 in term 5.
I20260709 13:05:37.622716 15797 consensus_queue.cc:237] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } }
I20260709 13:05:37.629069 15353 catalog_manager.cc:5697] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 reported cstate change: term changed from 4 to 5, leader changed from e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66) to 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65). New cstate: current_term: 5 leader_uuid: "48a5e07331bd4dfeaa911af27e181436" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.878172 15529 raft_consensus.cc:1275] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.879596 15797 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.888835 15605 raft_consensus.cc:1275] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.891618 15798 consensus_queue.cc:1048] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.891958 15455 raft_consensus.cc:1275] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.893400 15770 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:37.906030 15529 raft_consensus.cc:1275] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.907635 15804 consensus_queue.cc:1048] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:38.072829 15529 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.074030 15804 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.083160 15455 raft_consensus.cc:1275] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Refusing update from remote peer 398fd9d7a289406ba89eb1007f05b391: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:38.084575 15770 consensus_queue.cc:1048] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a5e07331bd4dfeaa911af27e181436" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 33963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:38.110348 15605 raft_consensus.cc:1275] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.111459 15797 consensus_queue.cc:1048] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.119760 15529 raft_consensus.cc:1275] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:38.121387 15798 consensus_queue.cc:1048] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.159595 15605 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 5 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.160841 15798 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398fd9d7a289406ba89eb1007f05b391" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.168980 15529 raft_consensus.cc:1275] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 5 FOLLOWER]: Refusing update from remote peer 48a5e07331bd4dfeaa911af27e181436: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:38.170377 15797 consensus_queue.cc:1048] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e83b335ba7eb4a9eb371be030165eed2" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.267333 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.272393 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
I20260709 13:05:38.294883 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.295573 15321 tablet_replica.cc:333] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.296165 15321 raft_consensus.cc:2243] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.296609 15321 raft_consensus.cc:2272] T ab720634a5fb4d67a3c400c046f8fa8f P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.298873 15321 tablet_replica.cc:333] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.299401 15321 raft_consensus.cc:2243] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.300027 15321 raft_consensus.cc:2272] T 895309ab347d4de79c7dfafe70f4c86d P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.302420 15321 tablet_replica.cc:333] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.302892 15321 raft_consensus.cc:2243] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.303548 15321 raft_consensus.cc:2272] T 85bb563836fe4311a2769a9563c2c292 P 48a5e07331bd4dfeaa911af27e181436 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.305315 15321 tablet_replica.cc:333] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.305820 15321 raft_consensus.cc:2243] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.306201 15321 raft_consensus.cc:2272] T 1a7bf500422d4a9eb71378f748a0abcc P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.307706 15321 tablet_replica.cc:333] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.308161 15321 raft_consensus.cc:2243] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.308876 15321 raft_consensus.cc:2272] T 6070fc1b68a6420c8589e15bb12ba927 P 48a5e07331bd4dfeaa911af27e181436 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.310532 15321 tablet_replica.cc:333] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.310997 15321 raft_consensus.cc:2243] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.311388 15321 raft_consensus.cc:2272] T cdd9417ca27d42edaca29a12289aa189 P 48a5e07331bd4dfeaa911af27e181436 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.313207 15321 tablet_replica.cc:333] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.313658 15321 raft_consensus.cc:2243] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.314047 15321 raft_consensus.cc:2272] T 72e34516a2e54c0aa78eab3d9936c864 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.316039 15321 tablet_replica.cc:333] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.316524 15321 raft_consensus.cc:2243] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.316962 15321 raft_consensus.cc:2272] T 8d442026517747dd9fa820995d4df153 P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.318507 15321 tablet_replica.cc:333] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436: stopping tablet replica
I20260709 13:05:38.318917 15321 raft_consensus.cc:2243] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.319312 15321 raft_consensus.cc:2272] T 8cdb7b51609c46cd84a305ce37fd71df P 48a5e07331bd4dfeaa911af27e181436 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.414080 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
I20260709 13:05:38.431077 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
W20260709 13:05:38.433156 15570 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:05:38.437698 15570 consensus_peers.cc:597] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 -> Peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Couldn't send request to peer e83b335ba7eb4a9eb371be030165eed2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.453953 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.454596 15321 tablet_replica.cc:333] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.455448 15321 raft_consensus.cc:2243] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.456004 15321 raft_consensus.cc:2272] T 895309ab347d4de79c7dfafe70f4c86d P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.458616 15321 tablet_replica.cc:333] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.459051 15321 raft_consensus.cc:2243] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.459383 15321 raft_consensus.cc:2272] T cdd9417ca27d42edaca29a12289aa189 P e83b335ba7eb4a9eb371be030165eed2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.461139 15321 tablet_replica.cc:333] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.461556 15321 raft_consensus.cc:2243] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.461867 15321 raft_consensus.cc:2272] T 6070fc1b68a6420c8589e15bb12ba927 P e83b335ba7eb4a9eb371be030165eed2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.463550 15321 tablet_replica.cc:333] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.464103 15321 raft_consensus.cc:2243] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.464452 15321 raft_consensus.cc:2272] T ab720634a5fb4d67a3c400c046f8fa8f P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.465903 15321 tablet_replica.cc:333] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.466295 15321 raft_consensus.cc:2243] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.466928 15321 raft_consensus.cc:2272] T 8d442026517747dd9fa820995d4df153 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.468434 15321 tablet_replica.cc:333] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.468914 15321 raft_consensus.cc:2243] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.469236 15321 raft_consensus.cc:2272] T 72e34516a2e54c0aa78eab3d9936c864 P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.470907 15321 tablet_replica.cc:333] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.471297 15321 raft_consensus.cc:2243] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.471872 15321 raft_consensus.cc:2272] T 1a7bf500422d4a9eb71378f748a0abcc P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.473361 15321 tablet_replica.cc:333] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.473739 15321 raft_consensus.cc:2243] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.474043 15321 raft_consensus.cc:2272] T 85bb563836fe4311a2769a9563c2c292 P e83b335ba7eb4a9eb371be030165eed2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.475685 15321 tablet_replica.cc:333] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2: stopping tablet replica
I20260709 13:05:38.476121 15321 raft_consensus.cc:2243] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.476861 15321 raft_consensus.cc:2272] T 8cdb7b51609c46cd84a305ce37fd71df P e83b335ba7eb4a9eb371be030165eed2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.502954 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
W20260709 13:05:38.514375 15570 consensus_peers.cc:597] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 -> Peer 48a5e07331bd4dfeaa911af27e181436 (127.14.246.65:33963): Couldn't send request to peer 48a5e07331bd4dfeaa911af27e181436. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:33963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.520536 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
I20260709 13:05:38.541642 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.542250 15321 tablet_replica.cc:333] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.542819 15321 raft_consensus.cc:2243] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.543236 15321 raft_consensus.cc:2272] T 895309ab347d4de79c7dfafe70f4c86d P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.545706 15321 tablet_replica.cc:333] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.546175 15321 raft_consensus.cc:2243] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.546582 15321 raft_consensus.cc:2272] T 8cdb7b51609c46cd84a305ce37fd71df P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.548540 15321 tablet_replica.cc:333] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.549216 15321 raft_consensus.cc:2243] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.549973 15321 raft_consensus.cc:2272] T ab720634a5fb4d67a3c400c046f8fa8f P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:38.550074 15570 consensus_peers.cc:597] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 -> Peer e83b335ba7eb4a9eb371be030165eed2 (127.14.246.66:44303): Couldn't send request to peer e83b335ba7eb4a9eb371be030165eed2. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:44303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.551617 15321 tablet_replica.cc:333] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.552052 15321 raft_consensus.cc:2243] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.552392 15321 raft_consensus.cc:2272] T 6070fc1b68a6420c8589e15bb12ba927 P 398fd9d7a289406ba89eb1007f05b391 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.554270 15321 tablet_replica.cc:333] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.554659 15321 raft_consensus.cc:2243] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.555253 15321 raft_consensus.cc:2272] T cdd9417ca27d42edaca29a12289aa189 P 398fd9d7a289406ba89eb1007f05b391 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.556926 15321 tablet_replica.cc:333] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.557356 15321 raft_consensus.cc:2243] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.557808 15321 raft_consensus.cc:2272] T 1a7bf500422d4a9eb71378f748a0abcc P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.559468 15321 tablet_replica.cc:333] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.559839 15321 raft_consensus.cc:2243] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.560144 15321 raft_consensus.cc:2272] T 85bb563836fe4311a2769a9563c2c292 P 398fd9d7a289406ba89eb1007f05b391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.561815 15321 tablet_replica.cc:333] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.562204 15321 raft_consensus.cc:2243] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.562755 15321 raft_consensus.cc:2272] T 72e34516a2e54c0aa78eab3d9936c864 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.564416 15321 tablet_replica.cc:333] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391: stopping tablet replica
I20260709 13:05:38.564831 15321 raft_consensus.cc:2243] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.565167 15321 raft_consensus.cc:2272] T 8d442026517747dd9fa820995d4df153 P 398fd9d7a289406ba89eb1007f05b391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.591027 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:05:38.606475 15321 master.cc:562] Master@127.14.246.126:45227 shutting down...
I20260709 13:05:38.783723 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.784229 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.784512 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P 295bed0b74dc49e6bc6585f1da98248f: stopping tablet replica
I20260709 13:05:38.823042 15321 master.cc:584] Master@127.14.246.126:45227 shutdown complete.
398fd9d7a289406ba89eb1007f05b391  1
48a5e07331bd4dfeaa911af27e181436  4
e83b335ba7eb4a9eb371be030165eed2  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12604 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:05:38.861905 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:45281
I20260709 13:05:38.863036 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:38.868458 15828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.868561 15827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:38.869033 15830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:38.870993 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:38.872020 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:38.872331 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:38.872535 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602338872515 us; error 0 us; skew 500 ppm
I20260709 13:05:38.873252 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:38.875792 15321 webserver.cc:533] Webserver started at http://127.14.246.126:42933/ using document root <none> and password file <none>
I20260709 13:05:38.876338 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:38.876557 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:38.877174 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:38.878356 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "e0289c74645c446e8f526ee8622e848a"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-bhv2"
I20260709 13:05:38.882911 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:38.886236 15835 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:38.887086 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:38.887315 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "e0289c74645c446e8f526ee8622e848a"
format_stamp: "Formatted at 2026-07-09 13:05:38 on dist-test-slave-bhv2"
I20260709 13:05:38.887548 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:38.901839 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:38.902949 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:38.939049 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:45281
I20260709 13:05:38.939168 15886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:45281 every 8 connection(s)
I20260709 13:05:38.943109 15887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.952205 15887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a: Bootstrap starting.
I20260709 13:05:38.957162 15887 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:38.961622 15887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a: No bootstrap required, opened a new log
I20260709 13:05:38.963765 15887 raft_consensus.cc:359] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER }
I20260709 13:05:38.964144 15887 raft_consensus.cc:385] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:38.964336 15887 raft_consensus.cc:740] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0289c74645c446e8f526ee8622e848a, State: Initialized, Role: FOLLOWER
I20260709 13:05:38.964991 15887 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER }
I20260709 13:05:38.965433 15887 raft_consensus.cc:399] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:38.965637 15887 raft_consensus.cc:493] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:38.965870 15887 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:38.970068 15887 raft_consensus.cc:515] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER }
I20260709 13:05:38.970583 15887 leader_election.cc:304] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0289c74645c446e8f526ee8622e848a; no voters: 
I20260709 13:05:38.971678 15887 leader_election.cc:290] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:38.971951 15890 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:38.973213 15890 raft_consensus.cc:697] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 1 LEADER]: Becoming Leader. State: Replica: e0289c74645c446e8f526ee8622e848a, State: Running, Role: LEADER
I20260709 13:05:38.973868 15890 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER }
I20260709 13:05:38.974887 15887 sys_catalog.cc:565] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:38.978220 15891 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0289c74645c446e8f526ee8622e848a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER } }
I20260709 13:05:38.978463 15892 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0289c74645c446e8f526ee8622e848a. Latest consensus state: current_term: 1 leader_uuid: "e0289c74645c446e8f526ee8622e848a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0289c74645c446e8f526ee8622e848a" member_type: VOTER } }
I20260709 13:05:38.978955 15891 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:38.979233 15892 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:38.984673 15896 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:38.989660 15896 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:38.992470 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:38.997865 15896 catalog_manager.cc:1383] Generated new cluster ID: ef9764c9f0ae4a6da3007bd45aaecbf9
I20260709 13:05:38.998169 15896 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:39.023247 15896 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:39.024405 15896 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:39.036608 15896 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a: Generated new TSK 0
I20260709 13:05:39.037212 15896 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:39.059140 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.064677 15908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.065640 15909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.066861 15911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.067447 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:39.068214 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.068420 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.068576 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602339068562 us; error 0 us; skew 500 ppm
I20260709 13:05:39.069154 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.071285 15321 webserver.cc:533] Webserver started at http://127.14.246.65:37669/ using document root <none> and password file <none>
I20260709 13:05:39.071765 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.071947 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.072229 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.073366 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "5f62de8b67d546ab8f9a6934ec85bded"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.077688 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:39.080596 15916 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.081344 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:05:39.081625 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "5f62de8b67d546ab8f9a6934ec85bded"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.081862 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.097165 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.098306 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.099678 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.101881 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.102161 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.102407 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.102588 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.139382 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:45021
I20260709 13:05:39.139499 15978 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:45021 every 8 connection(s)
I20260709 13:05:39.144186 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.150993 15983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.152109 15984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.155073 15321 server_base.cc:1061] running on GCE node
W20260709 13:05:39.156183 15986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.157094 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.157315 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.157501 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602339157477 us; error 0 us; skew 500 ppm
I20260709 13:05:39.157981 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.160471 15321 webserver.cc:533] Webserver started at http://127.14.246.66:40261/ using document root <none> and password file <none>
I20260709 13:05:39.161109 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.161340 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.161677 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.162885 15979 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45281
I20260709 13:05:39.162983 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "5986e877266041b795c0cfa5c6621282"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.163218 15979 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.163972 15979 heartbeater.cc:507] Master 127.14.246.126:45281 requested a full tablet report, sending...
I20260709 13:05:39.165822 15852 ts_manager.cc:194] Registered new tserver with Master: 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021)
I20260709 13:05:39.167706 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:05:39.167850 15852 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57292
I20260709 13:05:39.171217 15991 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.172122 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:39.172355 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "5986e877266041b795c0cfa5c6621282"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.172581 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.196527 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.197753 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.199095 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.201290 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.201509 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.201752 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.201933 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.240331 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:44099
I20260709 13:05:39.240423 16053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:44099 every 8 connection(s)
I20260709 13:05:39.244859 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:39.251163 16057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.253381 16058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:39.254097 16060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:39.254313 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:39.255405 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:39.255672 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:39.255884 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602339255865 us; error 0 us; skew 500 ppm
I20260709 13:05:39.256546 16054 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45281
I20260709 13:05:39.256577 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:39.257083 16054 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.257843 16054 heartbeater.cc:507] Master 127.14.246.126:45281 requested a full tablet report, sending...
I20260709 13:05:39.259294 15321 webserver.cc:533] Webserver started at http://127.14.246.67:33649/ using document root <none> and password file <none>
I20260709 13:05:39.259817 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:39.259850 15852 ts_manager.cc:194] Registered new tserver with Master: 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:39.260066 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:39.260368 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:39.261308 15852 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57308
I20260709 13:05:39.261538 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "24a7480a2c4740d99cb4d4370e805aad"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.265802 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:05:39.268733 16065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.269505 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:39.269790 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "24a7480a2c4740d99cb4d4370e805aad"
format_stamp: "Formatted at 2026-07-09 13:05:39 on dist-test-slave-bhv2"
I20260709 13:05:39.270068 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:39.284430 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:39.285646 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:39.287113 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:39.289419 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:39.289644 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.289892 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:39.290061 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:39.327627 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:43967
I20260709 13:05:39.327725 16127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:43967 every 8 connection(s)
I20260709 13:05:39.341140 16128 heartbeater.cc:344] Connected to a master server at 127.14.246.126:45281
I20260709 13:05:39.341528 16128 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:39.342218 16128 heartbeater.cc:507] Master 127.14.246.126:45281 requested a full tablet report, sending...
I20260709 13:05:39.344046 15852 ts_manager.cc:194] Registered new tserver with Master: 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.345083 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014402306s
I20260709 13:05:39.345278 15852 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57320
I20260709 13:05:39.368393 15852 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:39.371191 15852 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:39.438445 15944 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaa39f1a228468fad4cd8a1105f06bc (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.439940 15944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaa39f1a228468fad4cd8a1105f06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.442725 15943 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4cf5f0f73445d8d9302949b6faee0 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.444309 15943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4cf5f0f73445d8d9302949b6faee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.462436 16093 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaa39f1a228468fad4cd8a1105f06bc (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.463958 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaa39f1a228468fad4cd8a1105f06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.464234 16092 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4cf5f0f73445d8d9302949b6faee0 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.465682 16092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4cf5f0f73445d8d9302949b6faee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.468439 16091 tablet_service.cc:1511] Processing CreateTablet for tablet 1983f6ae22264263ac7e90a4213bf84d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.469923 16091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1983f6ae22264263ac7e90a4213bf84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.471089 16019 tablet_service.cc:1511] Processing CreateTablet for tablet 2eaa39f1a228468fad4cd8a1105f06bc (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:05:39.472482 16019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaa39f1a228468fad4cd8a1105f06bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.474062 16018 tablet_service.cc:1511] Processing CreateTablet for tablet 6fa4cf5f0f73445d8d9302949b6faee0 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:05:39.474479 16090 tablet_service.cc:1511] Processing CreateTablet for tablet da94d2299cee4eaea7b8820f82208a17 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.475800 16090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da94d2299cee4eaea7b8820f82208a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.476099 15942 tablet_service.cc:1511] Processing CreateTablet for tablet 1983f6ae22264263ac7e90a4213bf84d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.477547 15942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1983f6ae22264263ac7e90a4213bf84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.480088 15941 tablet_service.cc:1511] Processing CreateTablet for tablet da94d2299cee4eaea7b8820f82208a17 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.481105 16017 tablet_service.cc:1511] Processing CreateTablet for tablet 1983f6ae22264263ac7e90a4213bf84d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:05:39.482626 16017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1983f6ae22264263ac7e90a4213bf84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.483052 15940 tablet_service.cc:1511] Processing CreateTablet for tablet 843d224327594adaa4929110689eaadf (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.484470 16018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fa4cf5f0f73445d8d9302949b6faee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.485020 16089 tablet_service.cc:1511] Processing CreateTablet for tablet 843d224327594adaa4929110689eaadf (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.485833 15939 tablet_service.cc:1511] Processing CreateTablet for tablet 702cfa2864cd40328da5cba3bb7ef58f (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.486399 16089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843d224327594adaa4929110689eaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.489451 16016 tablet_service.cc:1511] Processing CreateTablet for tablet da94d2299cee4eaea7b8820f82208a17 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:05:39.490885 16016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da94d2299cee4eaea7b8820f82208a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.492950 16014 tablet_service.cc:1511] Processing CreateTablet for tablet 702cfa2864cd40328da5cba3bb7ef58f (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.494050 16015 tablet_service.cc:1511] Processing CreateTablet for tablet 843d224327594adaa4929110689eaadf (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:05:39.494846 16014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702cfa2864cd40328da5cba3bb7ef58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.496596 16088 tablet_service.cc:1511] Processing CreateTablet for tablet 702cfa2864cd40328da5cba3bb7ef58f (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:05:39.497884 16015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843d224327594adaa4929110689eaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.498198 16088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702cfa2864cd40328da5cba3bb7ef58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.481573 15941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da94d2299cee4eaea7b8820f82208a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.500867 15940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 843d224327594adaa4929110689eaadf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.501575 15939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702cfa2864cd40328da5cba3bb7ef58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.518115 16013 tablet_service.cc:1511] Processing CreateTablet for tablet 64150d244182423e81cb36ff103ca61d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.518873 15938 tablet_service.cc:1511] Processing CreateTablet for tablet 64150d244182423e81cb36ff103ca61d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.519711 16013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64150d244182423e81cb36ff103ca61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.520318 15938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64150d244182423e81cb36ff103ca61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.534052 16087 tablet_service.cc:1511] Processing CreateTablet for tablet 64150d244182423e81cb36ff103ca61d (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:05:39.535403 16087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64150d244182423e81cb36ff103ca61d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.538555 15942 tablet_service.cc:1511] Processing CreateTablet for tablet c99151b0711b498399a58baf793b9a0e (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.539798 15942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99151b0711b498399a58baf793b9a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.539570 16012 tablet_service.cc:1511] Processing CreateTablet for tablet c99151b0711b498399a58baf793b9a0e (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.541555 16012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99151b0711b498399a58baf793b9a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.558312 16143 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:39.574086 16143 tablet_bootstrap.cc:654] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.590544 16091 tablet_service.cc:1511] Processing CreateTablet for tablet c99151b0711b498399a58baf793b9a0e (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:05:39.592392 16091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c99151b0711b498399a58baf793b9a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.603565 16011 tablet_service.cc:1511] Processing CreateTablet for tablet c687b4334a0a4348b188d2097b014cdd (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.605374 16011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c687b4334a0a4348b188d2097b014cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.609541 16015 tablet_service.cc:1511] Processing CreateTablet for tablet 46b73cc4222d49d7a9cbf5a30b201067 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.610780 16015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b73cc4222d49d7a9cbf5a30b201067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.611251 16093 tablet_service.cc:1511] Processing CreateTablet for tablet c687b4334a0a4348b188d2097b014cdd (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.612990 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c687b4334a0a4348b188d2097b014cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.614270 16143 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:39.637398 16143 ts_tablet_manager.cc:1403] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.000s
I20260709 13:05:39.639470 16143 raft_consensus.cc:359] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.639993 16143 raft_consensus.cc:385] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.640317 16143 raft_consensus.cc:740] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.615191 16144 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.615998 15940 tablet_service.cc:1511] Processing CreateTablet for tablet 46b73cc4222d49d7a9cbf5a30b201067 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.615998 15943 tablet_service.cc:1511] Processing CreateTablet for tablet c687b4334a0a4348b188d2097b014cdd (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:05:39.628183 16086 tablet_service.cc:1511] Processing CreateTablet for tablet 46b73cc4222d49d7a9cbf5a30b201067 (DEFAULT_TABLE table=test-workload [id=3c7b50c39b5d4ecc9792684b4081c4d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:05:39.641017 16143 consensus_queue.cc:260] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.641805 15940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b73cc4222d49d7a9cbf5a30b201067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.632540 16146 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:39.643690 15943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c687b4334a0a4348b188d2097b014cdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.662729 16146 tablet_bootstrap.cc:654] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.668431 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46b73cc4222d49d7a9cbf5a30b201067. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:39.679917 16144 tablet_bootstrap.cc:654] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.701736 16146 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:39.703830 16144 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:39.713074 16146 ts_tablet_manager.cc:1403] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.003s
I20260709 13:05:39.713121 16144 ts_tablet_manager.cc:1403] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.098s	user 0.009s	sys 0.005s
I20260709 13:05:39.716553 16144 raft_consensus.cc:359] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.717307 16144 raft_consensus.cc:385] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.717129 16146 raft_consensus.cc:359] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.718345 16146 raft_consensus.cc:385] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.718561 15979 heartbeater.cc:499] Master 127.14.246.126:45281 was elected leader, sending a full tablet report...
I20260709 13:05:39.718484 16144 raft_consensus.cc:740] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.718762 16146 raft_consensus.cc:740] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.719535 16144 consensus_queue.cc:260] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.719785 16146 consensus_queue.cc:260] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.721889 16128 heartbeater.cc:499] Master 127.14.246.126:45281 was elected leader, sending a full tablet report...
I20260709 13:05:39.722425 16144 ts_tablet_manager.cc:1434] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:39.724365 16143 ts_tablet_manager.cc:1434] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.087s	user 0.017s	sys 0.052s
I20260709 13:05:39.725795 16143 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:39.734014 16143 tablet_bootstrap.cc:654] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.741444 16143 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:39.742125 16143 ts_tablet_manager.cc:1403] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:05:39.744076 16144 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.746297 16143 raft_consensus.cc:359] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.747364 16143 raft_consensus.cc:385] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.747836 16143 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.748916 16143 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.751368 16144 tablet_bootstrap.cc:654] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.752303 16143 ts_tablet_manager.cc:1434] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:39.753626 16143 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:39.762269 16143 tablet_bootstrap.cc:654] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.764890 16054 heartbeater.cc:499] Master 127.14.246.126:45281 was elected leader, sending a full tablet report...
I20260709 13:05:39.766083 16144 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:39.766662 16144 ts_tablet_manager.cc:1403] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:05:39.770576 16146 ts_tablet_manager.cc:1434] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.057s	user 0.015s	sys 0.028s
I20260709 13:05:39.772121 16146 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:39.773597 16144 raft_consensus.cc:359] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.774686 16144 raft_consensus.cc:385] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.774978 16143 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:39.775085 16144 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.775550 16143 ts_tablet_manager.cc:1403] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:05:39.776326 16144 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.778781 16144 ts_tablet_manager.cc:1434] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:39.778731 16143 raft_consensus.cc:359] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.779616 16143 raft_consensus.cc:385] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.779886 16146 tablet_bootstrap.cc:654] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.780035 16144 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.779950 16143 raft_consensus.cc:740] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.781193 16143 consensus_queue.cc:260] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.787760 16144 tablet_bootstrap.cc:654] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.794513 16143 ts_tablet_manager.cc:1434] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:05:39.799300 16144 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:39.799458 16143 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:39.799866 16144 ts_tablet_manager.cc:1403] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:05:39.802543 16146 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:39.803010 16146 ts_tablet_manager.cc:1403] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.016s
I20260709 13:05:39.805852 16144 raft_consensus.cc:359] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.806001 16146 raft_consensus.cc:359] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.806394 16143 tablet_bootstrap.cc:654] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.806603 16144 raft_consensus.cc:385] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.806646 16146 raft_consensus.cc:385] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.807057 16144 raft_consensus.cc:740] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.807153 16146 raft_consensus.cc:740] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.808002 16144 consensus_queue.cc:260] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.808001 16146 consensus_queue.cc:260] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.810468 16144 ts_tablet_manager.cc:1434] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:39.810468 16146 ts_tablet_manager.cc:1434] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:39.811496 16146 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:39.811510 16144 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.815653 16147 raft_consensus.cc:493] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.816190 16147 raft_consensus.cc:515] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.819705 16144 tablet_bootstrap.cc:654] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.825977 16147 leader_election.cc:290] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.831794 16146 tablet_bootstrap.cc:654] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.838977 16143 tablet_bootstrap.cc:492] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:39.839428 16143 ts_tablet_manager.cc:1403] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.019s
I20260709 13:05:39.841712 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:39.842386 16103 raft_consensus.cc:2468] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 0.
I20260709 13:05:39.842577 16143 raft_consensus.cc:359] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.843278 16143 raft_consensus.cc:385] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.843525 16143 raft_consensus.cc:740] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.843640 15919 leader_election.cc:304] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:39.844565 16147 raft_consensus.cc:2804] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.844262 16143 consensus_queue.cc:260] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.844964 16147 raft_consensus.cc:493] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.845350 16147 raft_consensus.cc:3060] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.846423 16144 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:39.846643 16146 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:39.846937 16144 ts_tablet_manager.cc:1403] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.008s
I20260709 13:05:39.847232 16146 ts_tablet_manager.cc:1403] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.002s
I20260709 13:05:39.849851 16144 raft_consensus.cc:359] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.850615 16144 raft_consensus.cc:385] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.850912 16144 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.851099 16146 raft_consensus.cc:359] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.852085 16146 raft_consensus.cc:385] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.851838 16144 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.852535 16146 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.853595 16146 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.854676 16144 ts_tablet_manager.cc:1434] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:05:39.855631 16144 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.856377 16146 ts_tablet_manager.cc:1434] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:05:39.857843 16146 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:39.862551 16144 tablet_bootstrap.cc:654] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.866401 16150 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.867002 16150 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.877583 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
W20260709 13:05:39.879077 15917 leader_election.cc:343] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.881466 16151 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.882040 16151 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.882627 16150 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:39.889714 16151 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.871551 16147 raft_consensus.cc:515] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.903009 16143 ts_tablet_manager.cc:1434] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.029s
I20260709 13:05:39.908525 16143 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:39.908993 16146 tablet_bootstrap.cc:654] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.919799 16147 leader_election.cc:290] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.921716 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:39.922500 16103 raft_consensus.cc:3060] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.923233 16144 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:39.923702 16144 ts_tablet_manager.cc:1403] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.002s
I20260709 13:05:39.927814 16143 tablet_bootstrap.cc:654] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:39.928931 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:39.929369 16103 raft_consensus.cc:2468] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 1.
I20260709 13:05:39.929452 16029 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 0.
I20260709 13:05:39.930474 16066 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:39.930550 16144 raft_consensus.cc:359] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.931123 15919 leader_election.cc:304] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:39.931278 16144 raft_consensus.cc:385] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.931422 16150 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.931620 16144 raft_consensus.cc:740] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.931782 16150 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.931825 16147 raft_consensus.cc:2804] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.932229 16150 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.932446 16147 raft_consensus.cc:697] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:39.934722 16162 raft_consensus.cc:493] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.933351 16147 consensus_queue.cc:237] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.935357 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:39.935184 16162 raft_consensus.cc:515] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
W20260709 13:05:39.936662 15917 leader_election.cc:343] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.937307 16162 leader_election.cc:290] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.932389 16144 consensus_queue.cc:260] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.938354 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:39.938561 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:39.939126 16103 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 0.
W20260709 13:05:39.939697 15917 leader_election.cc:343] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.941329 15919 leader_election.cc:304] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 5986e877266041b795c0cfa5c6621282
I20260709 13:05:39.944643 16162 raft_consensus.cc:2804] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.945039 16162 raft_consensus.cc:493] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.945708 16162 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.953819 16144 ts_tablet_manager.cc:1434] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 13:05:39.954820 16144 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:39.957141 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:39.962754 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:39.963462 15953 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:39.945348 16150 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:39.965898 15993 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:39.966688 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:39.967259 16151 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:39.967394 15954 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 0.
I20260709 13:05:39.967646 16151 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.968077 16151 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.958237 16162 raft_consensus.cc:515] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.970618 16162 leader_election.cc:290] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:39.971554 16103 raft_consensus.cc:2393] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5986e877266041b795c0cfa5c6621282 in current term 1: Already voted for candidate 24a7480a2c4740d99cb4d4370e805aad in this term.
I20260709 13:05:39.971709 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:39.973019 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
W20260709 13:05:39.973454 15917 leader_election.cc:343] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:39.973639 16102 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.974107 16146 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:39.975018 16146 ts_tablet_manager.cc:1403] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.004s
I20260709 13:05:39.977875 16146 raft_consensus.cc:359] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:39.978555 16146 raft_consensus.cc:385] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:39.978838 16146 raft_consensus.cc:740] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:39.979506 16146 consensus_queue.cc:260] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
W20260709 13:05:39.986599 15900 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:39.987298 16102 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 1.
I20260709 13:05:39.988922 15919 leader_election.cc:304] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 5986e877266041b795c0cfa5c6621282
I20260709 13:05:39.990196 16162 raft_consensus.cc:2804] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:39.991019 16162 raft_consensus.cc:697] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:39.991446 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:39.992211 15954 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:39.987534 15852 catalog_manager.cc:5697] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 1 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:39.997617 16151 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:40.000947 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:39.992218 16162 consensus_queue.cc:237] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.005692 16150 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.007404 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.008407 16029 raft_consensus.cc:2393] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 24a7480a2c4740d99cb4d4370e805aad in current term 1: Already voted for candidate 5986e877266041b795c0cfa5c6621282 in this term.
I20260709 13:05:40.008823 16146 ts_tablet_manager.cc:1434] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.033s	user 0.018s	sys 0.015s
I20260709 13:05:40.010092 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.010340 15954 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 1.
I20260709 13:05:40.010113 16172 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.011354 16144 tablet_bootstrap.cc:654] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.010882 16102 raft_consensus.cc:2393] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5986e877266041b795c0cfa5c6621282 in current term 1: Already voted for candidate 24a7480a2c4740d99cb4d4370e805aad in this term.
I20260709 13:05:40.011626 16067 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 5986e877266041b795c0cfa5c6621282
I20260709 13:05:40.005405 16174 raft_consensus.cc:493] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.013825 16146 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.006999 16151 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.012820 16150 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.015673 16150 raft_consensus.cc:697] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:40.012743 15994 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5986e877266041b795c0cfa5c6621282; no voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.018153 16151 raft_consensus.cc:2749] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.011276 16172 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.017261 16150 consensus_queue.cc:237] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:40.021605 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.023025 16146 tablet_bootstrap.cc:654] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.023419 15993 leader_election.cc:343] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.016266 16174 raft_consensus.cc:515] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.036700 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.037581 15954 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.039148 15993 leader_election.cc:304] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.040402 16173 raft_consensus.cc:2804] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.040868 16173 raft_consensus.cc:493] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.041297 16173 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.047067 16174 leader_election.cc:290] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.048122 16172 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.048588 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.058207 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
W20260709 13:05:40.058445 15994 leader_election.cc:343] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.058897 16102 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.059993 15994 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.060748 16172 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.061112 16172 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.061980 16172 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.065174 16173 raft_consensus.cc:515] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.066752 16144 tablet_bootstrap.cc:492] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:40.065869 15850 catalog_manager.cc:5697] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 0 to 1, leader changed from <none> to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 1 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.067279 16144 ts_tablet_manager.cc:1403] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.021s
I20260709 13:05:40.069582 16173 leader_election.cc:290] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.074415 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.074654 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:40.075167 15954 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.074875 16144 raft_consensus.cc:359] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.077190 16146 tablet_bootstrap.cc:492] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.077104 16144 raft_consensus.cc:385] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.077831 16146 ts_tablet_manager.cc:1403] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.025s
I20260709 13:05:40.077749 16144 raft_consensus.cc:740] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.079753 16144 consensus_queue.cc:260] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.080925 16102 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.081511 16146 raft_consensus.cc:359] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.082268 16146 raft_consensus.cc:385] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.082551 16146 raft_consensus.cc:740] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.083468 16146 consensus_queue.cc:260] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.085945 16146 ts_tablet_manager.cc:1434] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:40.087113 16146 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.088490 16102 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.088901 16172 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.090575 15994 leader_election.cc:304] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:40.091449 16173 raft_consensus.cc:2804] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.091809 16144 ts_tablet_manager.cc:1434] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:05:40.091924 16173 raft_consensus.cc:697] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.093209 16144 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:40.092933 16173 consensus_queue.cc:237] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.093538 16146 tablet_bootstrap.cc:654] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.098829 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
W20260709 13:05:40.100864 15993 leader_election.cc:343] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.101225 16143 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.102629 16143 ts_tablet_manager.cc:1403] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.199s	user 0.007s	sys 0.022s
I20260709 13:05:40.103991 16144 tablet_bootstrap.cc:654] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.106160 16143 raft_consensus.cc:359] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.107090 16143 raft_consensus.cc:385] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.107460 16143 raft_consensus.cc:740] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.110821 15954 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.114873 16172 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.116403 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.117136 16102 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.108355 16143 consensus_queue.cc:260] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.120471 16143 ts_tablet_manager.cc:1434] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:05:40.123824 16143 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:40.124266 16144 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:40.124905 16144 ts_tablet_manager.cc:1403] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.002s
I20260709 13:05:40.125399 16102 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.126688 15994 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.127784 16173 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.127991 16144 raft_consensus.cc:359] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.128309 16146 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.128261 16173 raft_consensus.cc:697] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.128691 16144 raft_consensus.cc:385] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.129031 16146 ts_tablet_manager.cc:1403] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.001s
I20260709 13:05:40.129041 16144 raft_consensus.cc:740] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.129379 16173 consensus_queue.cc:237] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.130067 16144 consensus_queue.cc:260] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.130893 16143 tablet_bootstrap.cc:654] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.132323 16144 ts_tablet_manager.cc:1434] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:40.131999 16146 raft_consensus.cc:359] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.132823 16146 raft_consensus.cc:385] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.133138 16146 raft_consensus.cc:740] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.133440 16144 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:40.133870 16146 consensus_queue.cc:260] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.136590 16146 ts_tablet_manager.cc:1434] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:40.137804 16146 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.138183 16150 raft_consensus.cc:493] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.138643 16150 raft_consensus.cc:515] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.141101 16150 leader_election.cc:290] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.141994 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.143018 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
W20260709 13:05:40.143529 16067 leader_election.cc:343] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.144580 16146 tablet_bootstrap.cc:654] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:40.151742 16066 leader_election.cc:343] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.152369 16066 leader_election.cc:304] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad; no voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.156582 16143 tablet_bootstrap.cc:492] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.157320 16143 ts_tablet_manager.cc:1403] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.000s
I20260709 13:05:40.160969 16150 raft_consensus.cc:2749] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.162501 16143 raft_consensus.cc:359] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.163546 16143 raft_consensus.cc:385] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.163975 16143 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.166983 16143 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.167388 15850 catalog_manager.cc:5697] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 1 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.171231 16143 ts_tablet_manager.cc:1434] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:05:40.177040 16144 tablet_bootstrap.cc:654] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.178048 16143 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:40.182371 16146 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.182857 16146 ts_tablet_manager.cc:1403] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.024s
I20260709 13:05:40.182814 16173 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.183386 16173 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.185787 16146 raft_consensus.cc:359] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.186477 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.187105 16173 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.187124 15954 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.188285 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
W20260709 13:05:40.189790 15994 leader_election.cc:343] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.190562 16143 tablet_bootstrap.cc:654] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.190810 15993 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:40.191876 16173 raft_consensus.cc:2804] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.192267 16173 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.192700 16173 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.192442 15851 catalog_manager.cc:5697] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.196357 16144 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:40.196808 16144 ts_tablet_manager.cc:1403] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.015s
I20260709 13:05:40.196105 15851 catalog_manager.cc:5697] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.199283 16144 raft_consensus.cc:359] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.199908 16144 raft_consensus.cc:385] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.200176 16144 raft_consensus.cc:740] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.186473 16146 raft_consensus.cc:385] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.200968 16144 consensus_queue.cc:260] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.202931 16144 ts_tablet_manager.cc:1434] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:40.203763 16144 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:40.203574 16173 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.207176 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:40.207898 15954 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.201205 16146 raft_consensus.cc:740] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.209306 16146 consensus_queue.cc:260] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.212873 16146 ts_tablet_manager.cc:1434] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:05:40.212798 16143 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.213680 16143 ts_tablet_manager.cc:1403] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.036s	user 0.026s	sys 0.002s
I20260709 13:05:40.213948 16146 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.215147 15954 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.216296 15993 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.217151 16172 raft_consensus.cc:2804] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.216810 16143 raft_consensus.cc:359] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.217618 16143 raft_consensus.cc:385] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.217609 16172 raft_consensus.cc:697] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.218152 16143 raft_consensus.cc:740] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.218612 16172 consensus_queue.cc:237] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.218969 16143 consensus_queue.cc:260] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.220381 16146 tablet_bootstrap.cc:654] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.220969 16144 tablet_bootstrap.cc:654] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.221692 16143 ts_tablet_manager.cc:1434] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:40.222957 16143 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:40.224931 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
W20260709 13:05:40.226313 15994 leader_election.cc:343] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.227478 16173 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.230501 16143 tablet_bootstrap.cc:654] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.235059 16146 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.235467 16146 ts_tablet_manager.cc:1403] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:05:40.237462 16146 raft_consensus.cc:359] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.237933 16146 raft_consensus.cc:385] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.237949 16144 tablet_bootstrap.cc:492] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:40.238193 16146 raft_consensus.cc:740] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.238591 16144 ts_tablet_manager.cc:1403] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.011s
I20260709 13:05:40.238901 16146 consensus_queue.cc:260] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.241894 16144 raft_consensus.cc:359] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.242754 16144 raft_consensus.cc:385] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.243103 16146 ts_tablet_manager.cc:1434] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:40.243099 16144 raft_consensus.cc:740] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.244189 16146 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.244318 16144 consensus_queue.cc:260] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.244951 15851 catalog_manager.cc:5697] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.249639 16150 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.250118 16150 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.251190 16146 tablet_bootstrap.cc:654] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.252130 16150 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.253840 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.254869 16144 ts_tablet_manager.cc:1434] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:40.255059 16143 tablet_bootstrap.cc:492] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.255424 16143 ts_tablet_manager.cc:1403] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.004s
I20260709 13:05:40.255712 16144 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: Bootstrap starting.
I20260709 13:05:40.255825 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
W20260709 13:05:40.257344 16067 leader_election.cc:343] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.256603 16029 raft_consensus.cc:2468] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 0.
I20260709 13:05:40.258039 16143 raft_consensus.cc:359] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.258728 16143 raft_consensus.cc:385] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.258989 16143 raft_consensus.cc:740] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.259626 16066 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.259827 16143 consensus_queue.cc:260] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.261041 16150 raft_consensus.cc:2804] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.261492 16150 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.261912 16150 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.262253 16144 tablet_bootstrap.cc:654] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.264159 16143 ts_tablet_manager.cc:1434] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:40.265388 16143 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:40.272380 16143 tablet_bootstrap.cc:654] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.272074 16150 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.276261 16150 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.277181 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
W20260709 13:05:40.281002 16067 leader_election.cc:343] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:40.285389 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.286127 16029 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.301795 16029 raft_consensus.cc:2468] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 1.
I20260709 13:05:40.304627 16066 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.305728 16150 raft_consensus.cc:2804] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.306197 16150 raft_consensus.cc:697] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:40.307237 16150 consensus_queue.cc:237] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.308951 16144 tablet_bootstrap.cc:492] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: No bootstrap required, opened a new log
I20260709 13:05:40.309321 16144 ts_tablet_manager.cc:1403] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.010s
I20260709 13:05:40.311452 16146 tablet_bootstrap.cc:492] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.311866 16146 ts_tablet_manager.cc:1403] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.031s
I20260709 13:05:40.311955 16144 raft_consensus.cc:359] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.312667 16144 raft_consensus.cc:385] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.312963 16144 raft_consensus.cc:740] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.313654 16144 consensus_queue.cc:260] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.314267 16146 raft_consensus.cc:359] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.314908 16146 raft_consensus.cc:385] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.315150 16146 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.315286 16144 ts_tablet_manager.cc:1434] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:40.315889 15852 catalog_manager.cc:5697] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 0 to 1, leader changed from <none> to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 1 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:40.316437 16146 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.317329 16143 tablet_bootstrap.cc:492] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.317744 16143 ts_tablet_manager.cc:1403] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.016s
I20260709 13:05:40.318397 16146 ts_tablet_manager.cc:1434] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:40.319229 16146 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: Bootstrap starting.
I20260709 13:05:40.320179 16143 raft_consensus.cc:359] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.320827 16143 raft_consensus.cc:385] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.321084 16143 raft_consensus.cc:740] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.321710 16143 consensus_queue.cc:260] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.325037 16146 tablet_bootstrap.cc:654] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.326066 16143 ts_tablet_manager.cc:1434] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:40.326422 16029 raft_consensus.cc:3060] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.326957 16143 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: Bootstrap starting.
I20260709 13:05:40.333288 16173 raft_consensus.cc:493] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.333829 16143 tablet_bootstrap.cc:654] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:40.333928 16173 raft_consensus.cc:515] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.337548 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.338279 15954 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.338677 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.339499 16102 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.339886 15993 leader_election.cc:304] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.340363 16162 consensus_queue.cc:1048] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.341024 16172 raft_consensus.cc:2804] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.341473 16172 raft_consensus.cc:493] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.341923 16172 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.342638 16173 leader_election.cc:290] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.346016 16143 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: No bootstrap required, opened a new log
I20260709 13:05:40.346508 16143 ts_tablet_manager.cc:1403] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:05:40.348939 16143 raft_consensus.cc:359] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.349642 16143 raft_consensus.cc:385] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.349952 16143 raft_consensus.cc:740] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.350673 16143 consensus_queue.cc:260] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.352689 16143 ts_tablet_manager.cc:1434] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:40.353746 16162 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.354169 16162 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.356324 16162 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.357486 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.358505 16102 raft_consensus.cc:2393] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f62de8b67d546ab8f9a6934ec85bded in current term 1: Already voted for candidate 5986e877266041b795c0cfa5c6621282 in this term.
I20260709 13:05:40.361370 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:40.365217 15917 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f62de8b67d546ab8f9a6934ec85bded; no voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282
I20260709 13:05:40.366199 16162 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.371506 16162 raft_consensus.cc:2749] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.371801 16172 raft_consensus.cc:515] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.373945 16172 leader_election.cc:290] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.374817 16150 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.375275 16150 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.376381 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:40.376945 15954 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.377890 16150 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.381918 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.382680 15953 raft_consensus.cc:2393] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24a7480a2c4740d99cb4d4370e805aad in current term 1: Already voted for candidate 5986e877266041b795c0cfa5c6621282 in this term.
I20260709 13:05:40.382975 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:40.386204 15954 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.386381 16146 tablet_bootstrap.cc:492] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: No bootstrap required, opened a new log
I20260709 13:05:40.386830 16067 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad; no voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.388821 16146 ts_tablet_manager.cc:1403] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.023s
I20260709 13:05:40.387562 15993 leader_election.cc:304] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.389070 16162 consensus_queue.cc:1048] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.389925 16172 raft_consensus.cc:2804] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.390391 16172 raft_consensus.cc:697] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.387948 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.391144 16103 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.391180 16172 consensus_queue.cc:237] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.392073 16146 raft_consensus.cc:359] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.392712 16146 raft_consensus.cc:385] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:40.393004 16146 raft_consensus.cc:740] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Initialized, Role: FOLLOWER
I20260709 13:05:40.393321 16170 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.393579 16146 consensus_queue.cc:260] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.395525 16146 ts_tablet_manager.cc:1434] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:40.401540 16103 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.401933 16170 raft_consensus.cc:2749] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.411294 15851 catalog_manager.cc:5697] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.420284 16170 consensus_queue.cc:1048] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.425498 16205 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.431100 16170 consensus_queue.cc:1048] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.437423 16172 raft_consensus.cc:493] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.437912 16172 raft_consensus.cc:515] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.439877 16172 leader_election.cc:290] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.441483 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.442085 16103 raft_consensus.cc:2468] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.443840 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded" is_pre_election: true
I20260709 13:05:40.444458 15953 raft_consensus.cc:2468] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 0.
I20260709 13:05:40.445703 15994 leader_election.cc:304] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:40.447429 16172 raft_consensus.cc:2804] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.447837 16172 raft_consensus.cc:493] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.448185 16172 raft_consensus.cc:3060] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.454249 16172 raft_consensus.cc:515] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.455801 16028 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.456648 16172 leader_election.cc:290] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.457813 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.458297 16103 raft_consensus.cc:3060] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.461951 15954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c687b4334a0a4348b188d2097b014cdd" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:40.462536 15954 raft_consensus.cc:3060] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.463508 16103 raft_consensus.cc:2468] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.464835 15994 leader_election.cc:304] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:40.465718 16172 raft_consensus.cc:2804] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.466825 16172 raft_consensus.cc:697] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.467885 16162 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.467657 16172 consensus_queue.cc:237] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.468883 15954 raft_consensus.cc:2468] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:40.476663 15850 catalog_manager.cc:5697] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.478128 16162 raft_consensus.cc:493] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.478509 16162 raft_consensus.cc:515] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.480145 16162 leader_election.cc:290] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.480988 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:40.481577 16029 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 0.
I20260709 13:05:40.482143 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.482676 16103 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 0.
I20260709 13:05:40.482555 15917 leader_election.cc:304] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.483420 16162 raft_consensus.cc:2804] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:40.483779 16162 raft_consensus.cc:493] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.484107 16162 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.488843 16162 raft_consensus.cc:515] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.490476 16162 leader_election.cc:290] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.491281 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.491484 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.491730 16029 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.492027 16103 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.496019 16029 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 1.
I20260709 13:05:40.496088 16103 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 1.
I20260709 13:05:40.497097 15917 leader_election.cc:304] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.497781 16162 raft_consensus.cc:2804] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:40.498247 16162 raft_consensus.cc:697] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:40.498976 16162 consensus_queue.cc:237] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.505277 15850 catalog_manager.cc:5697] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 1 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.531946 16173 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.541792 16174 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.625660 16103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:53010
I20260709 13:05:40.626226 16103 raft_consensus.cc:606] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.636389 16103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:53010
I20260709 13:05:40.636919 16103 raft_consensus.cc:606] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.648995 16029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:42240
I20260709 13:05:40.649585 16029 raft_consensus.cc:606] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:40.653039 16174 consensus_queue.cc:1048] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.663957 16172 consensus_queue.cc:1048] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.684365 15954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:47144
I20260709 13:05:40.684959 15954 raft_consensus.cc:606] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Received request to transfer leadership to TS 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:40.688145 16174 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.698438 16173 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.704977 16172 raft_consensus.cc:993] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.705430 16173 raft_consensus.cc:1081] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.706808 15954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:05:40.707238 15954 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.707571 15954 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.711966 15954 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.713635 15954 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.714290 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.714603 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.714891 16029 raft_consensus.cc:3055] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.715193 16103 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.715262 16162 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.715237 16029 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:40.715934 16162 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.716331 16029 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.717711 16029 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.718044 16162 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.719581 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:40.720340 16028 raft_consensus.cc:2393] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f62de8b67d546ab8f9a6934ec85bded in current term 1: Already voted for candidate 24a7480a2c4740d99cb4d4370e805aad in this term.
I20260709 13:05:40.720316 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:40.721915 16103 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:40.722306 15919 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f62de8b67d546ab8f9a6934ec85bded; no voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282
I20260709 13:05:40.723069 16162 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:40.723511 15919 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.724287 16147 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.724354 16029 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:40.724910 16147 raft_consensus.cc:697] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:40.725732 16147 consensus_queue.cc:237] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.729030 16162 raft_consensus.cc:2749] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:40.732362 15851 catalog_manager.cc:5697] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 5986e877266041b795c0cfa5c6621282 (127.14.246.66) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.810922 16170 consensus_queue.cc:1048] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.816845 16210 raft_consensus.cc:993] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.817343 16150 raft_consensus.cc:1081] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.819063 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:05:40.819631 15953 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.820029 15953 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.823905 16210 consensus_queue.cc:1048] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.827236 15953 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.830094 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.832667 15953 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:40.833277 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.833834 16103 raft_consensus.cc:3055] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.834183 16103 raft_consensus.cc:740] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:40.834932 16103 consensus_queue.cc:260] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.835997 16103 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.840346 16103 raft_consensus.cc:2468] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:40.841332 15919 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 5986e877266041b795c0cfa5c6621282
I20260709 13:05:40.842128 16162 raft_consensus.cc:2804] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.842540 16162 raft_consensus.cc:697] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:40.843281 16162 consensus_queue.cc:237] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:40.849596 15852 catalog_manager.cc:5697] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.888605 16210 raft_consensus.cc:993] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.889249 16210 raft_consensus.cc:1081] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:40.890166 16173 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.891099 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:05:40.891669 15953 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:40.891964 15953 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.898057 15953 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:40.900060 15953 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:40.901364 16174 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.902005 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:40.902549 16029 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.901590 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:40.904281 16102 raft_consensus.cc:3055] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:40.904592 16102 raft_consensus.cc:740] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:40.905846 16102 consensus_queue.cc:260] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:40.907758 16102 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:40.914069 16102 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:40.915033 15919 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:40.915923 16162 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:40.916045 16029 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:40.916487 16162 raft_consensus.cc:697] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:40.917399 16162 consensus_queue.cc:237] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:40.927078 15851 catalog_manager.cc:5697] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:40.934839 16173 consensus_queue.cc:1048] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.946380 16172 consensus_queue.cc:1048] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:40.992467 16162 consensus_queue.cc:1048] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.010308 16205 consensus_queue.cc:1048] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:41.017675 16233 raft_consensus.cc:993] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:41.018122 16205 raft_consensus.cc:1081] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Signalling peer 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:41.019503 16102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:52998
I20260709 13:05:41.019999 16102 raft_consensus.cc:493] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:41.020363 16102 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.024904 16102 raft_consensus.cc:515] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:41.026726 16102 leader_election.cc:290] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:41.027375 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:41.027803 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46b73cc4222d49d7a9cbf5a30b201067" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:41.027983 15953 raft_consensus.cc:3055] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:41.028291 15953 raft_consensus.cc:740] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:41.028348 16029 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.029201 15953 consensus_queue.cc:260] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:41.030365 15953 raft_consensus.cc:3060] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.035223 16029 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:41.036500 16066 leader_election.cc:304] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:41.037026 15953 raft_consensus.cc:2468] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:41.037380 16150 raft_consensus.cc:2804] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:41.037901 16150 raft_consensus.cc:697] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:41.038692 16150 consensus_queue.cc:237] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:41.044154 15852 catalog_manager.cc:5697] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 1 to 2, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 2 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.121624 16029 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.122757 16205 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.129869 16102 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.131150 16147 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.228348 16029 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:41.233609 16029 raft_consensus.cc:1275] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.234874 16147 consensus_queue.cc:1048] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.244028 16102 raft_consensus.cc:1275] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.245249 16205 consensus_queue.cc:1048] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.483203 16029 raft_consensus.cc:1275] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.484313 16103 raft_consensus.cc:1275] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.484870 16205 consensus_queue.cc:1048] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.485937 16147 consensus_queue.cc:1048] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.489866 16028 raft_consensus.cc:1275] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.491715 16150 consensus_queue.cc:1048] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.508162 15953 raft_consensus.cc:1275] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:41.509932 16150 consensus_queue.cc:1048] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:43.714524 15321 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:43.715163 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:43.730459 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:43.731020 15953 raft_consensus.cc:606] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Received request to transfer leadership to TS 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:43.733356 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:43.733830 15953 raft_consensus.cc:606] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Received request to transfer leadership to TS 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:43.734776 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:43.735220 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:43.852063 16239 raft_consensus.cc:993] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:43.852506 16240 raft_consensus.cc:1081] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Signalling peer 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:43.854074 16102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:52998
I20260709 13:05:43.854738 16102 raft_consensus.cc:493] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.855073 16102 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.860098 16102 raft_consensus.cc:515] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:43.861797 16102 leader_election.cc:290] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:43.862411 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:43.862794 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:43.863049 15953 raft_consensus.cc:3055] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.863334 16028 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.863997 15953 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:43.864719 15953 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:43.865767 15953 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.869426 16028 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:43.870479 16066 leader_election.cc:304] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:43.871119 16238 raft_consensus.cc:2804] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.871577 15953 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:43.872359 16238 raft_consensus.cc:697] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:43.873242 16238 consensus_queue.cc:237] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:43.879701 15852 catalog_manager.cc:5697] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 1 to 2, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 2 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.165504 16240 raft_consensus.cc:993] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:44.165951 16239 raft_consensus.cc:1081] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Signalling peer 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:44.167446 16102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:52998
I20260709 13:05:44.167925 16102 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.168287 16102 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.173014 16102 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.174327 16102 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:44.175117 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:44.175369 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:44.175707 15953 raft_consensus.cc:3055] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.175875 16028 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.176071 15953 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:44.176911 15953 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.178066 15953 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.182370 16028 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:44.183563 16066 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:44.184280 15953 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:44.184381 16238 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.184927 16238 raft_consensus.cc:697] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:44.185779 16238 consensus_queue.cc:237] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.192188 15852 catalog_manager.cc:5697] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 3 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:44.304101 15953 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.305392 16238 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.314631 16028 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:44.316272 16243 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:44.773494 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.785173 15954 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:44.786576 16243 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.788722 16102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:53010
I20260709 13:05:44.789336 16102 raft_consensus.cc:606] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:44.791640 16028 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:44.793344 16243 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:44.797456 16102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:53010
I20260709 13:05:44.798295 16102 raft_consensus.cc:606] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:44.804384 16028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:42240
I20260709 13:05:44.805063 16028 raft_consensus.cc:606] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:44.809859 16243 raft_consensus.cc:993] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.810449 16238 raft_consensus.cc:1081] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.812063 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:05:44.811856 16028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64150d244182423e81cb36ff103ca61d"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:42240
I20260709 13:05:44.813238 16028 raft_consensus.cc:606] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:44.813568 15953 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.813962 15953 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.819360 15953 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.824381 16029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
mode: GRACEFUL
new_leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:42240
I20260709 13:05:44.824474 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:44.825170 16029 raft_consensus.cc:606] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Received request to transfer leadership to TS 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:44.827467 15953 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 4 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:44.827627 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:44.828106 16102 raft_consensus.cc:3055] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:44.828346 16102 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:44.828903 16102 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.829552 16102 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.836318 16102 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 4.
I20260709 13:05:44.837606 15919 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 5986e877266041b795c0cfa5c6621282
I20260709 13:05:44.838361 16239 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:44.838833 16239 raft_consensus.cc:697] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:44.839568 16239 consensus_queue.cc:237] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.845916 15850 catalog_manager.cc:5697] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 3 to 4, leader changed from 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 4 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.890682 16259 raft_consensus.cc:993] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.891072 16243 raft_consensus.cc:1081] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.892562 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47130
I20260709 13:05:44.893168 15953 raft_consensus.cc:493] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.893525 15953 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.898627 15953 raft_consensus.cc:515] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.900085 15953 leader_election.cc:290] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 3 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:44.900889 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:44.901438 16028 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.901651 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:44.902182 16103 raft_consensus.cc:3055] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:44.902496 16103 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:44.903251 16103 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.904106 16255 raft_consensus.cc:993] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.904405 16103 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.904608 16172 raft_consensus.cc:1081] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:44.906396 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:05:44.906908 15953 raft_consensus.cc:493] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.907212 15953 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.907882 16028 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 3.
I20260709 13:05:44.909093 15917 leader_election.cc:304] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:44.909854 16239 raft_consensus.cc:2804] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.910648 16103 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 3.
I20260709 13:05:44.910998 16239 raft_consensus.cc:697] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:44.911834 16239 consensus_queue.cc:237] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.912989 15953 raft_consensus.cc:515] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.915486 15953 leader_election.cc:290] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:44.915606 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:44.915843 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:44.916402 16028 raft_consensus.cc:3055] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.916374 16103 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.916942 16028 raft_consensus.cc:740] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:44.917706 16028 consensus_queue.cc:260] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.918565 16028 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.918845 15850 catalog_manager.cc:5697] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 2 to 3, leader changed from 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 3 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:44.922451 16103 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:44.923561 16028 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:44.923599 15919 leader_election.cc:304] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:44.924451 16239 raft_consensus.cc:2804] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:44.924918 16239 raft_consensus.cc:697] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:44.925585 16239 consensus_queue.cc:237] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:44.931860 15850 catalog_manager.cc:5697] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 5986e877266041b795c0cfa5c6621282 (127.14.246.66) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.026791 16255 raft_consensus.cc:993] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:45.027243 16255 raft_consensus.cc:1081] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:45.028589 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:05:45.029165 15953 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.029417 15953 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.034346 15953 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.035782 15953 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:45.036559 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:45.036885 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:45.037200 16028 raft_consensus.cc:3055] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.037415 16103 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.037563 16028 raft_consensus.cc:740] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:45.038287 16028 consensus_queue.cc:260] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.039233 16028 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.042243 16103 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:45.043217 15919 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:45.043883 16239 raft_consensus.cc:2804] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.044327 16239 raft_consensus.cc:697] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:45.044661 16028 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:45.045109 16239 consensus_queue.cc:237] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.051667 15850 catalog_manager.cc:5697] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 5986e877266041b795c0cfa5c6621282 (127.14.246.66) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.169284 16172 raft_consensus.cc:993] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: : Instructing follower 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:45.169795 16172 raft_consensus.cc:1081] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Signalling peer 5f62de8b67d546ab8f9a6934ec85bded to start an election
I20260709 13:05:45.171162 15953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64150d244182423e81cb36ff103ca61d"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
 from {username='slave'} at 127.0.0.1:47142
I20260709 13:05:45.171608 15953 raft_consensus.cc:493] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:45.171891 15953 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.176050 15953 raft_consensus.cc:515] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.177641 15953 leader_election.cc:290] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Requested vote from peers 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:45.178436 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:45.178570 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "5f62de8b67d546ab8f9a6934ec85bded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:45.178943 16028 raft_consensus.cc:3055] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:45.179080 16103 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.179286 16028 raft_consensus.cc:740] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:45.179982 16028 consensus_queue.cc:260] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.180910 16028 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.183789 16103 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:45.184796 15919 leader_election.cc:304] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:45.185573 16239 raft_consensus.cc:2804] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:45.185684 16028 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f62de8b67d546ab8f9a6934ec85bded in term 2.
I20260709 13:05:45.186077 16239 raft_consensus.cc:697] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Leader. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:45.186901 16239 consensus_queue.cc:237] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:45.193153 15850 catalog_manager.cc:5697] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded reported cstate change: term changed from 1 to 2, leader changed from 5986e877266041b795c0cfa5c6621282 (127.14.246.66) to 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65). New cstate: current_term: 2 leader_uuid: "5f62de8b67d546ab8f9a6934ec85bded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:45.326452 16103 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:45.327649 16239 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.335337 16028 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.343662 16028 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:45.344918 16239 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.358121 16029 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.359328 16239 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.368151 16103 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:45.369916 16269 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:45.382545 16029 raft_consensus.cc:1275] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.383941 16269 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.393191 16103 raft_consensus.cc:1275] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.395220 16269 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:45.414852 15883 debug-util.cc:398] Leaking SignalData structure 0x7b0800054460 after lost signal to thread 15324
W20260709 13:05:45.415621 15883 debug-util.cc:398] Leaking SignalData structure 0x7b0800054b40 after lost signal to thread 15886
W20260709 13:05:45.416380 15883 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6460 after lost signal to thread 15978
W20260709 13:05:45.417204 15883 debug-util.cc:398] Leaking SignalData structure 0x7b08001d69c0 after lost signal to thread 16053
W20260709 13:05:45.417924 15883 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd500 after lost signal to thread 16127
I20260709 13:05:45.438473 16029 raft_consensus.cc:1275] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.439925 16269 consensus_queue.cc:1048] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.457304 16103 raft_consensus.cc:1275] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.458674 16275 consensus_queue.cc:1048] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.618257 16103 raft_consensus.cc:1275] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.619578 16275 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:45.628952 16029 raft_consensus.cc:1275] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Refusing update from remote peer 5f62de8b67d546ab8f9a6934ec85bded: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:45.630553 16239 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:47.836802 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:47.848385 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "5986e877266041b795c0cfa5c6621282"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:47.849640 15953 raft_consensus.cc:606] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 LEADER]: Received request to transfer leadership to TS 5986e877266041b795c0cfa5c6621282
I20260709 13:05:47.853166 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64150d244182423e81cb36ff103ca61d"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:47.853780 15953 raft_consensus.cc:606] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Received request to transfer leadership to TS 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:47.856721 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:47.857336 15953 raft_consensus.cc:606] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Received request to transfer leadership to TS 24a7480a2c4740d99cb4d4370e805aad
I20260709 13:05:47.860021 15953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
mode: GRACEFUL
new_leader_uuid: "5986e877266041b795c0cfa5c6621282"
 from {username='slave'} at 127.0.0.1:37378
I20260709 13:05:47.860626 15953 raft_consensus.cc:606] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 LEADER]: Received request to transfer leadership to TS 5986e877266041b795c0cfa5c6621282
I20260709 13:05:47.861824 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:47.862457 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:47.924046 16284 raft_consensus.cc:993] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:47.924603 16275 raft_consensus.cc:1081] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Signalling peer 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:47.926116 16103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64150d244182423e81cb36ff103ca61d"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:52998
I20260709 13:05:47.926600 16103 raft_consensus.cc:493] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.926928 16103 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.932096 16103 raft_consensus.cc:515] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.933665 16103 leader_election.cc:290] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:47.934571 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:47.934839 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64150d244182423e81cb36ff103ca61d" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:47.935340 15953 raft_consensus.cc:3055] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:47.935453 16028 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.935619 15953 raft_consensus.cc:740] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:47.936379 15953 consensus_queue.cc:260] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.937366 15953 raft_consensus.cc:3060] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:47.940171 16028 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:47.941226 16066 leader_election.cc:304] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:47.942013 16243 raft_consensus.cc:2804] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:47.942901 16243 raft_consensus.cc:697] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:47.942885 15953 raft_consensus.cc:2468] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:47.943998 16243 consensus_queue.cc:237] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.951156 15851 catalog_manager.cc:5697] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 3 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.960399 16284 raft_consensus.cc:993] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 5986e877266041b795c0cfa5c6621282 to start an election
I20260709 13:05:47.960963 16275 raft_consensus.cc:1081] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 LEADER]: Signalling peer 5986e877266041b795c0cfa5c6621282 to start an election
I20260709 13:05:47.962886 16028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "843d224327594adaa4929110689eaadf"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
 from {username='slave'} at 127.0.0.1:42222
I20260709 13:05:47.963388 16028 raft_consensus.cc:493] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:47.963693 16028 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.968295 16028 raft_consensus.cc:515] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.969858 16028 leader_election.cc:290] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 5 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:47.970777 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:47.971001 16103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "843d224327594adaa4929110689eaadf" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:47.971354 15953 raft_consensus.cc:3055] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:47.971442 16103 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.971700 15953 raft_consensus.cc:740] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:47.972510 15953 consensus_queue.cc:260] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.973675 15953 raft_consensus.cc:3060] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.977871 16103 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 5.
I20260709 13:05:47.979202 15994 leader_election.cc:304] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:47.980010 15953 raft_consensus.cc:2468] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 5.
I20260709 13:05:47.980118 16283 raft_consensus.cc:2804] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:47.981498 16283 raft_consensus.cc:697] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 5 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:47.982299 16283 consensus_queue.cc:237] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:47.988662 15851 catalog_manager.cc:5697] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 4 to 5, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 5 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.479579 16294 raft_consensus.cc:993] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:48.480183 16284 raft_consensus.cc:1081] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Signalling peer 24a7480a2c4740d99cb4d4370e805aad to start an election
I20260709 13:05:48.482008 16102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f"
dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
 from {username='slave'} at 127.0.0.1:52998
I20260709 13:05:48.482556 16102 raft_consensus.cc:493] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.482831 16102 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.484525 16294 raft_consensus.cc:993] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: : Instructing follower 5986e877266041b795c0cfa5c6621282 to start an election
I20260709 13:05:48.484982 16284 raft_consensus.cc:1081] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 LEADER]: Signalling peer 5986e877266041b795c0cfa5c6621282 to start an election
I20260709 13:05:48.486580 16029 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d"
dest_uuid: "5986e877266041b795c0cfa5c6621282"
 from {username='slave'} at 127.0.0.1:42222
I20260709 13:05:48.487092 16029 raft_consensus.cc:493] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:48.487372 16029 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.490028 16102 raft_consensus.cc:515] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.491886 16102 leader_election.cc:290] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:48.496551 15954 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 5 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:48.498373 16102 raft_consensus.cc:1275] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 5 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:48.498287 15953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:48.499231 15953 raft_consensus.cc:3055] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:48.499630 15953 raft_consensus.cc:740] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:48.500969 16283 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.502810 16283 consensus_queue.cc:1048] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:48.500622 15953 consensus_queue.cc:260] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.505776 16029 raft_consensus.cc:515] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.507284 15953 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.509367 15952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5f62de8b67d546ab8f9a6934ec85bded"
I20260709 13:05:48.510102 15952 raft_consensus.cc:3055] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:48.510486 15952 raft_consensus.cc:740] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5f62de8b67d546ab8f9a6934ec85bded, State: Running, Role: LEADER
I20260709 13:05:48.511471 15952 consensus_queue.cc:260] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.513185 15952 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.520790 15953 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:48.523458 15952 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 4.
I20260709 13:05:48.524113 16067 leader_election.cc:304] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:48.526926 16029 leader_election.cc:290] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 4 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:48.527323 16101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1983f6ae22264263ac7e90a4213bf84d" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:48.527784 16243 raft_consensus.cc:2804] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.528010 16101 raft_consensus.cc:3060] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:48.529723 15993 leader_election.cc:304] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded; no voters: 
I20260709 13:05:48.530527 16283 raft_consensus.cc:2804] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:48.531075 16283 raft_consensus.cc:697] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 4 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:48.532042 16283 consensus_queue.cc:237] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.533330 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702cfa2864cd40328da5cba3bb7ef58f" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:48.533831 16029 raft_consensus.cc:3060] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.535614 16101 raft_consensus.cc:2468] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 4.
I20260709 13:05:48.540136 16029 raft_consensus.cc:2468] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:48.541683 16028 raft_consensus.cc:1275] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.546584 15850 catalog_manager.cc:5697] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 3 to 4, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:48.554719 16302 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:48.558084 16243 raft_consensus.cc:697] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:48.558987 16243 consensus_queue.cc:237] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:48.563536 15954 raft_consensus.cc:1275] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.566009 16302 consensus_queue.cc:1048] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:48.578856 15851 catalog_manager.cc:5697] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 3 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.971171 15954 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.972457 16283 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.977890 15952 raft_consensus.cc:1275] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.979183 16302 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.983664 16102 raft_consensus.cc:1275] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:48.985491 16295 consensus_queue.cc:1048] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:48.992025 16028 raft_consensus.cc:1275] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:48.993953 16243 consensus_queue.cc:1048] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:48.995316 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.008507 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
I20260709 13:05:49.040587 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:49.041290 15321 tablet_replica.cc:333] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.041980 15321 raft_consensus.cc:2243] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.042430 15321 raft_consensus.cc:2272] T c687b4334a0a4348b188d2097b014cdd P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.044330 15321 tablet_replica.cc:333] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.044910 15321 raft_consensus.cc:2243] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.045377 15321 raft_consensus.cc:2272] T 46b73cc4222d49d7a9cbf5a30b201067 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.047183 15321 tablet_replica.cc:333] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.047694 15321 raft_consensus.cc:2243] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.048077 15321 raft_consensus.cc:2272] T 702cfa2864cd40328da5cba3bb7ef58f P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.050364 15321 tablet_replica.cc:333] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.050866 15321 raft_consensus.cc:2243] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.051244 15321 raft_consensus.cc:2272] T 843d224327594adaa4929110689eaadf P 5f62de8b67d546ab8f9a6934ec85bded [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.053268 15321 tablet_replica.cc:333] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.053763 15321 raft_consensus.cc:2243] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.054491 15321 raft_consensus.cc:2272] T c99151b0711b498399a58baf793b9a0e P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.056074 15321 tablet_replica.cc:333] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.056706 15321 raft_consensus.cc:2243] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.057675 15321 raft_consensus.cc:2272] T da94d2299cee4eaea7b8820f82208a17 P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.059778 15321 tablet_replica.cc:333] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.060190 15321 raft_consensus.cc:2243] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.060932 15321 raft_consensus.cc:2272] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5f62de8b67d546ab8f9a6934ec85bded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.062749 15321 tablet_replica.cc:333] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.063290 15321 raft_consensus.cc:2243] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.063740 15321 raft_consensus.cc:2272] T 64150d244182423e81cb36ff103ca61d P 5f62de8b67d546ab8f9a6934ec85bded [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.066280 15321 tablet_replica.cc:333] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.066766 15321 raft_consensus.cc:2243] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:49.067158 15321 raft_consensus.cc:2272] T 1983f6ae22264263ac7e90a4213bf84d P 5f62de8b67d546ab8f9a6934ec85bded [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:49.069188 15321 tablet_replica.cc:333] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded: stopping tablet replica
I20260709 13:05:49.069648 15321 raft_consensus.cc:2243] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:49.070328 15321 raft_consensus.cc:2272] T 2eaa39f1a228468fad4cd8a1105f06bc P 5f62de8b67d546ab8f9a6934ec85bded [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:49.077227 15993 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:05:49.080410 15993 consensus_peers.cc:597] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.097859 16067 consensus_peers.cc:597] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.270385 15993 consensus_peers.cc:597] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.274542 16067 consensus_peers.cc:597] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.380223 15975 debug-util.cc:398] Leaking SignalData structure 0x7b08001526a0 after lost signal to thread 15324
W20260709 13:05:49.381011 15975 debug-util.cc:398] Leaking SignalData structure 0x7b0800152d80 after lost signal to thread 15886
W20260709 13:05:49.381739 15975 debug-util.cc:398] Leaking SignalData structure 0x7b08001edc00 after lost signal to thread 15978
W20260709 13:05:49.382397 15975 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0ba0 after lost signal to thread 16053
W20260709 13:05:49.383055 15975 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8400 after lost signal to thread 16127
W20260709 13:05:49.424160 16067 consensus_peers.cc:597] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:49.527294 15993 consensus_peers.cc:597] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:49.976016 16243 raft_consensus.cc:493] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:49.976536 16243 raft_consensus.cc:515] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:49.978456 16243 leader_election.cc:290] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:49.979899 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
W20260709 13:05:49.982529 16067 leader_election.cc:336] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:49.982934 16067 leader_election.cc:304] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad; no voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:49.983613 16243 raft_consensus.cc:2749] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:50.087502 15321 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15975)
I20260709 13:05:50.111285 16243 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.111855 16243 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.114974 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:50.115564 16243 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
W20260709 13:05:50.118613 16067 leader_election.cc:336] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.119140 16067 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad; no voters: 5986e877266041b795c0cfa5c6621282, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.119980 16243 raft_consensus.cc:2749] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.132359 16300 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.132892 16300 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:50.134660 16300 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:50.135756 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
W20260709 13:05:50.138847 15993 leader_election.cc:336] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.139199 15993 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5986e877266041b795c0cfa5c6621282; no voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.139768 16300 raft_consensus.cc:2749] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.208869 16300 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.209324 16300 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.210865 16300 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:50.211971 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:50.212620 16102 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 2.
I20260709 13:05:50.213635 16300 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.213792 15994 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:50.214625 16295 raft_consensus.cc:2804] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:50.214998 16295 raft_consensus.cc:493] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.214202 16300 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
W20260709 13:05:50.215301 15993 leader_election.cc:336] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.215396 16295 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.217978 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:50.219444 16300 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
W20260709 13:05:50.221513 15993 leader_election.cc:336] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.221931 15993 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5986e877266041b795c0cfa5c6621282; no voters: 24a7480a2c4740d99cb4d4370e805aad, 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.222673 16300 raft_consensus.cc:2749] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.222460 16295 raft_consensus.cc:515] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.224350 16295 leader_election.cc:290] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:50.225426 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c99151b0711b498399a58baf793b9a0e" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:50.225939 16102 raft_consensus.cc:3060] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:50.228113 15993 leader_election.cc:336] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.231014 16102 raft_consensus.cc:2468] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 3.
I20260709 13:05:50.232110 15994 leader_election.cc:304] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.232877 16295 raft_consensus.cc:2804] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.233392 16295 raft_consensus.cc:697] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 3 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:50.234246 16295 consensus_queue.cc:237] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.242303 15850 catalog_manager.cc:5697] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.363878 16295 raft_consensus.cc:493] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.364455 16295 raft_consensus.cc:515] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.366480 16295 leader_election.cc:290] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:50.367738 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad" is_pre_election: true
I20260709 13:05:50.368391 16102 raft_consensus.cc:2468] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 1.
I20260709 13:05:50.369463 15994 leader_election.cc:304] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:50.370294 16295 raft_consensus.cc:2804] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:50.370725 15993 leader_election.cc:336] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.370822 16295 raft_consensus.cc:493] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.371372 16295 raft_consensus.cc:3060] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.379809 16295 raft_consensus.cc:515] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.382198 16295 leader_election.cc:290] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67:43967)
I20260709 13:05:50.383368 16102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fa4cf5f0f73445d8d9302949b6faee0" candidate_uuid: "5986e877266041b795c0cfa5c6621282" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "24a7480a2c4740d99cb4d4370e805aad"
I20260709 13:05:50.383967 16102 raft_consensus.cc:3060] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:50.385604 15993 leader_election.cc:336] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.391125 16102 raft_consensus.cc:2468] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5986e877266041b795c0cfa5c6621282 in term 2.
I20260709 13:05:50.392372 15994 leader_election.cc:304] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.393327 16295 raft_consensus.cc:2804] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.393815 16295 raft_consensus.cc:697] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 2 LEADER]: Becoming Leader. State: Replica: 5986e877266041b795c0cfa5c6621282, State: Running, Role: LEADER
I20260709 13:05:50.394737 16295 consensus_queue.cc:237] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.402969 15850 catalog_manager.cc:5697] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 reported cstate change: term changed from 1 to 2, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 5986e877266041b795c0cfa5c6621282 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "5986e877266041b795c0cfa5c6621282" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.504757 16243 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.505518 16243 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.508021 16243 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:50.509275 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:50.509974 16028 raft_consensus.cc:2468] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:50.511085 16066 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:50.512053 16243 raft_consensus.cc:2804] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:50.512228 16067 leader_election.cc:336] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.512498 16243 raft_consensus.cc:493] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.512948 16243 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.518517 16243 raft_consensus.cc:515] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.520287 16243 leader_election.cc:290] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:50.521499 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da94d2299cee4eaea7b8820f82208a17" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:50.522163 16028 raft_consensus.cc:3060] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:50.524273 16067 leader_election.cc:336] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.529721 16028 raft_consensus.cc:2468] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:50.529935 16243 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.530524 16243 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:50.530923 16066 leader_election.cc:304] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.532510 16243 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:50.532708 16331 raft_consensus.cc:2804] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.533921 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282" is_pre_election: true
I20260709 13:05:50.534186 16331 raft_consensus.cc:697] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:50.534705 16028 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 2.
I20260709 13:05:50.536362 16066 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 
I20260709 13:05:50.536020 16331 consensus_queue.cc:237] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } }
I20260709 13:05:50.537328 16243 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:50.537779 16243 raft_consensus.cc:493] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5f62de8b67d546ab8f9a6934ec85bded)
I20260709 13:05:50.538185 16243 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:50.542601 16067 leader_election.cc:336] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.545977 15850 catalog_manager.cc:5697] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 3 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.546875 16243 raft_consensus.cc:515] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:50.549908 16243 leader_election.cc:290] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Requested vote from peers 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021), 5986e877266041b795c0cfa5c6621282 (127.14.246.66:44099)
I20260709 13:05:50.550683 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eaa39f1a228468fad4cd8a1105f06bc" candidate_uuid: "24a7480a2c4740d99cb4d4370e805aad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5986e877266041b795c0cfa5c6621282"
I20260709 13:05:50.551276 16028 raft_consensus.cc:3060] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:50.553965 16067 leader_election.cc:336] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111)
I20260709 13:05:50.557747 16028 raft_consensus.cc:2468] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24a7480a2c4740d99cb4d4370e805aad in term 3.
I20260709 13:05:50.558749 16066 leader_election.cc:304] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24a7480a2c4740d99cb4d4370e805aad, 5986e877266041b795c0cfa5c6621282; no voters: 5f62de8b67d546ab8f9a6934ec85bded
I20260709 13:05:50.559487 16243 raft_consensus.cc:2804] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.560052 16243 raft_consensus.cc:697] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Becoming Leader. State: Replica: 24a7480a2c4740d99cb4d4370e805aad, State: Running, Role: LEADER
I20260709 13:05:50.560948 16243 consensus_queue.cc:237] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } }
I20260709 13:05:50.569980 15850 catalog_manager.cc:5697] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad reported cstate change: term changed from 2 to 3, leader changed from 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65) to 24a7480a2c4740d99cb4d4370e805aad (127.14.246.67). New cstate: current_term: 3 leader_uuid: "24a7480a2c4740d99cb4d4370e805aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f62de8b67d546ab8f9a6934ec85bded" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 45021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:50.695091 15993 consensus_peers.cc:597] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.817044 16102 raft_consensus.cc:1275] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.818390 16295 consensus_queue.cc:1048] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.911234 16102 raft_consensus.cc:1275] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Refusing update from remote peer 5986e877266041b795c0cfa5c6621282: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.912432 16295 consensus_queue.cc:1048] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24a7480a2c4740d99cb4d4370e805aad" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 43967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:50.927249 15993 consensus_peers.cc:597] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:50.927822 16067 consensus_peers.cc:597] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:50.984966 16028 raft_consensus.cc:1275] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.986235 16243 consensus_queue.cc:1048] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:50.990348 16029 raft_consensus.cc:1275] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Refusing update from remote peer 24a7480a2c4740d99cb4d4370e805aad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:50.991911 16243 consensus_queue.cc:1048] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5986e877266041b795c0cfa5c6621282" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 44099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:51.022148 16067 consensus_peers.cc:597] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:51.087975 15321 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15975)
W20260709 13:05:51.475564 16067 consensus_peers.cc:597] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:51.499907 16067 consensus_peers.cc:597] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:51.582798 15993 consensus_peers.cc:597] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:51.809741 15993 consensus_peers.cc:597] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:51.854457 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
I20260709 13:05:51.873790 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
W20260709 13:05:51.893620 16067 consensus_peers.cc:597] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad -> Peer 5f62de8b67d546ab8f9a6934ec85bded (127.14.246.65:45021): Couldn't send request to peer 5f62de8b67d546ab8f9a6934ec85bded. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:45021: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:05:51.899938 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:51.900564 15321 tablet_replica.cc:333] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.901201 15321 raft_consensus.cc:2243] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.901854 15321 raft_consensus.cc:2272] T 1983f6ae22264263ac7e90a4213bf84d P 5986e877266041b795c0cfa5c6621282 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.903987 15321 tablet_replica.cc:333] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.904469 15321 raft_consensus.cc:2243] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.905202 15321 raft_consensus.cc:2272] T c687b4334a0a4348b188d2097b014cdd P 5986e877266041b795c0cfa5c6621282 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.906893 15321 tablet_replica.cc:333] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.907344 15321 raft_consensus.cc:2243] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.907704 15321 raft_consensus.cc:2272] T 702cfa2864cd40328da5cba3bb7ef58f P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.909307 15321 tablet_replica.cc:333] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.909747 15321 raft_consensus.cc:2243] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.910112 15321 raft_consensus.cc:2272] T 46b73cc4222d49d7a9cbf5a30b201067 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.911695 15321 tablet_replica.cc:333] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.912159 15321 raft_consensus.cc:2243] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.912755 15321 raft_consensus.cc:2272] T 843d224327594adaa4929110689eaadf P 5986e877266041b795c0cfa5c6621282 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.914283 15321 tablet_replica.cc:333] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.914680 15321 raft_consensus.cc:2243] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.915359 15321 raft_consensus.cc:2272] T c99151b0711b498399a58baf793b9a0e P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.916889 15321 tablet_replica.cc:333] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.917308 15321 raft_consensus.cc:2243] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.917652 15321 raft_consensus.cc:2272] T da94d2299cee4eaea7b8820f82208a17 P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.919472 15321 tablet_replica.cc:333] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.920130 15321 raft_consensus.cc:2243] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.920509 15321 raft_consensus.cc:2272] T 64150d244182423e81cb36ff103ca61d P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.922194 15321 tablet_replica.cc:333] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.922832 15321 raft_consensus.cc:2243] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.923579 15321 raft_consensus.cc:2272] T 6fa4cf5f0f73445d8d9302949b6faee0 P 5986e877266041b795c0cfa5c6621282 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.925568 15321 tablet_replica.cc:333] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282: stopping tablet replica
I20260709 13:05:51.926160 15321 raft_consensus.cc:2243] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:51.926585 15321 raft_consensus.cc:2272] T 2eaa39f1a228468fad4cd8a1105f06bc P 5986e877266041b795c0cfa5c6621282 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.956072 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
I20260709 13:05:51.973174 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
I20260709 13:05:51.995007 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:51.995715 15321 tablet_replica.cc:333] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:51.996353 15321 raft_consensus.cc:2243] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:51.997140 15321 raft_consensus.cc:2272] T 702cfa2864cd40328da5cba3bb7ef58f P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:51.998899 15321 tablet_replica.cc:333] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:51.999411 15321 raft_consensus.cc:2243] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.000085 15321 raft_consensus.cc:2272] T 46b73cc4222d49d7a9cbf5a30b201067 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.001847 15321 tablet_replica.cc:333] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.002357 15321 raft_consensus.cc:2243] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.002744 15321 raft_consensus.cc:2272] T c687b4334a0a4348b188d2097b014cdd P 24a7480a2c4740d99cb4d4370e805aad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.004447 15321 tablet_replica.cc:333] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.004997 15321 raft_consensus.cc:2243] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.005663 15321 raft_consensus.cc:2272] T 64150d244182423e81cb36ff103ca61d P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.007418 15321 tablet_replica.cc:333] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.007980 15321 raft_consensus.cc:2243] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.008368 15321 raft_consensus.cc:2272] T 6fa4cf5f0f73445d8d9302949b6faee0 P 24a7480a2c4740d99cb4d4370e805aad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.009922 15321 tablet_replica.cc:333] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.010411 15321 raft_consensus.cc:2243] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.011111 15321 raft_consensus.cc:2272] T da94d2299cee4eaea7b8820f82208a17 P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.012868 15321 tablet_replica.cc:333] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.013343 15321 raft_consensus.cc:2243] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.013732 15321 raft_consensus.cc:2272] T c99151b0711b498399a58baf793b9a0e P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.015244 15321 tablet_replica.cc:333] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.015727 15321 raft_consensus.cc:2243] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.016129 15321 raft_consensus.cc:2272] T 843d224327594adaa4929110689eaadf P 24a7480a2c4740d99cb4d4370e805aad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.017695 15321 tablet_replica.cc:333] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.018137 15321 raft_consensus.cc:2243] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:52.018541 15321 raft_consensus.cc:2272] T 1983f6ae22264263ac7e90a4213bf84d P 24a7480a2c4740d99cb4d4370e805aad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.019873 15321 tablet_replica.cc:333] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad: stopping tablet replica
I20260709 13:05:52.020313 15321 raft_consensus.cc:2243] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.020928 15321 raft_consensus.cc:2272] T 2eaa39f1a228468fad4cd8a1105f06bc P 24a7480a2c4740d99cb4d4370e805aad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.048179 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:05:52.067108 15321 master.cc:562] Master@127.14.246.126:45281 shutting down...
I20260709 13:05:52.089025 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:52.089609 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:52.089979 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P e0289c74645c446e8f526ee8622e848a: stopping tablet replica
I20260709 13:05:52.125833 15321 master.cc:584] Master@127.14.246.126:45281 shutdown complete.
24a7480a2c4740d99cb4d4370e805aad  1
5986e877266041b795c0cfa5c6621282  4
5f62de8b67d546ab8f9a6934ec85bded  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (13310 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:52.172130 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:40851
I20260709 13:05:52.173384 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:52.179369 16344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.179369 16343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.180102 16346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.180979 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:52.182049 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:52.182251 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:52.182482 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602352182444 us; error 0 us; skew 500 ppm
I20260709 13:05:52.183075 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:52.186415 15321 webserver.cc:533] Webserver started at http://127.14.246.126:36853/ using document root <none> and password file <none>
I20260709 13:05:52.186924 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:52.187084 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:52.187418 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:52.188577 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "e0b8327892f143ffba83cd5a4c97d808"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.193354 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:05:52.196745 16351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.197579 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:52.197868 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "e0b8327892f143ffba83cd5a4c97d808"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.198189 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:52.209955 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:52.211226 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:52.250620 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:40851
I20260709 13:05:52.250706 16402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:40851 every 8 connection(s)
I20260709 13:05:52.254469 16403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.265283 16403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Bootstrap starting.
I20260709 13:05:52.269982 16403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:52.274217 16403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: No bootstrap required, opened a new log
I20260709 13:05:52.276281 16403 raft_consensus.cc:359] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER }
I20260709 13:05:52.276669 16403 raft_consensus.cc:385] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:52.276932 16403 raft_consensus.cc:740] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0b8327892f143ffba83cd5a4c97d808, State: Initialized, Role: FOLLOWER
I20260709 13:05:52.277575 16403 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER }
I20260709 13:05:52.278017 16403 raft_consensus.cc:399] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:52.278240 16403 raft_consensus.cc:493] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:52.278499 16403 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:52.282534 16403 raft_consensus.cc:515] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER }
I20260709 13:05:52.283051 16403 leader_election.cc:304] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0b8327892f143ffba83cd5a4c97d808; no voters: 
I20260709 13:05:52.284268 16403 leader_election.cc:290] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:52.284617 16406 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:52.286087 16406 raft_consensus.cc:697] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 1 LEADER]: Becoming Leader. State: Replica: e0b8327892f143ffba83cd5a4c97d808, State: Running, Role: LEADER
I20260709 13:05:52.286813 16406 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER }
I20260709 13:05:52.287300 16403 sys_catalog.cc:565] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:52.291558 16407 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0b8327892f143ffba83cd5a4c97d808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER } }
I20260709 13:05:52.291857 16408 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0b8327892f143ffba83cd5a4c97d808. Latest consensus state: current_term: 1 leader_uuid: "e0b8327892f143ffba83cd5a4c97d808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0b8327892f143ffba83cd5a4c97d808" member_type: VOTER } }
I20260709 13:05:52.292402 16408 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:52.292306 16407 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:52.294548 16412 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:52.302714 16412 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:52.303869 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:52.311599 16412 catalog_manager.cc:1383] Generated new cluster ID: ad40ac008f81461c9350225d004ff100
I20260709 13:05:52.311902 16412 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:52.339912 16412 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:52.341333 16412 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:52.359647 16412 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Generated new TSK 0
I20260709 13:05:52.360308 16412 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:52.371022 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:52.377763 16424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.378523 16425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.380033 16427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.380609 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:52.381608 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:52.381799 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:52.381949 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602352381937 us; error 0 us; skew 500 ppm
I20260709 13:05:52.382491 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:52.385218 15321 webserver.cc:533] Webserver started at http://127.14.246.65:44665/ using document root <none> and password file <none>
I20260709 13:05:52.385673 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:52.385828 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:52.386034 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:52.387029 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "6f34f184d0dd4382bee8790b4c077d05"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.391641 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:05:52.394809 16432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.395557 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:05:52.395810 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "6f34f184d0dd4382bee8790b4c077d05"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.396045 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:52.404857 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:52.406178 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:52.407735 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:52.410092 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:52.410288 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.410480 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:52.410660 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.453392 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:40627
I20260709 13:05:52.453478 16494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:40627 every 8 connection(s)
I20260709 13:05:52.458928 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:52.466980 16499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.468750 16500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.474963 16495 heartbeater.cc:344] Connected to a master server at 127.14.246.126:40851
I20260709 13:05:52.475677 16495 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:52.476994 16495 heartbeater.cc:507] Master 127.14.246.126:40851 requested a full tablet report, sending...
I20260709 13:05:52.480988 16368 ts_manager.cc:194] Registered new tserver with Master: 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:05:52.484637 16368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54058
I20260709 13:05:52.498729 15321 server_base.cc:1061] running on GCE node
W20260709 13:05:52.499097 16502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.500485 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:52.500694 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:52.500936 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602352500919 us; error 0 us; skew 500 ppm
I20260709 13:05:52.501528 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:52.503932 15321 webserver.cc:533] Webserver started at http://127.14.246.66:44709/ using document root <none> and password file <none>
I20260709 13:05:52.504427 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:52.504588 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:52.504933 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:52.505986 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "59746530bb6d4726893c108602ffac27"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.510504 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:05:52.514003 16507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.514868 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:05:52.515195 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "59746530bb6d4726893c108602ffac27"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.515492 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:52.561934 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:52.563264 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:52.564898 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:52.567307 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:52.567581 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.567847 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:52.568042 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.611737 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:37367
I20260709 13:05:52.611840 16569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:37367 every 8 connection(s)
I20260709 13:05:52.617091 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:52.625326 16573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:52.628665 16574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.628940 16570 heartbeater.cc:344] Connected to a master server at 127.14.246.126:40851
I20260709 13:05:52.629465 16570 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:52.629596 16576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:52.630363 15321 server_base.cc:1061] running on GCE node
I20260709 13:05:52.630494 16570 heartbeater.cc:507] Master 127.14.246.126:40851 requested a full tablet report, sending...
I20260709 13:05:52.631364 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:52.631664 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:52.631877 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602352631858 us; error 0 us; skew 500 ppm
I20260709 13:05:52.632500 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:52.633054 16368 ts_manager.cc:194] Registered new tserver with Master: 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:52.634552 16368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54070
I20260709 13:05:52.637157 15321 webserver.cc:533] Webserver started at http://127.14.246.67:34981/ using document root <none> and password file <none>
I20260709 13:05:52.637668 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:52.637878 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:52.638145 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:52.639238 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "8e851f11d27b4a83aa395e05c4be6808"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.643628 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:05:52.646798 16581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.647665 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:05:52.647913 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "8e851f11d27b4a83aa395e05c4be6808"
format_stamp: "Formatted at 2026-07-09 13:05:52 on dist-test-slave-bhv2"
I20260709 13:05:52.648157 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:52.666154 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:52.667387 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:52.668910 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:52.671264 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:52.671478 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.671810 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:52.671989 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:52.717823 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:44347
I20260709 13:05:52.717927 16643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:44347 every 8 connection(s)
I20260709 13:05:52.731768 16644 heartbeater.cc:344] Connected to a master server at 127.14.246.126:40851
I20260709 13:05:52.732206 16644 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:52.733000 16644 heartbeater.cc:507] Master 127.14.246.126:40851 requested a full tablet report, sending...
I20260709 13:05:52.735061 16368 ts_manager.cc:194] Registered new tserver with Master: 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:52.735486 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014556169s
I20260709 13:05:52.736440 16368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33444
I20260709 13:05:52.762310 16368 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33456:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:52.768898 16368 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:52.973670 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8afa934df14d3bb3e773c41ab520ec (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:52.973820 16608 tablet_service.cc:1511] Processing CreateTablet for tablet d994045524f7444ba202d5cf05c49d7f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:52.975194 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8afa934df14d3bb3e773c41ab520ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.975257 16608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d994045524f7444ba202d5cf05c49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.978036 16458 tablet_service.cc:1511] Processing CreateTablet for tablet 43cea492ee7e4f91b2ad509449c832f1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:52.978709 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 43cea492ee7e4f91b2ad509449c832f1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:52.979436 16458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cea492ee7e4f91b2ad509449c832f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.980079 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cea492ee7e4f91b2ad509449c832f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.980656 16459 tablet_service.cc:1511] Processing CreateTablet for tablet d994045524f7444ba202d5cf05c49d7f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:52.982033 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d994045524f7444ba202d5cf05c49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.982084 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0af8eb7234215a518fd144bd450af (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:52.983413 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0af8eb7234215a518fd144bd450af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.986847 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 605e831b8c574943b8b259e490e4d208 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:52.988150 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e831b8c574943b8b259e490e4d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.988550 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 9077e45eb7ce4f25a250be02bedafeb4 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:52.989070 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8afa934df14d3bb3e773c41ab520ec (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:52.989938 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077e45eb7ce4f25a250be02bedafeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.993911 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 605e831b8c574943b8b259e490e4d208 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:52.995265 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e831b8c574943b8b259e490e4d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.997911 16455 tablet_service.cc:1511] Processing CreateTablet for tablet 9077e45eb7ce4f25a250be02bedafeb4 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:52.999711 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077e45eb7ce4f25a250be02bedafeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:52.992389 16457 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0af8eb7234215a518fd144bd450af (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:53.002301 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0af8eb7234215a518fd144bd450af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.003839 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8afa934df14d3bb3e773c41ab520ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.007647 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1a9d5e3dd45d7a937a9954de478cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:53.009052 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1a9d5e3dd45d7a937a9954de478cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.016680 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1a9d5e3dd45d7a937a9954de478cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:53.018168 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1a9d5e3dd45d7a937a9954de478cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.025362 16659 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.027407 16453 tablet_service.cc:1511] Processing CreateTablet for tablet 4021ce342efc430996265ce4a5a65e87 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:53.028831 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4021ce342efc430996265ce4a5a65e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.035908 16659 tablet_bootstrap.cc:654] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.040073 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 4021ce342efc430996265ce4a5a65e87 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:53.041517 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4021ce342efc430996265ce4a5a65e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.042050 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8afa934df14d3bb3e773c41ab520ec (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:53.043334 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8afa934df14d3bb3e773c41ab520ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.045897 16534 tablet_service.cc:1511] Processing CreateTablet for tablet d994045524f7444ba202d5cf05c49d7f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:53.047247 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d994045524f7444ba202d5cf05c49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.049921 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 43cea492ee7e4f91b2ad509449c832f1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:53.051283 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cea492ee7e4f91b2ad509449c832f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.053920 16532 tablet_service.cc:1511] Processing CreateTablet for tablet 74c0af8eb7234215a518fd144bd450af (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:53.055274 16532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0af8eb7234215a518fd144bd450af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.056249 16452 tablet_service.cc:1511] Processing CreateTablet for tablet 84545dee228c4faea4411a58c683bb27 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:53.057322 16531 tablet_service.cc:1511] Processing CreateTablet for tablet 605e831b8c574943b8b259e490e4d208 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:53.058595 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e831b8c574943b8b259e490e4d208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.061985 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 9077e45eb7ce4f25a250be02bedafeb4 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:53.063333 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9077e45eb7ce4f25a250be02bedafeb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.065907 16529 tablet_service.cc:1511] Processing CreateTablet for tablet 11c1a9d5e3dd45d7a937a9954de478cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:53.067233 16529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1a9d5e3dd45d7a937a9954de478cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.074141 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 84545dee228c4faea4411a58c683bb27 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:53.074811 16528 tablet_service.cc:1511] Processing CreateTablet for tablet 4021ce342efc430996265ce4a5a65e87 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:53.075438 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84545dee228c4faea4411a58c683bb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.076156 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4021ce342efc430996265ce4a5a65e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.078009 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 84545dee228c4faea4411a58c683bb27 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:53.079303 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84545dee228c4faea4411a58c683bb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.094230 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84545dee228c4faea4411a58c683bb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.105475 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 92aeb38730a646668d4f528d66afd917 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:53.106020 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 92aeb38730a646668d4f528d66afd917 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:53.106901 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aeb38730a646668d4f528d66afd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.107450 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aeb38730a646668d4f528d66afd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.107857 16453 tablet_service.cc:1511] Processing CreateTablet for tablet b6c87fc9474b4fd2806ea6a4c1104e22 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:53.109295 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c87fc9474b4fd2806ea6a4c1104e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.110105 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 92aeb38730a646668d4f528d66afd917 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:53.111469 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aeb38730a646668d4f528d66afd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.115463 16607 tablet_service.cc:1511] Processing CreateTablet for tablet b6c87fc9474b4fd2806ea6a4c1104e22 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:53.117159 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c87fc9474b4fd2806ea6a4c1104e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.125866 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 53c1c59c7dab4ee3afd08075f673c2c8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:53.127394 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c1c59c7dab4ee3afd08075f673c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.135813 16662 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:53.138660 16659 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.139214 16659 ts_tablet_manager.cc:1403] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.005s
I20260709 13:05:53.142233 16659 raft_consensus.cc:359] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.142887 16659 raft_consensus.cc:385] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.143150 16659 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.143811 16659 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.155956 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 53c1c59c7dab4ee3afd08075f673c2c8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:53.161759 16532 tablet_service.cc:1511] Processing CreateTablet for tablet b6c87fc9474b4fd2806ea6a4c1104e22 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:53.170954 16662 tablet_bootstrap.cc:654] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.171641 16532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c87fc9474b4fd2806ea6a4c1104e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.173357 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 53c1c59c7dab4ee3afd08075f673c2c8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:53.178639 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba52d3ee04ab8b71cd4236ee0ccde (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:53.179881 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba52d3ee04ab8b71cd4236ee0ccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.181042 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c1c59c7dab4ee3afd08075f673c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.181463 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c1c59c7dab4ee3afd08075f673c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.189906 16644 heartbeater.cc:499] Master 127.14.246.126:40851 was elected leader, sending a full tablet report...
I20260709 13:05:53.190765 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba52d3ee04ab8b71cd4236ee0ccde (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:53.192008 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba52d3ee04ab8b71cd4236ee0ccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.197458 16661 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:53.216723 16659 ts_tablet_manager.cc:1434] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.024s
I20260709 13:05:53.217934 16659 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.218662 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 4caba52d3ee04ab8b71cd4236ee0ccde (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:53.219869 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba52d3ee04ab8b71cd4236ee0ccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.224082 16659 tablet_bootstrap.cc:654] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.228631 16533 tablet_service.cc:1511] Processing CreateTablet for tablet d0499df31d9f40178fb10011eef7ece6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:53.229189 16605 tablet_service.cc:1511] Processing CreateTablet for tablet d0499df31d9f40178fb10011eef7ece6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:53.230449 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0499df31d9f40178fb10011eef7ece6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.234550 16456 tablet_service.cc:1511] Processing CreateTablet for tablet e30da0730b354efb9fefd9ef646ce15f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:53.235952 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30da0730b354efb9fefd9ef646ce15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.230506 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0499df31d9f40178fb10011eef7ece6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.247918 16661 tablet_bootstrap.cc:654] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.249729 16453 tablet_service.cc:1511] Processing CreateTablet for tablet d0499df31d9f40178fb10011eef7ece6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:53.269694 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0499df31d9f40178fb10011eef7ece6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.270514 16609 tablet_service.cc:1511] Processing CreateTablet for tablet e30da0730b354efb9fefd9ef646ce15f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:53.272197 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30da0730b354efb9fefd9ef646ce15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.268298 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 3274c86d23d641758f36e812f849be43 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:53.268730 16662 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:53.274024 16662 ts_tablet_manager.cc:1403] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.139s	user 0.023s	sys 0.022s
I20260709 13:05:53.274348 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3274c86d23d641758f36e812f849be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.276842 16662 raft_consensus.cc:359] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.277616 16662 raft_consensus.cc:385] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.277912 16662 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.278625 16662 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.281406 16528 tablet_service.cc:1511] Processing CreateTablet for tablet e30da0730b354efb9fefd9ef646ce15f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:53.287011 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 3274c86d23d641758f36e812f849be43 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:53.291574 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3274c86d23d641758f36e812f849be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.291324 16534 tablet_service.cc:1511] Processing CreateTablet for tablet 13ae44ac0f4e496caaa8405cb3f946d8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:53.291993 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 13ae44ac0f4e496caaa8405cb3f946d8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:53.292831 16659 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.293195 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ae44ac0f4e496caaa8405cb3f946d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.293349 16659 ts_tablet_manager.cc:1403] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.020s
I20260709 13:05:53.296195 16659 raft_consensus.cc:359] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.296901 16659 raft_consensus.cc:385] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:53.299094 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:53.289003 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 3274c86d23d641758f36e812f849be43 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:53.283118 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30da0730b354efb9fefd9ef646ce15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.287658 16662 ts_tablet_manager.cc:1434] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:05:53.287647 16495 heartbeater.cc:499] Master 127.14.246.126:40851 was elected leader, sending a full tablet report...
I20260709 13:05:53.301273 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ae44ac0f4e496caaa8405cb3f946d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.290226 16661 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:53.305182 16661 ts_tablet_manager.cc:1403] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 13:05:53.297247 16659 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.307395 16659 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.308241 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 8de1d4f10dad40289b4f0b93992ff9b6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:53.309103 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3274c86d23d641758f36e812f849be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.309667 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de1d4f10dad40289b4f0b93992ff9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.316112 16659 ts_tablet_manager.cc:1434] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 13:05:53.305194 16453 tablet_service.cc:1511] Processing CreateTablet for tablet 13ae44ac0f4e496caaa8405cb3f946d8 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:53.308231 16661 raft_consensus.cc:359] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.318114 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ae44ac0f4e496caaa8405cb3f946d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.318192 16661 raft_consensus.cc:385] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.320648 16659 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.320962 16661 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.321929 16661 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.326143 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 8de1d4f10dad40289b4f0b93992ff9b6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:53.327312 16659 tablet_bootstrap.cc:654] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.327386 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de1d4f10dad40289b4f0b93992ff9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.331979 16662 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:53.337699 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 486137446c7c411e8a8ec3d1dd300579 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:53.338471 16532 tablet_service.cc:1511] Processing CreateTablet for tablet 79efbc85967d4384bfa3825ef0ec5a14 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:53.339013 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486137446c7c411e8a8ec3d1dd300579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.339713 16532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efbc85967d4384bfa3825ef0ec5a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.338501 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 79efbc85967d4384bfa3825ef0ec5a14 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:53.346197 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efbc85967d4384bfa3825ef0ec5a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.345849 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 8de1d4f10dad40289b4f0b93992ff9b6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:53.347424 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de1d4f10dad40289b4f0b93992ff9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.351629 16662 tablet_bootstrap.cc:654] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.351979 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 486137446c7c411e8a8ec3d1dd300579 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:53.353237 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486137446c7c411e8a8ec3d1dd300579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.355973 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 486137446c7c411e8a8ec3d1dd300579 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:53.357616 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486137446c7c411e8a8ec3d1dd300579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.357623 16456 tablet_service.cc:1511] Processing CreateTablet for tablet eb71b78423ad47fbb40e65fef063a173 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:53.364926 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb71b78423ad47fbb40e65fef063a173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.372064 16570 heartbeater.cc:499] Master 127.14.246.126:40851 was elected leader, sending a full tablet report...
I20260709 13:05:53.380864 16608 tablet_service.cc:1511] Processing CreateTablet for tablet eb71b78423ad47fbb40e65fef063a173 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:53.382205 16608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb71b78423ad47fbb40e65fef063a173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.382568 16527 tablet_service.cc:1511] Processing CreateTablet for tablet eb71b78423ad47fbb40e65fef063a173 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:53.383756 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb71b78423ad47fbb40e65fef063a173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.386837 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 245c53b961134a578f08f960e84a789a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:53.387218 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 245c53b961134a578f08f960e84a789a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:53.388125 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c53b961134a578f08f960e84a789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.402776 16453 tablet_service.cc:1511] Processing CreateTablet for tablet c8566128e1c24c7fa1f9894bd8ffdec7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:53.419688 16602 tablet_service.cc:1511] Processing CreateTablet for tablet c8566128e1c24c7fa1f9894bd8ffdec7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:53.390836 16452 tablet_service.cc:1511] Processing CreateTablet for tablet ad356f899692471d8abda66b7fe01205 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:53.422339 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8566128e1c24c7fa1f9894bd8ffdec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.419139 16455 tablet_service.cc:1511] Processing CreateTablet for tablet 4a96ace5bf484a4eb2288cc869f95f80 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:53.388415 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c53b961134a578f08f960e84a789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.394675 16529 tablet_service.cc:1511] Processing CreateTablet for tablet ad356f899692471d8abda66b7fe01205 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:53.423601 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96ace5bf484a4eb2288cc869f95f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.424113 16529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad356f899692471d8abda66b7fe01205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.424685 16663 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.397817 16603 tablet_service.cc:1511] Processing CreateTablet for tablet ad356f899692471d8abda66b7fe01205 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:53.425205 16663 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.391484 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 245c53b961134a578f08f960e84a789a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:53.422363 16602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8566128e1c24c7fa1f9894bd8ffdec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.427943 16663 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.402966 16531 tablet_service.cc:1511] Processing CreateTablet for tablet c8566128e1c24c7fa1f9894bd8ffdec7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:53.430668 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8566128e1c24c7fa1f9894bd8ffdec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.437126 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad356f899692471d8abda66b7fe01205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.438619 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c53b961134a578f08f960e84a789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.439291 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad356f899692471d8abda66b7fe01205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.390679 16661 ts_tablet_manager.cc:1434] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 13:05:53.441561 16662 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:53.442029 16662 ts_tablet_manager.cc:1403] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.003s
I20260709 13:05:53.440625 16661 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:53.445266 16662 raft_consensus.cc:359] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.445982 16662 raft_consensus.cc:385] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.446286 16662 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.447157 16662 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.449586 16662 ts_tablet_manager.cc:1434] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:53.454422 16659 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.454906 16659 ts_tablet_manager.cc:1403] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.134s	user 0.015s	sys 0.016s
I20260709 13:05:53.458781 16457 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1257c346f6436b83f5cc36b5c04f18 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:53.459806 16661 tablet_bootstrap.cc:654] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.460032 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1257c346f6436b83f5cc36b5c04f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.450023 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 79efbc85967d4384bfa3825ef0ec5a14 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:53.468545 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79efbc85967d4384bfa3825ef0ec5a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.466143 16662 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:53.484401 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1257c346f6436b83f5cc36b5c04f18 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:53.485813 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1257c346f6436b83f5cc36b5c04f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.496567 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:53.498862 16585 leader_election.cc:343] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.499791 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 4a96ace5bf484a4eb2288cc869f95f80 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:53.501269 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96ace5bf484a4eb2288cc869f95f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.497917 16659 raft_consensus.cc:359] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.506047 16659 raft_consensus.cc:385] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.506358 16659 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.507411 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:53.507238 16659 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.509543 16659 ts_tablet_manager.cc:1434] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.008s
I20260709 13:05:53.510502 16659 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.513278 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 4a96ace5bf484a4eb2288cc869f95f80 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:53.514585 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96ace5bf484a4eb2288cc869f95f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.516611 16659 tablet_bootstrap.cc:654] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:53.530367 16582 leader_election.cc:343] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.530915 16582 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:53.532025 16663 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.539897 16460 tablet_service.cc:1511] Processing CreateTablet for tablet c2cd1155e69c4429b642e17940dde1e6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:53.541247 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2cd1155e69c4429b642e17940dde1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.540989 16527 tablet_service.cc:1511] Processing CreateTablet for tablet c2cd1155e69c4429b642e17940dde1e6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:53.543255 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2cd1155e69c4429b642e17940dde1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.543193 16607 tablet_service.cc:1511] Processing CreateTablet for tablet c2cd1155e69c4429b642e17940dde1e6 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:53.544461 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2cd1155e69c4429b642e17940dde1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.555101 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac1479cf4a42f2950de2628057ba50 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:53.555521 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 9a1257c346f6436b83f5cc36b5c04f18 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:53.556509 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac1479cf4a42f2950de2628057ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.558562 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac1479cf4a42f2950de2628057ba50 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:53.559608 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 40ac1479cf4a42f2950de2628057ba50 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:53.560842 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac1479cf4a42f2950de2628057ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.561939 16661 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:53.562470 16661 ts_tablet_manager.cc:1403] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.006s
I20260709 13:05:53.567130 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1257c346f6436b83f5cc36b5c04f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.574806 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40ac1479cf4a42f2950de2628057ba50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.582752 16663 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.583261 16663 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.585371 16663 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.586587 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:53.586879 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:53.587234 16545 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:53.587513 16470 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:53.588442 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:53.582439 16662 tablet_bootstrap.cc:654] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.589305 16663 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.589679 16663 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.590011 16663 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.598068 16453 tablet_service.cc:1511] Processing CreateTablet for tablet df33d6051c004b71a5d0f086053be1fe (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:53.599390 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33d6051c004b71a5d0f086053be1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.606115 16603 tablet_service.cc:1511] Processing CreateTablet for tablet df33d6051c004b71a5d0f086053be1fe (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:53.607221 16659 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.607400 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33d6051c004b71a5d0f086053be1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.607710 16659 ts_tablet_manager.cc:1403] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.017s
I20260709 13:05:53.611356 16457 tablet_service.cc:1511] Processing CreateTablet for tablet 8806363158d645279801d4633a1c7d74 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:53.612517 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8806363158d645279801d4633a1c7d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.612360 16528 tablet_service.cc:1511] Processing CreateTablet for tablet df33d6051c004b71a5d0f086053be1fe (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:53.613102 16659 raft_consensus.cc:359] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.613713 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33d6051c004b71a5d0f086053be1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.613839 16659 raft_consensus.cc:385] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.614205 16659 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.615058 16659 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.565651 16661 raft_consensus.cc:359] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.625558 16661 raft_consensus.cc:385] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.625975 16661 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.626938 16661 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.598740 16663 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.643757 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 8806363158d645279801d4633a1c7d74 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:53.645650 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8806363158d645279801d4633a1c7d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.655933 16661 ts_tablet_manager.cc:1434] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:05:53.656044 16608 tablet_service.cc:1511] Processing CreateTablet for tablet 8806363158d645279801d4633a1c7d74 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:53.656420 16663 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.657205 16663 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.657413 16608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8806363158d645279801d4633a1c7d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.657657 16663 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.659562 16663 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.659334 16454 tablet_service.cc:1511] Processing CreateTablet for tablet 630ca4cf8bd64907bf8c82149ab5afb9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:53.660015 16663 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.660570 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630ca4cf8bd64907bf8c82149ab5afb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.662254 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:53.665588 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:53.666321 16659 ts_tablet_manager.cc:1434] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.019s
I20260709 13:05:53.667402 16659 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.671401 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 630ca4cf8bd64907bf8c82149ab5afb9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 13:05:53.672477 16582 leader_election.cc:343] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.674382 16603 tablet_service.cc:1511] Processing CreateTablet for tablet 630ca4cf8bd64907bf8c82149ab5afb9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:53.674526 16452 tablet_service.cc:1511] Processing CreateTablet for tablet 343fbc074bb94714900a4da026ab998a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:53.675680 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630ca4cf8bd64907bf8c82149ab5afb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.675681 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 343fbc074bb94714900a4da026ab998a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:53.662848 16545 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.675808 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343fbc074bb94714900a4da026ab998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.682718 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343fbc074bb94714900a4da026ab998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.685385 16661 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:53.660429 16663 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.687402 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630ca4cf8bd64907bf8c82149ab5afb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.689613 16663 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.689844 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:53.691376 16582 leader_election.cc:343] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.699046 16659 tablet_bootstrap.cc:654] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.708276 16603 tablet_service.cc:1511] Processing CreateTablet for tablet 343fbc074bb94714900a4da026ab998a (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:53.709654 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343fbc074bb94714900a4da026ab998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.711808 16666 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.712317 16666 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.718207 16666 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:53.710124 16661 tablet_bootstrap.cc:654] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.727710 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:53.729926 16662 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:53.730401 16470 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.730572 16662 ts_tablet_manager.cc:1403] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.011s
I20260709 13:05:53.730698 16545 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:53.731864 16659 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.732332 16659 ts_tablet_manager.cc:1403] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.000s
I20260709 13:05:53.732199 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:53.733507 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 1137091c3c0e4f76a0e16e0f8076bacb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:53.733742 16662 raft_consensus.cc:359] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.734483 16662 raft_consensus.cc:385] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.734344 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 1137091c3c0e4f76a0e16e0f8076bacb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:53.734791 16662 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.734848 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1137091c3c0e4f76a0e16e0f8076bacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.735000 16602 tablet_service.cc:1511] Processing CreateTablet for tablet 1137091c3c0e4f76a0e16e0f8076bacb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:53.735649 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1137091c3c0e4f76a0e16e0f8076bacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.736343 16602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1137091c3c0e4f76a0e16e0f8076bacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.737272 16678 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.737788 16678 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:53.738572 16678 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.749004 16662 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.758591 16662 ts_tablet_manager.cc:1434] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:05:53.762311 16455 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd34f18a6f4fcf882d199ba467c56c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:53.765208 16662 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:53.770593 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd34f18a6f4fcf882d199ba467c56c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:53.771874 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd34f18a6f4fcf882d199ba467c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.739974 16659 raft_consensus.cc:359] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.773208 16659 raft_consensus.cc:385] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.773518 16659 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.774230 16659 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.785394 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:53.786108 16469 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:53.787245 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:53.788308 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd34f18a6f4fcf882d199ba467c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.795790 16659 ts_tablet_manager.cc:1434] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.001s
I20260709 13:05:53.794652 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:53.795825 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd34f18a6f4fcf882d199ba467c56c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:53.797991 16659 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.798416 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd34f18a6f4fcf882d199ba467c56c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:53.798602 16585 leader_election.cc:343] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.798666 16678 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:53.806749 16678 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.807123 16678 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.802135 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf604205a574ee6a5fba699476010ee (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:53.810364 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf604205a574ee6a5fba699476010ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.812753 16457 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad8175aa8b04b6099470077ebb9aea9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:53.804636 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf604205a574ee6a5fba699476010ee (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:53.799197 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:53.814079 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad8175aa8b04b6099470077ebb9aea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.814531 16677 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.815171 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf604205a574ee6a5fba699476010ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.818778 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad8175aa8b04b6099470077ebb9aea9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:53.806299 16659 tablet_bootstrap.cc:654] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.789263 16470 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:53.847075 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad8175aa8b04b6099470077ebb9aea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.804629 16367 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.824290 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 3ad8175aa8b04b6099470077ebb9aea9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:53.850876 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad8175aa8b04b6099470077ebb9aea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.851621 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 9d214c667f1547569798ec88932945a2 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:53.826572 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 9d214c667f1547569798ec88932945a2 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:53.852937 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d214c667f1547569798ec88932945a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.853150 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:53.854453 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d214c667f1547569798ec88932945a2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:53.857553 16433 leader_election.cc:343] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.858003 16662 tablet_bootstrap.cc:654] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.826824 16453 tablet_service.cc:1511] Processing CreateTablet for tablet 9d214c667f1547569798ec88932945a2 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:53.837821 16528 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf604205a574ee6a5fba699476010ee (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:53.865700 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d214c667f1547569798ec88932945a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.865841 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf604205a574ee6a5fba699476010ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.866806 16609 tablet_service.cc:1511] Processing CreateTablet for tablet 45e6d6887bf149f9ad8ed2c85503056c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:53.868083 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e6d6887bf149f9ad8ed2c85503056c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.874038 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:53.863893 16452 tablet_service.cc:1511] Processing CreateTablet for tablet 45e6d6887bf149f9ad8ed2c85503056c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:53.877903 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e6d6887bf149f9ad8ed2c85503056c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.890550 16659 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:53.891076 16659 ts_tablet_manager.cc:1403] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.093s	user 0.006s	sys 0.006s
I20260709 13:05:53.894126 16659 raft_consensus.cc:359] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.877607 16678 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.894850 16659 raft_consensus.cc:385] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.895190 16659 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.895556 16619 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 1: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:05:53.887988 16454 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb40598544d8591903d884ef151b0 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:53.899931 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:53.879001 16661 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:53.880648 16668 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.901207 16666 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:53.900848 16668 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.903581 16668 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:53.904287 16661 ts_tablet_manager.cc:1403] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.003s
I20260709 13:05:53.907200 16661 raft_consensus.cc:359] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.881059 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 45e6d6887bf149f9ad8ed2c85503056c (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:53.897547 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb40598544d8591903d884ef151b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.908757 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e6d6887bf149f9ad8ed2c85503056c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.908869 16603 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb40598544d8591903d884ef151b0 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:53.910358 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb40598544d8591903d884ef151b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.912441 16666 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:53.920939 16678 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:53.921180 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 922b28b4b68e4191b6f4e8c9291cd40d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:53.921543 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:53.922487 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922b28b4b68e4191b6f4e8c9291cd40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.922808 16661 raft_consensus.cc:385] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.923195 16661 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.923939 16661 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.925540 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:05:53.930254 16582 leader_election.cc:343] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:53.933471 16661 ts_tablet_manager.cc:1434] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:05:53.928449 16470 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:53.917248 16659 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.937194 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:53.938143 16659 ts_tablet_manager.cc:1434] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:05:53.938583 16677 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:53.938205 16457 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec5040680744828ce3ed1844be1ac1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:53.939054 16677 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:53.939254 16659 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:53.933966 16455 tablet_service.cc:1511] Processing CreateTablet for tablet c9e9a6d3e5b24df58aa452e3b70637fc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:53.940061 16677 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.935452 16604 tablet_service.cc:1511] Processing CreateTablet for tablet 922b28b4b68e4191b6f4e8c9291cd40d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:53.935905 16662 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:53.941697 16662 ts_tablet_manager.cc:1403] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.000s
I20260709 13:05:53.944476 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec5040680744828ce3ed1844be1ac1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:53.944846 16662 raft_consensus.cc:359] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.945906 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec5040680744828ce3ed1844be1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.947024 16661 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:53.947065 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922b28b4b68e4191b6f4e8c9291cd40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.965204 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec5040680744828ce3ed1844be1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.972671 16659 tablet_bootstrap.cc:654] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:53.951493 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:53.974455 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ab75d98ba64a9caa062cd19a0594fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.951081 16608 tablet_service.cc:1511] Processing CreateTablet for tablet c9e9a6d3e5b24df58aa452e3b70637fc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:53.958360 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:53.945844 16662 raft_consensus.cc:385] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:53.978430 16662 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:53.980027 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ab75d98ba64a9caa062cd19a0594fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.980083 16662 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:53.981350 16453 tablet_service.cc:1511] Processing CreateTablet for tablet 58e2513ac115476c9eb7fcddb908cb9b (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:54.000061 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 58e2513ac115476c9eb7fcddb908cb9b (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:53.982451 16662 ts_tablet_manager.cc:1434] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:05:54.007305 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e2513ac115476c9eb7fcddb908cb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.004868 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e9a6d3e5b24df58aa452e3b70637fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.005384 16661 tablet_bootstrap.cc:654] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.019243 16602 tablet_service.cc:1511] Processing CreateTablet for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:54.020615 16602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.024365 16603 tablet_service.cc:1511] Processing CreateTablet for tablet facc0e17b2a549b4b071a55d5f7c2167 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:54.024695 16601 tablet_service.cc:1511] Processing CreateTablet for tablet 859be0294f7f4761b91b80c75b983562 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:54.025985 16601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859be0294f7f4761b91b80c75b983562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.007730 16666 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.034605 16662 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.047087 16604 tablet_service.cc:1511] Processing CreateTablet for tablet ebc26e5c94524ffe84fdc3e560019f4f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:54.038558 16666 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.053942 16666 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.054961 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.043248 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e2513ac115476c9eb7fcddb908cb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.049883 16608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e9a6d3e5b24df58aa452e3b70637fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.064512 16452 tablet_service.cc:1511] Processing CreateTablet for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:54.065877 16452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.069387 16662 tablet_bootstrap.cc:654] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.069200 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:54.074249 16535 tablet_service.cc:1511] Processing CreateTablet for tablet b92bb40598544d8591903d884ef151b0 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:54.075584 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb40598544d8591903d884ef151b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.078992 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc26e5c94524ffe84fdc3e560019f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.080358 16603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facc0e17b2a549b4b071a55d5f7c2167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.077514 16666 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.081467 16666 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.083483 16666 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:05:54.062107 16433 leader_election.cc:343] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.087937 16436 leader_election.cc:343] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.088816 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.089666 16545 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:54.090355 16436 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:54.091462 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:54.092337 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:54.092779 16691 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.092998 16619 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:54.093638 16691 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.094115 16691 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.094534 16691 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.121526 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 6689ca00362248ce81b56252a62e85a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:54.121999 16454 tablet_service.cc:1511] Processing CreateTablet for tablet facc0e17b2a549b4b071a55d5f7c2167 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:54.122905 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6689ca00362248ce81b56252a62e85a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.123169 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facc0e17b2a549b4b071a55d5f7c2167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.125744 16602 tablet_service.cc:1511] Processing CreateTablet for tablet 628b797ac16849cca2b2c6254663f2f7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:54.126946 16602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628b797ac16849cca2b2c6254663f2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.123802 16691 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.133559 16609 tablet_service.cc:1511] Processing CreateTablet for tablet deb27cdf9e08471584fe7bce6bffd303 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:54.141855 16609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb27cdf9e08471584fe7bce6bffd303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.151218 16659 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.151767 16659 ts_tablet_manager.cc:1403] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.213s	user 0.015s	sys 0.005s
I20260709 13:05:54.151467 16460 tablet_service.cc:1511] Processing CreateTablet for tablet ebc26e5c94524ffe84fdc3e560019f4f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:54.152209 16458 tablet_service.cc:1511] Processing CreateTablet for tablet 6689ca00362248ce81b56252a62e85a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:54.152786 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc26e5c94524ffe84fdc3e560019f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.153457 16458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6689ca00362248ce81b56252a62e85a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.153651 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 859be0294f7f4761b91b80c75b983562 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:54.154855 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859be0294f7f4761b91b80c75b983562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.165109 16451 tablet_service.cc:1511] Processing CreateTablet for tablet 628b797ac16849cca2b2c6254663f2f7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:54.165553 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 922b28b4b68e4191b6f4e8c9291cd40d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:54.170090 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922b28b4b68e4191b6f4e8c9291cd40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.171492 16451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628b797ac16849cca2b2c6254663f2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.175136 16453 tablet_service.cc:1511] Processing CreateTablet for tablet deb27cdf9e08471584fe7bce6bffd303 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:54.175782 16528 tablet_service.cc:1511] Processing CreateTablet for tablet c9e9a6d3e5b24df58aa452e3b70637fc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:54.177495 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:54.183269 16545 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.184091 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e9a6d3e5b24df58aa452e3b70637fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.185070 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 58e2513ac115476c9eb7fcddb908cb9b (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:54.186288 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e2513ac115476c9eb7fcddb908cb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.189742 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 1fec5040680744828ce3ed1844be1ac1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:54.189798 16526 tablet_service.cc:1511] Processing CreateTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:54.191071 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec5040680744828ce3ed1844be1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.181782 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb27cdf9e08471584fe7bce6bffd303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.201790 16604 tablet_service.cc:1511] Processing CreateTablet for tablet edc37979fbec49e3beeb0104b9711f73 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:54.199815 16691 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.210199 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc37979fbec49e3beeb0104b9711f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.199321 16677 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.232177 16453 tablet_service.cc:1511] Processing CreateTablet for tablet 400e1c04ef6646108d16357968e6e8d1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:54.208324 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:54.208642 16526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ab75d98ba64a9caa062cd19a0594fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.219156 16367 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.234709 16675 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.236572 16678 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.238849 16601 tablet_service.cc:1511] Processing CreateTablet for tablet 15bb7626d64b480b9966ee39a4d8f1f9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:54.243448 16678 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.244078 16601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bb7626d64b480b9966ee39a4d8f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.244136 16619 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.245324 16453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400e1c04ef6646108d16357968e6e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.245594 16678 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.208446 16529 tablet_service.cc:1511] Processing CreateTablet for tablet facc0e17b2a549b4b071a55d5f7c2167 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:54.237185 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 866175a9d3d74ca692d4573f642d17a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:54.249739 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.240603 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 400e1c04ef6646108d16357968e6e8d1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:54.249078 16677 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.205300 16545 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:54.251784 16659 raft_consensus.cc:359] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.261394 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 18effeb8d3aa4c58bffd8cce4093fd3d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:54.261765 16659 raft_consensus.cc:385] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.262100 16659 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.256392 16532 tablet_service.cc:1511] Processing CreateTablet for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:54.260279 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.260874 16531 tablet_service.cc:1511] Processing CreateTablet for tablet 859be0294f7f4761b91b80c75b983562 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:05:54.262511 16582 leader_election.cc:343] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.271337 16585 leader_election.cc:343] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.265980 16659 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.271912 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:54.270411 16619 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:54.273196 16678 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.274020 16659 ts_tablet_manager.cc:1434] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.001s
I20260709 13:05:54.273896 16436 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:54.261570 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400e1c04ef6646108d16357968e6e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.274765 16691 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.275206 16691 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:54.275982 16691 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.277034 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18effeb8d3aa4c58bffd8cce4093fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.277225 16459 tablet_service.cc:1511] Processing CreateTablet for tablet 866175a9d3d74ca692d4573f642d17a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:54.277370 16675 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.281394 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866175a9d3d74ca692d4573f642d17a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.282778 16459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866175a9d3d74ca692d4573f642d17a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.285499 16662 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.285976 16662 ts_tablet_manager.cc:1403] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.252s	user 0.047s	sys 0.044s
I20260709 13:05:54.291162 16456 tablet_service.cc:1511] Processing CreateTablet for tablet 15bb7626d64b480b9966ee39a4d8f1f9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:54.296667 16456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bb7626d64b480b9966ee39a4d8f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:54.301348 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:54.212610 16457 tablet_service.cc:1511] Processing CreateTablet for tablet edc37979fbec49e3beeb0104b9711f73 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:54.304518 16457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc37979fbec49e3beeb0104b9711f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.259143 16661 tablet_bootstrap.cc:492] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.306788 16661 ts_tablet_manager.cc:1403] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.360s	user 0.017s	sys 0.008s
I20260709 13:05:54.318750 16675 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.319299 16675 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.321527 16675 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.323921 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:54.325568 16585 leader_election.cc:343] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.326469 16455 tablet_service.cc:1511] Processing CreateTablet for tablet 18effeb8d3aa4c58bffd8cce4093fd3d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:54.329294 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:54.330693 16582 leader_election.cc:343] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.331130 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:54.294952 16677 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.332244 16675 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.295199 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.295567 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.292471 16659 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.333819 16662 raft_consensus.cc:359] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:54.337020 16585 leader_election.cc:343] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.334985 16662 raft_consensus.cc:385] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:54.337779 16582 leader_election.cc:343] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.338096 16662 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.338219 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:54.340970 16535 tablet_service.cc:1511] Processing CreateTablet for tablet ebc26e5c94524ffe84fdc3e560019f4f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:54.341174 16662 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.342430 16675 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.334172 16529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet facc0e17b2a549b4b071a55d5f7c2167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.332085 16455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18effeb8d3aa4c58bffd8cce4093fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.358635 16661 raft_consensus.cc:359] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.359521 16661 raft_consensus.cc:385] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.359941 16661 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.359591 16454 tablet_service.cc:1511] Processing CreateTablet for tablet ab144bc0671c46e6807f89d495e66473 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:54.360980 16661 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.363078 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 6689ca00362248ce81b56252a62e85a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:54.365960 16534 tablet_service.cc:1511] Processing CreateTablet for tablet 628b797ac16849cca2b2c6254663f2f7 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:54.376894 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6689ca00362248ce81b56252a62e85a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.382799 16458 tablet_service.cc:1511] Processing CreateTablet for tablet 5eccbd91402541c4bb6edc9c47f3cf8f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:54.383682 16607 tablet_service.cc:1511] Processing CreateTablet for tablet 5eccbd91402541c4bb6edc9c47f3cf8f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:54.384852 16607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eccbd91402541c4bb6edc9c47f3cf8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.385066 16659 tablet_bootstrap.cc:654] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.388911 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.393441 16543 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.394681 16661 ts_tablet_manager.cc:1434] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:05:54.395723 16661 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.397519 16662 ts_tablet_manager.cc:1434] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.001s
I20260709 13:05:54.398558 16662 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
W20260709 13:05:54.400554 16511 leader_election.cc:343] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.401286 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc26e5c94524ffe84fdc3e560019f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.405069 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 628b797ac16849cca2b2c6254663f2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.409545 16675 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.412850 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 400e1c04ef6646108d16357968e6e8d1 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:54.414218 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400e1c04ef6646108d16357968e6e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.417490 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:05:54.419514 16511 leader_election.cc:343] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.419950 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:54.420703 16668 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.421977 16460 tablet_service.cc:1511] Processing CreateTablet for tablet 7735d77d64e14457985553596120e4cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:54.423667 16460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7735d77d64e14457985553596120e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.424795 16454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab144bc0671c46e6807f89d495e66473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.431998 16678 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.440213 16604 tablet_service.cc:1511] Processing CreateTablet for tablet ab144bc0671c46e6807f89d495e66473 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:54.442719 16604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab144bc0671c46e6807f89d495e66473. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:54.448114 16352 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 57975.3us
I20260709 13:05:54.447830 16662 tablet_bootstrap.cc:654] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.449895 16458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eccbd91402541c4bb6edc9c47f3cf8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.448825 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859be0294f7f4761b91b80c75b983562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.479234 16367 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.507501 16533 tablet_service.cc:1511] Processing CreateTablet for tablet 866175a9d3d74ca692d4573f642d17a9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:54.527261 16529 tablet_service.cc:1511] Processing CreateTablet for tablet edc37979fbec49e3beeb0104b9711f73 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:54.528039 16535 tablet_service.cc:1511] Processing CreateTablet for tablet deb27cdf9e08471584fe7bce6bffd303 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:54.509992 16532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.541587 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb27cdf9e08471584fe7bce6bffd303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.542361 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 7735d77d64e14457985553596120e4cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:54.546339 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7735d77d64e14457985553596120e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.559926 16659 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.560405 16659 ts_tablet_manager.cc:1403] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.268s	user 0.025s	sys 0.012s
I20260709 13:05:54.562901 16661 tablet_bootstrap.cc:654] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.563843 16528 tablet_service.cc:1511] Processing CreateTablet for tablet 5eccbd91402541c4bb6edc9c47f3cf8f (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:54.566613 16659 raft_consensus.cc:359] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.567701 16659 raft_consensus.cc:385] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.567935 16659 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.557489 16533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866175a9d3d74ca692d4573f642d17a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.568517 16659 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.572068 16659 ts_tablet_manager.cc:1434] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:54.572935 16659 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.587642 16534 tablet_service.cc:1511] Processing CreateTablet for tablet 15bb7626d64b480b9966ee39a4d8f1f9 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:54.589017 16659 tablet_bootstrap.cc:654] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.590240 16661 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.590750 16661 ts_tablet_manager.cc:1403] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.195s	user 0.021s	sys 0.001s
I20260709 13:05:54.610783 16662 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.599146 16528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eccbd91402541c4bb6edc9c47f3cf8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.621595 16662 ts_tablet_manager.cc:1403] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.223s	user 0.012s	sys 0.033s
I20260709 13:05:54.626652 16662 raft_consensus.cc:359] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.627372 16662 raft_consensus.cc:385] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.627667 16662 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.614451 16661 raft_consensus.cc:359] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.629163 16529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edc37979fbec49e3beeb0104b9711f73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.629299 16661 raft_consensus.cc:385] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.629675 16661 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.631661 16527 tablet_service.cc:1511] Processing CreateTablet for tablet 18effeb8d3aa4c58bffd8cce4093fd3d (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:54.632890 16527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18effeb8d3aa4c58bffd8cce4093fd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.635737 16662 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.634115 16531 tablet_service.cc:1511] Processing CreateTablet for tablet ab144bc0671c46e6807f89d495e66473 (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:54.636904 16534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bb7626d64b480b9966ee39a4d8f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.640714 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab144bc0671c46e6807f89d495e66473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.641753 16659 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.642225 16659 ts_tablet_manager.cc:1403] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.012s
I20260709 13:05:54.635803 16661 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:54.644261 16535 tablet_service.cc:1511] Processing CreateTablet for tablet 7735d77d64e14457985553596120e4cc (DEFAULT_TABLE table=test-workload [id=33f9beb0747545679c040044c30ca602]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:54.645714 16535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7735d77d64e14457985553596120e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:54.645954 16662 ts_tablet_manager.cc:1434] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:05:54.646986 16662 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.652791 16661 ts_tablet_manager.cc:1434] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.001s
I20260709 13:05:54.656716 16661 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.656629 16659 raft_consensus.cc:359] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.665103 16659 raft_consensus.cc:385] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.665423 16659 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.666095 16659 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.668005 16659 ts_tablet_manager.cc:1434] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:54.661967 16662 tablet_bootstrap.cc:654] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.683948 16659 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.684160 16662 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.684603 16662 ts_tablet_manager.cc:1403] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 13:05:54.687290 16662 raft_consensus.cc:359] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.688012 16662 raft_consensus.cc:385] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.688303 16662 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.691697 16662 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.693753 16659 tablet_bootstrap.cc:654] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.698244 16662 ts_tablet_manager.cc:1434] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:54.699276 16662 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.700671 16661 tablet_bootstrap.cc:654] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.705318 16662 tablet_bootstrap.cc:654] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.707984 16659 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.708412 16659 ts_tablet_manager.cc:1403] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:05:54.711292 16659 raft_consensus.cc:359] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.712169 16659 raft_consensus.cc:385] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.712502 16659 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.713510 16659 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.718139 16666 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.718657 16666 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.720860 16666 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.722589 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:54.723062 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.723259 16619 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
W20260709 13:05:54.724597 16433 leader_election.cc:343] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.725304 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:54.725986 16659 ts_tablet_manager.cc:1434] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:05:54.726022 16666 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.726745 16666 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.727206 16666 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.728498 16661 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.729051 16661 ts_tablet_manager.cc:1403] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.016s
I20260709 13:05:54.734227 16661 raft_consensus.cc:359] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.735028 16661 raft_consensus.cc:385] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.735384 16661 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.736308 16661 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.737262 16659 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.739102 16666 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.742216 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:05:54.743736 16433 leader_election.cc:343] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.745263 16659 tablet_bootstrap.cc:654] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.745996 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:54.746615 16619 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.747052 16661 ts_tablet_manager.cc:1434] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:05:54.750860 16662 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.751325 16662 ts_tablet_manager.cc:1403] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.024s
I20260709 13:05:54.751842 16659 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.752388 16659 ts_tablet_manager.cc:1403] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:05:54.754038 16662 raft_consensus.cc:359] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.754693 16662 raft_consensus.cc:385] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.755002 16662 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.754792 16659 raft_consensus.cc:359] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.755427 16659 raft_consensus.cc:385] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.755721 16659 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.755141 16619 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:54.756108 16661 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.755757 16662 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.756485 16659 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.757330 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:54.755780 16666 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.758937 16666 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:54.759477 16666 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:54.760468 16666 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.763320 16661 tablet_bootstrap.cc:654] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.765897 16659 ts_tablet_manager.cc:1434] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:05:54.769507 16662 ts_tablet_manager.cc:1434] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:05:54.770393 16659 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.772802 16675 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.773253 16675 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.775382 16675 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.777029 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.777563 16659 tablet_bootstrap.cc:654] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.778230 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:54.779574 16582 leader_election.cc:343] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:54.780387 16585 leader_election.cc:343] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.780872 16585 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:54.781528 16661 tablet_bootstrap.cc:492] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.781986 16675 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:54.782071 16661 ts_tablet_manager.cc:1403] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.009s
I20260709 13:05:54.782536 16662 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.782150 16367 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.785542 16661 raft_consensus.cc:359] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.786399 16661 raft_consensus.cc:385] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.786706 16661 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.787530 16661 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.790099 16661 ts_tablet_manager.cc:1434] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:54.792821 16661 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.799163 16666 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:54.800343 16661 tablet_bootstrap.cc:654] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.808109 16662 tablet_bootstrap.cc:654] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.808213 16659 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.808727 16659 ts_tablet_manager.cc:1403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.019s
I20260709 13:05:54.810849 16659 raft_consensus.cc:359] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.811515 16661 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.811508 16659 raft_consensus.cc:385] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.811983 16659 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.812112 16661 ts_tablet_manager.cc:1403] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:05:54.812789 16659 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.814728 16661 raft_consensus.cc:359] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.815353 16661 raft_consensus.cc:385] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.815649 16661 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.816299 16661 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.818111 16661 ts_tablet_manager.cc:1434] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:54.819096 16661 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.818111 16659 ts_tablet_manager.cc:1434] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:54.821969 16659 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.824528 16661 tablet_bootstrap.cc:654] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.824481 16691 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:54.827526 16659 tablet_bootstrap.cc:654] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.852988 16659 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.853142 16661 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.853430 16659 ts_tablet_manager.cc:1403] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.032s	user 0.002s	sys 0.010s
I20260709 13:05:54.853737 16661 ts_tablet_manager.cc:1403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.015s
I20260709 13:05:54.855999 16659 raft_consensus.cc:359] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.856122 16661 raft_consensus.cc:359] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.856688 16659 raft_consensus.cc:385] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.856830 16661 raft_consensus.cc:385] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.857025 16659 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.857184 16661 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.857896 16661 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.857896 16659 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.860481 16662 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.860831 16661 ts_tablet_manager.cc:1434] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:54.860981 16662 ts_tablet_manager.cc:1403] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.011s
I20260709 13:05:54.862084 16661 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.863787 16662 raft_consensus.cc:359] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.864506 16662 raft_consensus.cc:385] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.864816 16662 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.865600 16662 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.868016 16661 tablet_bootstrap.cc:654] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.871364 16662 ts_tablet_manager.cc:1434] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:54.872303 16662 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.874130 16659 ts_tablet_manager.cc:1434] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:05:54.875706 16659 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.883136 16659 tablet_bootstrap.cc:654] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.887226 16661 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.887693 16661 ts_tablet_manager.cc:1403] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.015s
I20260709 13:05:54.889015 16659 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.889487 16659 ts_tablet_manager.cc:1403] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:05:54.890269 16662 tablet_bootstrap.cc:654] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.890654 16661 raft_consensus.cc:359] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.891399 16661 raft_consensus.cc:385] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.891690 16661 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.892138 16659 raft_consensus.cc:359] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.892885 16659 raft_consensus.cc:385] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.892514 16661 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.893180 16659 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.894659 16661 ts_tablet_manager.cc:1434] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:54.894816 16662 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.895308 16662 ts_tablet_manager.cc:1403] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:05:54.895745 16661 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.895514 16659 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.900516 16662 raft_consensus.cc:359] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.901088 16659 ts_tablet_manager.cc:1434] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:54.901244 16662 raft_consensus.cc:385] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.901585 16662 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.902097 16659 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.902366 16661 tablet_bootstrap.cc:654] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.902313 16662 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.904707 16662 ts_tablet_manager.cc:1434] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:54.905735 16662 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.914667 16659 tablet_bootstrap.cc:654] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.919471 16661 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.919909 16661 ts_tablet_manager.cc:1403] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.003s
I20260709 13:05:54.920949 16662 tablet_bootstrap.cc:654] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.922075 16661 raft_consensus.cc:359] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.922340 16659 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.922632 16661 raft_consensus.cc:385] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.922864 16659 ts_tablet_manager.cc:1403] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
I20260709 13:05:54.922901 16661 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.923732 16661 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.925464 16661 ts_tablet_manager.cc:1434] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:05:54.926461 16661 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.926497 16659 raft_consensus.cc:359] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.927511 16659 raft_consensus.cc:385] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.927866 16659 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.928992 16659 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.931906 16661 tablet_bootstrap.cc:654] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.932358 16662 tablet_bootstrap.cc:492] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:54.932858 16662 ts_tablet_manager.cc:1403] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.010s
I20260709 13:05:54.935686 16662 raft_consensus.cc:359] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.936574 16662 raft_consensus.cc:385] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.936887 16662 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.937693 16662 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.940021 16662 ts_tablet_manager.cc:1434] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:54.940133 16659 ts_tablet_manager.cc:1434] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:05:54.940845 16691 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.941308 16691 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.943536 16691 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.944430 16662 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:54.944677 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:54.945317 16619 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:54.946233 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.946816 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:54.948068 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:54.948848 16691 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.949229 16691 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.949604 16691 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.951108 16659 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:54.955176 16661 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:54.955737 16661 ts_tablet_manager.cc:1403] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 13:05:54.956410 16662 tablet_bootstrap.cc:654] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.957299 16691 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.958197 16659 tablet_bootstrap.cc:654] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.958556 16661 raft_consensus.cc:359] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.960760 16661 raft_consensus.cc:385] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:54.960760 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:54.961303 16661 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:54.961556 16619 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.962117 16661 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.965390 16675 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.965888 16675 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.968096 16675 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.970089 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.970798 16468 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:54.971954 16661 ts_tablet_manager.cc:1434] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:54.960295 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:54.972553 16545 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.972929 16585 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:54.970089 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:54.959642 16691 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:05:54.975450 16582 leader_election.cc:343] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:54.975670 16661 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:54.976363 16675 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:54.976802 16675 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.977170 16675 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:54.983021 16619 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:54.990242 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:54.984328 16661 tablet_bootstrap.cc:654] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:54.993459 16678 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.994031 16678 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.995631 16659 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:54.995831 16668 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.996115 16659 ts_tablet_manager.cc:1403] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.011s
I20260709 13:05:54.992285 16675 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.996290 16678 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.996366 16668 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.998011 16675 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:54.998111 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:54.998478 16668 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:54.999095 16659 raft_consensus.cc:359] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:54.999996 16659 raft_consensus.cc:385] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.000285 16659 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.001160 16659 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.001981 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.002636 16470 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:55.003500 16677 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.004176 16677 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.004925 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.005640 16544 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:55.006681 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.006918 16677 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.007381 16659 ts_tablet_manager.cc:1434] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:55.007843 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.003509 16662 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.008437 16659 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.008683 16662 ts_tablet_manager.cc:1403] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.016s
I20260709 13:05:55.014190 16582 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.015105 16677 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.015645 16659 tablet_bootstrap.cc:654] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.015723 16677 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.016275 16677 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:55.015173 16582 leader_election.cc:343] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:55.021979 16585 leader_election.cc:343] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.022517 16675 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.022962 16666 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.023020 16675 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.024297 16668 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.025249 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.025576 16675 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.025969 16543 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:55.012411 16662 raft_consensus.cc:359] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.030725 16662 raft_consensus.cc:385] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.033785 16662 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.035477 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.036355 16675 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.035981 16662 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.036799 16675 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.037189 16675 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.042295 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.043197 16619 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:55.024725 16668 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.043857 16668 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.038489 16691 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.050952 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.051865 16470 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:55.045100 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.067266 16677 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.069536 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.070246 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.049824 16666 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:55.074932 16468 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.085278 16659 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.085891 16659 ts_tablet_manager.cc:1403] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.016s
I20260709 13:05:55.057456 16691 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:05:55.077404 16582 leader_election.cc:343] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.093888 16662 ts_tablet_manager.cc:1434] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.085s	user 0.012s	sys 0.000s
I20260709 13:05:55.095007 16662 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.095250 16661 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.095894 16661 ts_tablet_manager.cc:1403] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.120s	user 0.043s	sys 0.054s
I20260709 13:05:55.095257 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.096448 16619 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.098543 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.101152 16737 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.101809 16737 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.102854 16675 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.103708 16738 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.104187 16738 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.104321 16737 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.104540 16738 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.107139 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.107914 16619 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.107184 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:55.108844 16585 leader_election.cc:343] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.106477 16668 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.109115 16436 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.109321 16585 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.110746 16739 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.111310 16468 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.108865 16543 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.112656 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.113111 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.115052 16735 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.113031 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.115654 16691 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.115752 16469 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.116259 16691 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.116683 16691 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.096711 16666 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.115691 16467 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.118674 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.119585 16543 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.121589 16675 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.121865 16691 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.124156 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.124976 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.114041 16585 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:55.125097 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.125633 16619 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.125900 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.125399 16544 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.114491 16677 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.127172 16668 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.127583 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.132375 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.132738 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.125049 16740 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.133251 16691 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.133574 16740 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.133693 16691 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.136435 16691 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.138459 16659 raft_consensus.cc:359] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.139164 16659 raft_consensus.cc:385] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.139472 16659 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.139617 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.140298 16468 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.140152 16659 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.138999 16662 tablet_bootstrap.cc:654] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.131667 16675 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.134289 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.144716 16659 ts_tablet_manager.cc:1434] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260709 13:05:55.145651 16675 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:55.146478 16675 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.147744 16691 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.134981 16740 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.148663 16659 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.149111 16368 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.151417 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.151945 16542 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.157871 16691 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.159333 16661 raft_consensus.cc:359] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.160053 16661 raft_consensus.cc:385] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.160310 16661 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.160892 16543 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.161790 16661 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.162123 16582 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.162817 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.163396 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.163424 16618 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.118835 16735 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:55.164958 16677 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.166174 16677 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:55.167685 16677 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.168239 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.170670 16668 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.176075 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.176211 16668 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.177305 16545 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:55.178632 16668 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.180101 16739 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.172588 16544 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.180569 16739 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.183815 16661 ts_tablet_manager.cc:1434] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.003s
I20260709 13:05:55.181389 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.184984 16661 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.180122 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.184648 16691 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.191335 16691 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:05:55.192696 16511 leader_election.cc:343] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.192579 16691 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.170032 16619 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:55.197350 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.201720 16678 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.201601 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.206730 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.174477 16738 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:55.208385 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.189724 16618 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:55.213701 16469 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:55.214922 16735 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:05:55.218125 16585 leader_election.cc:343] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.219153 16470 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:55.219626 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.220844 16735 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.221305 16735 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:05:55.222064 16582 leader_election.cc:343] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.222513 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.222102 16735 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.207484 16739 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.224555 16739 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.228332 16368 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.225255 16678 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:55.229210 16468 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.239485 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.240461 16544 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.241493 16739 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.241942 16739 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.242517 16740 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.237172 16738 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.228739 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.231878 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.245256 16739 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.247774 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.248307 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.249018 16668 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.268675 16678 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.270804 16545 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.244272 16467 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.293816 16668 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.295832 16735 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.295135 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64823.6us
I20260709 13:05:55.296406 16735 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.274667 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.298332 16542 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:55.291981 16740 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.274720 16618 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:55.300146 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.301677 16617 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.302881 16661 tablet_bootstrap.cc:654] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.303797 16668 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.305260 16735 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.305418 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:55.305801 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:55.306293 16470 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:05:55.308465 16582 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:55.310752 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.314527 16659 tablet_bootstrap.cc:654] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:55.313846 16585 leader_election.cc:343] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.310127 16739 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.321501 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.319682 16368 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.310122 16740 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:05:55.327196 16619 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.316871 16739 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.315236 16544 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.329231 16662 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.332690 16662 ts_tablet_manager.cc:1403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.238s	user 0.029s	sys 0.026s
I20260709 13:05:55.335162 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.336043 16666 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.336501 16666 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:05:55.343396 16433 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:55.343940 16666 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:05:55.332862 16739 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.355226 16668 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.355618 16662 raft_consensus.cc:359] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.356693 16662 raft_consensus.cc:385] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.357101 16662 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.357540 16668 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.358739 16545 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.326483 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.361392 16368 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.362416 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.363969 16368 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.363569 16662 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.364377 16691 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.366765 16691 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:55.366991 16619 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.367522 16691 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.363998 16668 raft_consensus.cc:2764] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:05:55.375025 16617 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.377468 16662 ts_tablet_manager.cc:1434] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:05:55.378427 16662 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.377561 16367 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.381404 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.382000 16468 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.417778 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.418085 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:55.418519 16617 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.425959 16668 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.446154 16468 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:55.447731 16739 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.452904 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:05:55.454473 16585 leader_election.cc:343] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.456424 16739 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.452267 16617 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:55.462687 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.463471 16545 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.472935 16545 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.474598 16582 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.475663 16739 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.478760 16739 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:55.479029 16659 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.479530 16659 ts_tablet_manager.cc:1403] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.331s	user 0.013s	sys 0.005s
I20260709 13:05:55.479764 16739 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.481765 16662 tablet_bootstrap.cc:654] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.486132 16678 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.486768 16678 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.488579 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:55.489750 16748 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.490216 16748 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:55.490938 16678 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.492336 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.475507 16668 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.491181 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.491079 16748 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:55.495157 16582 leader_election.cc:343] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:55.495694 16585 leader_election.cc:343] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.496279 16585 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:55.500141 16678 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:55.502751 16661 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.503253 16661 ts_tablet_manager.cc:1403] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.319s	user 0.012s	sys 0.002s
I20260709 13:05:55.507385 16661 raft_consensus.cc:359] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.508144 16661 raft_consensus.cc:385] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.508430 16661 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.513260 16659 raft_consensus.cc:359] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.514142 16659 raft_consensus.cc:385] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.514477 16659 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.515206 16659 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.517707 16659 ts_tablet_manager.cc:1434] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.006s
I20260709 13:05:55.517552 16366 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.518728 16659 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.521797 16368 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:55.524523 16662 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.525120 16662 ts_tablet_manager.cc:1403] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.025s
I20260709 13:05:55.524588 16661 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.528024 16662 raft_consensus.cc:359] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.529771 16659 tablet_bootstrap.cc:654] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.531919 16661 ts_tablet_manager.cc:1434] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:05:55.532982 16661 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.530239 16662 raft_consensus.cc:385] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.536971 16662 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.539206 16661 tablet_bootstrap.cc:654] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.543354 16659 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.544647 16659 ts_tablet_manager.cc:1403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:05:55.547148 16659 raft_consensus.cc:359] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.547940 16659 raft_consensus.cc:385] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.548241 16659 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.549007 16659 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.551369 16659 ts_tablet_manager.cc:1434] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:55.552214 16659 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.553025 16662 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.554935 16662 ts_tablet_manager.cc:1434] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.003s
I20260709 13:05:55.555841 16662 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.557802 16659 tablet_bootstrap.cc:654] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.561620 16662 tablet_bootstrap.cc:654] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.565835 16367 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.567762 16661 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.568269 16661 ts_tablet_manager.cc:1403] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.036s	user 0.032s	sys 0.001s
I20260709 13:05:55.567667 16367 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.571080 16661 raft_consensus.cc:359] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.571880 16661 raft_consensus.cc:385] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.572193 16661 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.572999 16659 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.573125 16662 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.572938 16661 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.573539 16659 ts_tablet_manager.cc:1403] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:05:55.573602 16662 ts_tablet_manager.cc:1403] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 13:05:55.575896 16661 ts_tablet_manager.cc:1434] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:55.576272 16659 raft_consensus.cc:359] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.576889 16661 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.576939 16659 raft_consensus.cc:385] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.578616 16662 raft_consensus.cc:359] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.579288 16662 raft_consensus.cc:385] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.579239 16659 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.579632 16662 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.580327 16662 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.581621 16659 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.582291 16662 ts_tablet_manager.cc:1434] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:05:55.583115 16662 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.584087 16659 ts_tablet_manager.cc:1434] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:05:55.584209 16661 tablet_bootstrap.cc:654] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.584928 16659 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.588687 16662 tablet_bootstrap.cc:654] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.591782 16659 tablet_bootstrap.cc:654] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.594971 16678 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.596233 16661 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.596678 16661 ts_tablet_manager.cc:1403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:05:55.601848 16662 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.602408 16662 ts_tablet_manager.cc:1403] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:05:55.605800 16662 raft_consensus.cc:359] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.606709 16662 raft_consensus.cc:385] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.607055 16662 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.608143 16662 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.613989 16662 ts_tablet_manager.cc:1434] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:55.614888 16662 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.615660 16748 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.616071 16661 raft_consensus.cc:359] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.617128 16661 raft_consensus.cc:385] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.618132 16661 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.619632 16661 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.621855 16661 ts_tablet_manager.cc:1434] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:55.622917 16661 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.627992 16678 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.629114 16661 tablet_bootstrap.cc:654] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.629492 16691 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.636492 16675 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.641299 16691 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.641886 16691 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.645586 16691 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:55.645473 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:55.646252 16662 tablet_bootstrap.cc:654] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.648442 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.649281 16619 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
W20260709 13:05:55.649861 16433 leader_election.cc:343] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.652195 16436 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:55.653364 16691 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.653764 16691 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.654182 16691 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.667557 16675 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.669859 16662 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.670310 16662 ts_tablet_manager.cc:1403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.000s
I20260709 13:05:55.672739 16662 raft_consensus.cc:359] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.677711 16662 raft_consensus.cc:385] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.677968 16662 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.682849 16544 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.684075 16691 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.689322 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:55.689507 16691 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:05:55.690701 16433 leader_election.cc:343] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.690821 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:55.691879 16619 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.698374 16691 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.702020 16619 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:55.703684 16436 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:55.704908 16666 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.705616 16666 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:55.706719 16666 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.728137 16666 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.734928 16367 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.679963 16662 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.742728 16662 ts_tablet_manager.cc:1434] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.002s
I20260709 13:05:55.751231 16662 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.745601 16666 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.763758 16662 tablet_bootstrap.cc:654] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.769057 16748 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.801936 16666 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.818003 16659 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.821892 16659 ts_tablet_manager.cc:1403] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.237s	user 0.037s	sys 0.054s
I20260709 13:05:55.825220 16659 raft_consensus.cc:359] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.827832 16659 raft_consensus.cc:385] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.828531 16659 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.830827 16659 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.833329 16659 ts_tablet_manager.cc:1434] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:55.834242 16659 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.837972 16662 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.838444 16662 ts_tablet_manager.cc:1403] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.087s	user 0.026s	sys 0.003s
I20260709 13:05:55.839475 16661 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.839986 16661 ts_tablet_manager.cc:1403] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.217s	user 0.038s	sys 0.110s
I20260709 13:05:55.841022 16659 tablet_bootstrap.cc:654] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.841717 16662 raft_consensus.cc:359] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.842660 16662 raft_consensus.cc:385] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.842948 16662 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.843966 16678 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.845109 16661 raft_consensus.cc:359] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.845865 16661 raft_consensus.cc:385] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.846181 16661 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.846966 16661 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.850190 16661 ts_tablet_manager.cc:1434] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:05:55.851325 16661 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.854312 16738 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.857956 16678 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:55.865180 16661 tablet_bootstrap.cc:654] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.843688 16662 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.875255 16662 ts_tablet_manager.cc:1434] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.005s
I20260709 13:05:55.876387 16662 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.876113 16666 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.878123 16661 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.878836 16661 ts_tablet_manager.cc:1403] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 13:05:55.882015 16661 raft_consensus.cc:359] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.883415 16661 raft_consensus.cc:385] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.885533 16661 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.887787 16661 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.889513 16662 tablet_bootstrap.cc:654] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.891479 16661 ts_tablet_manager.cc:1434] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:55.895210 16661 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.901319 16661 tablet_bootstrap.cc:654] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.909008 16744 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.909789 16744 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.912324 16662 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:55.912837 16662 ts_tablet_manager.cc:1403] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.002s
I20260709 13:05:55.913975 16744 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.914176 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:55.915294 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:55.917119 16582 leader_election.cc:343] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.917682 16662 raft_consensus.cc:359] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.918541 16662 raft_consensus.cc:385] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.918834 16662 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.923563 16662 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.925755 16468 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:55.928344 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:55.930338 16744 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:55.930749 16744 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.931123 16744 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.938366 16744 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.941242 16659 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:55.941743 16659 ts_tablet_manager.cc:1403] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.108s	user 0.017s	sys 0.023s
I20260709 13:05:55.941598 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:55.938892 16661 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:55.943259 16661 ts_tablet_manager.cc:1403] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.003s
I20260709 13:05:55.945892 16691 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.948050 16662 ts_tablet_manager.cc:1434] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:05:55.949064 16662 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:55.949002 16659 raft_consensus.cc:359] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.949803 16659 raft_consensus.cc:385] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.950099 16659 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.946082 16661 raft_consensus.cc:359] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.942914 16468 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:55.951444 16661 raft_consensus.cc:385] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:55.951886 16661 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:55.952626 16661 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.955332 16661 ts_tablet_manager.cc:1434] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:05:55.950793 16659 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.956429 16662 tablet_bootstrap.cc:654] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.958081 16659 ts_tablet_manager.cc:1434] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:55.959079 16659 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:55.962637 16678 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.969749 16744 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:55.970597 16659 tablet_bootstrap.cc:654] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:55.956398 16661 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:55.972575 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:05:55.976053 16582 leader_election.cc:343] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:55.978210 16468 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:55.980010 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:55.983655 16748 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:55.987222 16740 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.987802 16740 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.990957 16675 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:55.991788 16675 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:56.012398 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:55.993706 16675 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.016717 16618 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:56.018721 16468 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.021227 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.022469 16691 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.022908 16691 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.023062 16661 tablet_bootstrap.cc:654] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.023307 16691 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.025027 16744 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.025548 16744 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:55.993589 16740 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.029134 16748 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.030959 16748 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.032224 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.032938 16544 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:56.034929 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.037308 16748 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.045499 16678 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.049826 16678 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.051607 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.050432 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.047919 16691 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.050402 16678 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.052345 16470 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:56.052704 16618 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:56.054189 16585 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.054802 16678 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.055536 16678 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.055960 16678 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.056363 16678 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.057569 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:56.059733 16585 leader_election.cc:343] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.061260 16744 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.061966 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.062772 16544 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:56.066625 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.067587 16748 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.068049 16659 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.066661 16467 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:56.068604 16659 ts_tablet_manager.cc:1403] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.110s	user 0.020s	sys 0.029s
I20260709 13:05:56.067982 16748 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.069279 16748 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.077253 16662 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:56.077893 16662 ts_tablet_manager.cc:1403] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.129s	user 0.026s	sys 0.069s
I20260709 13:05:56.085620 16668 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.087119 16668 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.086989 16659 raft_consensus.cc:359] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.087785 16659 raft_consensus.cc:385] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.087602 16668 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.088101 16659 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.093421 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.093705 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:56.095827 16659 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:56.096086 16582 leader_election.cc:343] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.099258 16368 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:56.106740 16433 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.110359 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.111282 16616 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.101337 16691 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.095302 16748 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.131899 16668 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.132933 16748 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.135001 16543 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:05:56.134778 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.103132 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.136288 16677 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.137864 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.138171 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.117585 16739 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.141054 16511 leader_election.cc:343] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.141117 16739 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.143538 16739 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.144654 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:56.146096 16582 leader_election.cc:343] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.150624 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:56.152251 16585 leader_election.cc:343] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.152871 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.154222 16739 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.156239 16659 ts_tablet_manager.cc:1434] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.001s
I20260709 13:05:56.158180 16659 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.167450 16662 raft_consensus.cc:359] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.168483 16662 raft_consensus.cc:385] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.169080 16662 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.171253 16662 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.176121 16662 ts_tablet_manager.cc:1434] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:05:56.177564 16662 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:56.179203 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:05:56.181532 16511 leader_election.cc:343] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.183310 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:05:56.184098 16799 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:56.184495 16748 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.180151 16467 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:56.190436 16659 tablet_bootstrap.cc:654] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.193996 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:56.198410 16748 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.198570 16691 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.202308 16678 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.222724 16678 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.232910 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:56.233618 16545 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.233701 16616 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:56.236531 16691 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.237133 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:56.237046 16691 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.237771 16468 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.239097 16691 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.239926 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:56.241220 16691 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.241518 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.242069 16691 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:56.242115 16543 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:56.243399 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:56.244148 16738 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.244354 16662 tablet_bootstrap.cc:654] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.244535 16738 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.245020 16738 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.243288 16691 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.249385 16661 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.249846 16661 ts_tablet_manager.cc:1403] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.294s	user 0.012s	sys 0.005s
I20260709 13:05:56.241093 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.252619 16659 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.254151 16661 raft_consensus.cc:359] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.257602 16661 raft_consensus.cc:385] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.257750 16616 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:56.257958 16661 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.258700 16661 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.261000 16661 ts_tablet_manager.cc:1434] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:56.261567 16659 ts_tablet_manager.cc:1403] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.001s
I20260709 13:05:56.261338 16738 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.261767 16666 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.262338 16666 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.265640 16661 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.256171 16545 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:56.285017 16659 raft_consensus.cc:359] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.365579 16659 raft_consensus.cc:385] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.365994 16659 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.308398 16735 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.367413 16735 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.369505 16735 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:05:56.310078 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47282.2us
I20260709 13:05:56.374467 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.374855 16662 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:56.375289 16618 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.375942 16662 ts_tablet_manager.cc:1403] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.199s	user 0.022s	sys 0.036s
I20260709 13:05:56.379262 16662 raft_consensus.cc:359] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.380017 16662 raft_consensus.cc:385] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.380322 16662 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.317322 16666 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.381235 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.387609 16659 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.389003 16662 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.308552 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:56.302798 16738 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.398640 16659 ts_tablet_manager.cc:1434] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.137s	user 0.025s	sys 0.012s
I20260709 13:05:56.399729 16659 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.339706 16468 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:56.394080 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.409166 16543 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:56.287710 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.404587 16662 ts_tablet_manager.cc:1434] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:05:56.407034 16618 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:56.396579 16545 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.410372 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:56.413127 16368 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.412474 16662 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:56.418659 16691 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.419037 16691 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.419359 16691 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.417968 16675 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.423933 16675 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:56.424760 16739 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.425640 16675 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.429154 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.432916 16468 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
W20260709 13:05:56.414623 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 130476us
I20260709 13:05:56.434372 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:56.435232 16735 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:56.431226 16436 leader_election.cc:343] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.435629 16735 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.435993 16735 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.436983 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.442533 16661 tablet_bootstrap.cc:654] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.435217 16691 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.448279 16691 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.449193 16545 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
W20260709 13:05:56.450943 16511 leader_election.cc:343] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.443996 16436 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:05:56.493808 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52114us
I20260709 13:05:56.501682 16678 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.508059 16738 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.506661 16678 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.510761 16738 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:56.500916 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:56.515446 16545 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:56.521991 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:56.512719 16738 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.516294 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.526203 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:56.530330 16585 leader_election.cc:343] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.530822 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.529117 16678 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:05:56.533640 16582 leader_election.cc:343] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.534243 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:05:56.534616 16436 leader_election.cc:343] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.535866 16744 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:56.539031 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49386.2us
I20260709 13:05:56.540228 16659 tablet_bootstrap.cc:654] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.544755 16662 tablet_bootstrap.cc:654] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.548179 16661 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.550839 16661 ts_tablet_manager.cc:1403] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.285s	user 0.009s	sys 0.007s
I20260709 13:05:56.553555 16735 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.555305 16661 raft_consensus.cc:359] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.557745 16545 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:56.558779 16661 raft_consensus.cc:385] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.559723 16661 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.563916 16661 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:56.566026 16582 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:56.575398 16661 ts_tablet_manager.cc:1434] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.005s
I20260709 13:05:56.577858 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:56.579006 16735 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.579725 16666 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.582912 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:56.583591 16467 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.589273 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.580878 16666 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:05:56.591290 16511 leader_election.cc:343] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.591993 16666 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.605007 16661 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.606822 16467 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:56.607815 16659 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.608230 16662 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:56.608417 16659 ts_tablet_manager.cc:1403] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.209s	user 0.013s	sys 0.016s
I20260709 13:05:56.609007 16662 ts_tablet_manager.cc:1403] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.197s	user 0.019s	sys 0.019s
I20260709 13:05:56.608582 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:56.610821 16801 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.604755 16368 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.611370 16801 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:56.613639 16801 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.615871 16365 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.623955 16662 raft_consensus.cc:359] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.625133 16662 raft_consensus.cc:385] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.625499 16662 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.626706 16662 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.622850 16659 raft_consensus.cc:359] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.629032 16659 raft_consensus.cc:385] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.629464 16659 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.630712 16661 tablet_bootstrap.cc:654] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.630462 16659 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.636173 16662 ts_tablet_manager.cc:1434] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:56.639956 16659 ts_tablet_manager.cc:1434] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.006s
I20260709 13:05:56.641898 16659 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.661859 16662 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:56.674971 16659 tablet_bootstrap.cc:654] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.679337 16675 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.680059 16675 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.683950 16662 tablet_bootstrap.cc:654] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.686324 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.686473 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:56.688301 16582 leader_election.cc:343] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:56.688881 16585 leader_election.cc:343] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.689512 16585 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.690758 16678 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.691748 16675 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.695030 16661 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.695639 16661 ts_tablet_manager.cc:1403] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.017s
I20260709 13:05:56.698129 16365 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.701592 16659 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.702093 16659 ts_tablet_manager.cc:1403] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.061s	user 0.005s	sys 0.016s
I20260709 13:05:56.702344 16367 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.704336 16801 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.704999 16801 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.705391 16659 raft_consensus.cc:359] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.706166 16675 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.706866 16675 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.706185 16659 raft_consensus.cc:385] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.707639 16801 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.708194 16659 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.709383 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.709977 16468 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:56.710495 16661 raft_consensus.cc:359] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.711369 16661 raft_consensus.cc:385] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.711221 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:56.711790 16661 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.712307 16801 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.712809 16801 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.713198 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.713043 16661 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.714054 16617 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:56.715485 16661 ts_tablet_manager.cc:1434] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:05:56.716681 16661 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.712805 16659 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.718045 16675 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.713241 16801 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.719466 16659 ts_tablet_manager.cc:1434] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:05:56.720731 16659 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.723323 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.723877 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.724519 16543 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
W20260709 13:05:56.724920 16585 leader_election.cc:343] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.725941 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.727142 16675 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:56.727614 16675 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.728063 16675 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.731446 16659 tablet_bootstrap.cc:654] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.735637 16801 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.736740 16675 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.739372 16662 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:56.739848 16661 tablet_bootstrap.cc:654] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.739876 16662 ts_tablet_manager.cc:1403] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.007s
I20260709 13:05:56.744900 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:56.745124 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:56.745592 16543 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.745180 16662 raft_consensus.cc:359] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.745932 16467 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.746291 16662 raft_consensus.cc:385] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.746589 16662 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.744900 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:56.747882 16662 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.748730 16675 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.748905 16468 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.752215 16666 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:56.762419 16801 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.765146 16659 tablet_bootstrap.cc:492] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.764907 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.765611 16659 ts_tablet_manager.cc:1403] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.008s
I20260709 13:05:56.765605 16616 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.770299 16662 ts_tablet_manager.cc:1434] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:05:56.771275 16662 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:56.772436 16467 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:56.776685 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:56.777845 16801 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.778465 16801 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:56.779527 16801 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.782306 16468 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:56.780103 16616 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:56.792179 16543 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:56.793852 16659 raft_consensus.cc:359] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.795279 16659 raft_consensus.cc:385] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.795665 16659 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.796461 16659 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.797410 16585 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.798266 16678 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.798697 16678 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:56.801582 16659 ts_tablet_manager.cc:1434] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:05:56.803476 16678 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.811172 16659 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.812662 16662 tablet_bootstrap.cc:654] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.812922 16367 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.822136 16661 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.822664 16661 ts_tablet_manager.cc:1403] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.005s
I20260709 13:05:56.833125 16666 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.836933 16661 raft_consensus.cc:359] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.838171 16661 raft_consensus.cc:385] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.838488 16661 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.844477 16659 tablet_bootstrap.cc:654] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.844310 16661 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.856879 16661 ts_tablet_manager.cc:1434] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:05:56.856582 16365 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.858382 16661 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.859840 16801 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.860280 16801 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.863350 16801 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.864845 16662 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:56.866394 16662 ts_tablet_manager.cc:1403] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.009s
I20260709 13:05:56.866691 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.867801 16619 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:56.869505 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.870167 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:56.872179 16801 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:56.872321 16511 leader_election.cc:343] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.872759 16801 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.875242 16661 tablet_bootstrap.cc:654] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.873263 16801 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.874567 16662 raft_consensus.cc:359] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.877678 16662 raft_consensus.cc:385] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.878026 16662 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.878702 16662 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.884438 16801 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.888374 16659 tablet_bootstrap.cc:492] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:56.888113 16678 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.888947 16659 ts_tablet_manager.cc:1403] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.008s
I20260709 13:05:56.892462 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:05:56.897029 16511 leader_election.cc:343] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:56.900209 16661 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.900907 16661 ts_tablet_manager.cc:1403] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.001s
I20260709 13:05:56.901721 16662 ts_tablet_manager.cc:1434] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:05:56.902942 16662 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:56.903072 16801 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.891562 16659 raft_consensus.cc:359] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.903707 16659 raft_consensus.cc:385] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.904006 16659 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.904204 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:56.904863 16619 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.904633 16659 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.904700 16661 raft_consensus.cc:359] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.905604 16661 raft_consensus.cc:385] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.905932 16661 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.906666 16659 ts_tablet_manager.cc:1434] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:05:56.906723 16661 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.907588 16659 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:56.909085 16661 ts_tablet_manager.cc:1434] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:56.913636 16661 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.913856 16619 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:56.915160 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.917410 16801 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:56.918146 16801 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:56.919132 16801 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.925069 16678 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.925642 16678 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.927042 16661 tablet_bootstrap.cc:654] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.928860 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.930766 16659 tablet_bootstrap.cc:654] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:56.930744 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.931972 16545 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:56.931841 16678 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.940236 16677 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.940752 16677 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.942399 16735 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.943029 16677 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:56.942874 16735 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.946069 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.953075 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:56.948403 16678 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.954259 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.956410 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:56.948096 16735 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:56.957542 16668 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.971751 16675 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:56.971958 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:56.971688 16368 catalog_manager.cc:5697] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:56.979233 16661 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:56.979703 16661 ts_tablet_manager.cc:1403] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.011s
I20260709 13:05:56.982800 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:56.983637 16468 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:05:56.984805 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:56.985839 16739 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.988221 16678 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:56.984973 16542 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:56.992830 16808 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:56.993193 16661 raft_consensus.cc:359] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.993844 16661 raft_consensus.cc:385] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:56.994113 16661 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:56.994750 16661 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:56.996402 16661 ts_tablet_manager.cc:1434] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 13:05:56.997366 16661 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:56.996116 16735 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.002027 16735 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.002614 16662 tablet_bootstrap.cc:654] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.002687 16739 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.010178 16735 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.011453 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.012540 16468 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.021378 16659 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.021950 16659 ts_tablet_manager.cc:1403] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.008s
I20260709 13:05:57.023167 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.027377 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.028190 16617 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.025422 16735 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.030326 16735 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.039142 16661 tablet_bootstrap.cc:654] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.033687 16735 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.045648 16691 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.047443 16659 raft_consensus.cc:359] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.048343 16659 raft_consensus.cc:385] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.048756 16659 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.049618 16659 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.052171 16659 ts_tablet_manager.cc:1434] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:05:57.053412 16659 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.058840 16735 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.059895 16659 tablet_bootstrap.cc:654] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.061805 16662 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.062384 16662 ts_tablet_manager.cc:1403] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.004s
I20260709 13:05:57.064100 16735 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.066565 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.067440 16619 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.069384 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:57.070230 16468 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.079636 16662 raft_consensus.cc:359] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.080590 16662 raft_consensus.cc:385] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.080965 16662 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.081306 16735 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.081795 16662 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.089566 16662 ts_tablet_manager.cc:1434] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:05:57.090597 16662 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.091596 16661 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.092052 16661 ts_tablet_manager.cc:1403] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.028s
I20260709 13:05:57.091977 16735 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.096405 16662 tablet_bootstrap.cc:654] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.099371 16661 raft_consensus.cc:359] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.100066 16661 raft_consensus.cc:385] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.100351 16661 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.101128 16661 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.104276 16661 ts_tablet_manager.cc:1434] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:57.105247 16661 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.115447 16468 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.116724 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.117674 16735 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.118167 16735 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:57.118983 16735 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.109930 16619 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.134727 16661 tablet_bootstrap.cc:654] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.144404 16678 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.145519 16678 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.147053 16659 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.147504 16659 ts_tablet_manager.cc:1403] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.014s
I20260709 13:05:57.147560 16678 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.154232 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.154986 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:57.156395 16585 leader_election.cc:343] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.156253 16367 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:57.160739 16582 leader_election.cc:343] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.165328 16659 raft_consensus.cc:359] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.166006 16659 raft_consensus.cc:385] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.166255 16659 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.166862 16659 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.162184 16582 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.169101 16659 ts_tablet_manager.cc:1434] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.006s
I20260709 13:05:57.170135 16659 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.170585 16678 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.171615 16661 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.172138 16661 ts_tablet_manager.cc:1403] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.005s
I20260709 13:05:57.174701 16661 raft_consensus.cc:359] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.175377 16661 raft_consensus.cc:385] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.175606 16659 tablet_bootstrap.cc:654] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.175712 16661 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.176518 16661 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.179286 16661 ts_tablet_manager.cc:1434] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:57.180989 16661 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.187172 16661 tablet_bootstrap.cc:654] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.187597 16808 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.189586 16545 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.195935 16659 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.196429 16659 ts_tablet_manager.cc:1403] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.003s
I20260709 13:05:57.201216 16662 tablet_bootstrap.cc:492] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.202540 16662 ts_tablet_manager.cc:1403] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.012s
I20260709 13:05:57.202610 16659 raft_consensus.cc:359] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.203661 16659 raft_consensus.cc:385] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.204000 16659 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.206950 16662 raft_consensus.cc:359] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.207858 16662 raft_consensus.cc:385] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.208207 16662 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.209268 16662 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.210809 16668 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:05:57.211513 16668 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.204885 16659 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.217378 16659 ts_tablet_manager.cc:1434] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:05:57.218189 16659 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.219365 16739 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.219831 16739 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.223747 16668 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.224858 16739 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.225881 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.227128 16659 tablet_bootstrap.cc:654] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.227286 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.225170 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.234692 16662 ts_tablet_manager.cc:1434] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:05:57.244088 16662 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
W20260709 13:05:57.236603 16585 leader_election.cc:343] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:57.244655 16582 leader_election.cc:343] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.246873 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.248705 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.250659 16678 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.251034 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:57.252605 16668 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.253829 16661 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.254257 16661 ts_tablet_manager.cc:1403] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.029s
I20260709 13:05:57.257607 16661 raft_consensus.cc:359] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.258268 16661 raft_consensus.cc:385] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.258513 16661 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.258819 16662 tablet_bootstrap.cc:654] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.259308 16661 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.261161 16668 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.261571 16668 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.263510 16668 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.265079 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.265751 16467 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.265966 16661 ts_tablet_manager.cc:1434] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:05:57.266060 16691 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.266304 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.266937 16617 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.267381 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.268090 16661 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.268657 16668 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.269016 16668 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.269359 16668 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.274662 16661 tablet_bootstrap.cc:654] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.275496 16739 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.276053 16668 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.279459 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:57.280011 16467 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.287060 16801 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.300310 16467 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.306154 16668 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.308184 16659 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.309553 16659 ts_tablet_manager.cc:1403] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.006s
I20260709 13:05:57.312180 16659 raft_consensus.cc:359] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.312855 16659 raft_consensus.cc:385] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.313126 16659 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.313385 16678 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.314616 16659 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.317562 16662 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.318018 16662 ts_tablet_manager.cc:1403] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.002s
I20260709 13:05:57.318224 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.318810 16619 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.320376 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.321238 16668 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.321462 16801 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.322327 16801 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:57.323251 16801 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.327240 16619 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.327690 16659 ts_tablet_manager.cc:1434] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:05:57.329957 16662 raft_consensus.cc:359] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.330741 16662 raft_consensus.cc:385] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.331012 16662 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.331681 16662 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.328709 16659 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.368479 16662 ts_tablet_manager.cc:1434] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 13:05:57.369478 16662 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.377748 16661 tablet_bootstrap.cc:492] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.378336 16661 ts_tablet_manager.cc:1403] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.110s	user 0.032s	sys 0.032s
I20260709 13:05:57.384707 16675 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.385255 16675 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.386647 16659 tablet_bootstrap.cc:654] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.387473 16675 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.388492 16661 raft_consensus.cc:359] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.389616 16661 raft_consensus.cc:385] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.389974 16661 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.390767 16661 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.392354 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.393474 16661 ts_tablet_manager.cc:1434] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 13:05:57.394150 16585 leader_election.cc:343] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.394789 16661 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.399295 16662 tablet_bootstrap.cc:654] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.397809 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:57.409942 16582 leader_election.cc:343] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.410519 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.411339 16677 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.412633 16677 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.413105 16677 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.415683 16677 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.418277 16691 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.418748 16691 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.419672 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.421103 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.421731 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.422500 16617 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:05:57.423791 16661 tablet_bootstrap.cc:654] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.424081 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.424816 16691 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.425762 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:05:57.424319 16582 leader_election.cc:343] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.427569 16691 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.426957 16585 leader_election.cc:343] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.434243 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.434588 16801 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:57.439044 16662 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.439561 16662 ts_tablet_manager.cc:1403] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.070s	user 0.002s	sys 0.007s
I20260709 13:05:57.440747 16691 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.442862 16662 raft_consensus.cc:359] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.443598 16662 raft_consensus.cc:385] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.443873 16662 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.444909 16661 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.445358 16661 ts_tablet_manager.cc:1403] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.005s
I20260709 13:05:57.446588 16659 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.447050 16659 ts_tablet_manager.cc:1403] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.119s	user 0.014s	sys 0.007s
I20260709 13:05:57.444496 16662 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.448980 16677 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.451689 16744 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.452067 16662 ts_tablet_manager.cc:1434] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:57.452159 16744 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.453382 16662 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.454442 16744 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.456000 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.457230 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.457703 16661 raft_consensus.cc:359] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:57.457846 16585 leader_election.cc:343] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.458348 16661 raft_consensus.cc:385] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:57.458520 16582 leader_election.cc:343] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.458660 16661 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.458958 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.459438 16661 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.459879 16677 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.462000 16661 ts_tablet_manager.cc:1434] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:05:57.462940 16661 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.462853 16659 raft_consensus.cc:359] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.463550 16659 raft_consensus.cc:385] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.463820 16659 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.448208 16368 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.464555 16659 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.466538 16659 ts_tablet_manager.cc:1434] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:05:57.467468 16659 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.471917 16662 tablet_bootstrap.cc:654] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.474188 16659 tablet_bootstrap.cc:654] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.479969 16691 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.480458 16691 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.481686 16661 tablet_bootstrap.cc:654] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.482474 16691 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.483605 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.484088 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.484329 16619 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:57.484674 16542 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:57.479756 16801 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.485790 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:57.486786 16691 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.487200 16691 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.487576 16691 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.499892 16659 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.499872 16677 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.500648 16659 ts_tablet_manager.cc:1403] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.004s
I20260709 13:05:57.500682 16677 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.505368 16691 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.506520 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:57.511224 16582 leader_election.cc:343] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.511610 16662 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.504544 16659 raft_consensus.cc:359] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.512104 16662 ts_tablet_manager.cc:1403] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.010s
I20260709 13:05:57.512210 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:57.512640 16691 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.514284 16662 raft_consensus.cc:359] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.514714 16662 raft_consensus.cc:385] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.514870 16662 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.515281 16662 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.512133 16659 raft_consensus.cc:385] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.516177 16659 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.517189 16662 ts_tablet_manager.cc:1434] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:05:57.511610 16661 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.516799 16659 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.517925 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.518188 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.518466 16619 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.519616 16659 ts_tablet_manager.cc:1434] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
W20260709 13:05:57.519855 16585 leader_election.cc:343] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.520332 16585 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.517961 16661 ts_tablet_manager.cc:1403] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.011s
I20260709 13:05:57.521135 16744 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.512800 16542 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.523324 16661 raft_consensus.cc:359] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.523996 16661 raft_consensus.cc:385] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.524241 16661 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.524883 16661 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.525243 16619 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:57.526357 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:57.526870 16661 ts_tablet_manager.cc:1434] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:57.527084 16691 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.527648 16661 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.527731 16691 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:57.520618 16659 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.528528 16691 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.535213 16662 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.537951 16677 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.541760 16659 tablet_bootstrap.cc:654] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.545202 16661 tablet_bootstrap.cc:654] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.546831 16662 tablet_bootstrap.cc:654] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.558947 16368 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.564910 16668 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.565543 16668 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.568104 16668 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.574802 16659 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.575227 16659 ts_tablet_manager.cc:1403] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.012s
I20260709 13:05:57.574550 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.575955 16470 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.577215 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.578064 16668 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.578001 16659 raft_consensus.cc:359] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.578490 16668 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.578768 16659 raft_consensus.cc:385] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.578820 16668 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.579097 16659 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.579749 16659 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.575740 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.583338 16619 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.564325 16542 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:57.587489 16668 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.590179 16659 ts_tablet_manager.cc:1434] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:57.592038 16659 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.597868 16668 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.598942 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:57.599781 16470 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.600159 16659 tablet_bootstrap.cc:654] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.602669 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.603241 16619 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.605033 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:57.612119 16661 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.613258 16661 ts_tablet_manager.cc:1403] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.011s
I20260709 13:05:57.614465 16691 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.614933 16691 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.616187 16661 raft_consensus.cc:359] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.618445 16662 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.619081 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.622833 16662 ts_tablet_manager.cc:1403] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.000s
I20260709 13:05:57.622870 16616 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:57.624230 16436 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:57.624457 16619 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.625088 16738 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.625437 16738 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.625597 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:57.617724 16691 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.621109 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.625792 16738 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.626411 16668 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.625617 16662 raft_consensus.cc:359] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.626967 16668 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:57.627089 16662 raft_consensus.cc:385] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.627422 16662 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.627848 16668 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.628154 16662 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.629858 16662 ts_tablet_manager.cc:1434] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:57.630854 16662 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.619477 16470 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.632987 16738 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.635727 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:57.636293 16545 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.639745 16661 raft_consensus.cc:385] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.643254 16545 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:57.644428 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.645251 16691 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.645941 16691 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:57.646698 16691 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.648411 16662 tablet_bootstrap.cc:654] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.648260 16542 raft_consensus.cc:2376] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1. Re-sending same reply.
I20260709 13:05:57.640159 16661 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.654881 16738 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.654433 16661 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.655085 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.655717 16619 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.657555 16659 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.658057 16659 ts_tablet_manager.cc:1403] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.002s
I20260709 13:05:57.660661 16659 raft_consensus.cc:359] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.661391 16659 raft_consensus.cc:385] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.661721 16659 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.662454 16659 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.662814 16662 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.662860 16619 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:57.663626 16662 ts_tablet_manager.cc:1403] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.006s
I20260709 13:05:57.663872 16367 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.665503 16661 ts_tablet_manager.cc:1434] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:05:57.666481 16661 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.666203 16662 raft_consensus.cc:359] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.666834 16662 raft_consensus.cc:385] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.667090 16662 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.667806 16662 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.671581 16662 ts_tablet_manager.cc:1434] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:57.672647 16662 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.676261 16661 tablet_bootstrap.cc:654] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.677286 16801 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.678361 16662 tablet_bootstrap.cc:654] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.681399 16659 ts_tablet_manager.cc:1434] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:05:57.682396 16659 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.692183 16659 tablet_bootstrap.cc:654] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.691510 16367 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.700964 16668 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.704697 16659 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.707391 16659 ts_tablet_manager.cc:1403] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.006s
I20260709 13:05:57.715001 16675 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.715699 16675 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.719019 16659 raft_consensus.cc:359] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.719939 16659 raft_consensus.cc:385] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.720335 16659 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.721403 16659 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.722062 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.723613 16691 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.724224 16691 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.728088 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.728909 16691 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.731283 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:57.719926 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:57.734391 16585 leader_election.cc:343] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:57.735481 16433 leader_election.cc:343] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.737231 16659 ts_tablet_manager.cc:1434] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 13:05:57.737145 16582 leader_election.cc:343] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.736387 16619 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:57.737869 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.739838 16668 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.740481 16677 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.740409 16668 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.741782 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:57.742676 16668 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.742805 16691 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.743325 16691 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.743724 16691 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.744073 16668 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.739430 16675 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.748004 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.754385 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.755306 16619 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
W20260709 13:05:57.755601 16511 leader_election.cc:343] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.757292 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.758500 16668 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.759102 16668 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.759474 16668 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.760042 16659 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.774682 16661 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.775168 16661 ts_tablet_manager.cc:1403] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.109s	user 0.006s	sys 0.010s
I20260709 13:05:57.775425 16662 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.775858 16662 ts_tablet_manager.cc:1403] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.103s	user 0.033s	sys 0.060s
I20260709 13:05:57.777711 16661 raft_consensus.cc:359] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.778173 16662 raft_consensus.cc:359] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.778707 16661 raft_consensus.cc:385] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.778765 16662 raft_consensus.cc:385] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.779047 16661 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.779076 16662 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.779927 16662 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.781852 16662 ts_tablet_manager.cc:1434] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:05:57.782763 16662 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.786463 16661 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.788672 16661 ts_tablet_manager.cc:1434] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:05:57.789649 16661 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.797678 16801 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:57.784654 16691 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.804235 16691 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.805419 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.807822 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:57.806087 16619 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:57.809350 16433 leader_election.cc:343] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.813388 16659 tablet_bootstrap.cc:654] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.795583 16668 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.819096 16668 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.820534 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.821201 16617 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.821745 16662 tablet_bootstrap.cc:654] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.829073 16661 tablet_bootstrap.cc:654] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.832830 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:57.833499 16470 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.835379 16662 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.835852 16662 ts_tablet_manager.cc:1403] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.002s
I20260709 13:05:57.838275 16662 raft_consensus.cc:359] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.844241 16662 raft_consensus.cc:385] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.844621 16662 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.845770 16619 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:57.847095 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:57.848405 16740 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.848937 16740 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:57.849834 16740 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.857896 16662 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.862665 16659 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:57.863188 16659 ts_tablet_manager.cc:1403] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.000s
I20260709 13:05:57.865091 16662 ts_tablet_manager.cc:1434] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:05:57.860450 16470 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.866711 16662 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.868000 16661 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.868386 16661 ts_tablet_manager.cc:1403] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.012s
I20260709 13:05:57.871961 16661 raft_consensus.cc:359] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.872735 16617 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.877369 16661 raft_consensus.cc:385] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.877736 16661 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.875108 16659 raft_consensus.cc:359] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.878135 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.878582 16659 raft_consensus.cc:385] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.878952 16659 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.878648 16661 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.879765 16801 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:57.880229 16801 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:57.881114 16661 ts_tablet_manager.cc:1434] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:05:57.880715 16367 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:57.881008 16801 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.882222 16661 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.884012 16662 tablet_bootstrap.cc:654] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.879606 16659 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.889008 16661 tablet_bootstrap.cc:654] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.891422 16659 ts_tablet_manager.cc:1434] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:05:57.908939 16659 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:57.918612 16735 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.919312 16735 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.921989 16735 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.924942 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.925850 16470 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.927420 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.928570 16735 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.929105 16735 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.929529 16735 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.933465 16662 tablet_bootstrap.cc:492] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.933863 16662 ts_tablet_manager.cc:1403] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.024s
I20260709 13:05:57.934304 16661 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:57.924942 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.934736 16661 ts_tablet_manager.cc:1403] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.029s
I20260709 13:05:57.936355 16662 raft_consensus.cc:359] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.937117 16662 raft_consensus.cc:385] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.937223 16661 raft_consensus.cc:359] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.937618 16662 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.937920 16661 raft_consensus.cc:385] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.938264 16661 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:57.938355 16617 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.938383 16662 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.938947 16661 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.940753 16662 ts_tablet_manager.cc:1434] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:57.940899 16661 ts_tablet_manager.cc:1434] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:05:57.941922 16661 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:57.942672 16675 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.942901 16662 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:57.943168 16675 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.946164 16675 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:57.946832 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.947271 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:57.948385 16585 leader_election.cc:343] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.949467 16662 tablet_bootstrap.cc:654] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:57.953714 16582 leader_election.cc:343] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:57.954589 16661 tablet_bootstrap.cc:654] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:57.962374 16836 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.954622 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:57.963022 16836 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.964322 16677 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.965123 16668 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.965750 16668 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.970412 16735 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.973501 16735 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.973865 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.974730 16470 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.976804 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:57.977319 16662 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:57.977375 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:57.977548 16617 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.977859 16662 ts_tablet_manager.cc:1403] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.015s
I20260709 13:05:57.978497 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:57.979082 16470 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.980527 16662 raft_consensus.cc:359] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.981225 16662 raft_consensus.cc:385] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:57.981009 16801 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:57.981402 16668 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.981666 16801 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.982048 16801 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.983263 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.984050 16619 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:57.985163 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:57.986011 16619 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:57.986431 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:57.987967 16511 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:57.988502 16801 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.993659 16801 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:57.994328 16668 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:57.994884 16836 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.000481 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.000728 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.001325 16619 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.001353 16467 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.004861 16668 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:57.991895 16470 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:57.989187 16662 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.007073 16662 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.009418 16662 ts_tablet_manager.cc:1434] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:05:58.010408 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:58.010777 16662 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.012545 16836 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.013155 16836 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.013911 16836 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:57.972432 16365 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.021807 16662 tablet_bootstrap.cc:654] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.021575 16467 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.025408 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:58.026315 16735 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.026950 16735 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.027735 16735 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.029808 16659 tablet_bootstrap.cc:654] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.030884 16661 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.031359 16661 ts_tablet_manager.cc:1403] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.090s	user 0.029s	sys 0.032s
I20260709 13:05:58.033866 16617 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.034129 16661 raft_consensus.cc:359] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.034853 16661 raft_consensus.cc:385] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.035171 16661 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.035948 16661 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.038184 16661 ts_tablet_manager.cc:1434] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:58.039160 16661 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.044425 16619 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.044866 16661 tablet_bootstrap.cc:654] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.046118 16662 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.047148 16662 ts_tablet_manager.cc:1403] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.004s
I20260709 13:05:58.050493 16662 raft_consensus.cc:359] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.050984 16659 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:58.051239 16662 raft_consensus.cc:385] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.051445 16659 ts_tablet_manager.cc:1403] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.000s
I20260709 13:05:58.051561 16662 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.052341 16662 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.053926 16659 raft_consensus.cc:359] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.054454 16662 ts_tablet_manager.cc:1434] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:58.054565 16659 raft_consensus.cc:385] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.055567 16659 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.055758 16662 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.056958 16659 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.062055 16662 tablet_bootstrap.cc:654] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.063292 16661 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.063436 16675 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.063755 16661 ts_tablet_manager.cc:1403] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:05:58.063947 16675 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.066368 16661 raft_consensus.cc:359] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.067013 16661 raft_consensus.cc:385] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.067281 16661 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.067353 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.067924 16661 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.068203 16467 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:58.070567 16661 ts_tablet_manager.cc:1434] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:05:58.070214 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.071600 16661 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.071759 16677 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.072265 16677 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.072722 16677 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.078119 16675 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.080955 16661 tablet_bootstrap.cc:654] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.082705 16740 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.085132 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:58.086056 16542 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:58.098752 16895 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.099395 16895 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.103991 16895 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.106019 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.106894 16470 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.108407 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:58.114315 16895 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.114815 16895 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.115175 16895 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.120223 16367 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.121155 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.121762 16619 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.122117 16367 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.132448 16740 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.138556 16738 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.142937 16895 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.085966 16677 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.153267 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.154222 16467 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.153177 16738 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.166632 16836 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.167333 16836 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.170269 16836 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.174726 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.175629 16468 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.179682 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:58.181099 16801 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.181587 16801 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.181298 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.182029 16801 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.182228 16617 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.187697 16836 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.189682 16801 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.196511 16801 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.205173 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.206121 16469 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.222960 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.223850 16619 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.228271 16836 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.247383 16659 ts_tablet_manager.cc:1434] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.196s	user 0.008s	sys 0.000s
W20260709 13:05:58.248324 16903 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:58.249972 16738 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:58.254465 16659 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:58.263495 16661 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.263934 16661 ts_tablet_manager.cc:1403] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.193s	user 0.052s	sys 0.102s
I20260709 13:05:58.266448 16661 raft_consensus.cc:359] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.267095 16661 raft_consensus.cc:385] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.267380 16661 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.268019 16661 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.269731 16677 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.271806 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:58.274559 16545 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.276374 16659 tablet_bootstrap.cc:654] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.279173 16467 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:58.280521 16661 ts_tablet_manager.cc:1434] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:58.280369 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.282840 16895 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.282920 16744 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.283530 16744 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:58.284408 16744 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.284906 16469 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.287895 16659 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:58.289335 16661 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.289470 16619 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.292976 16662 tablet_bootstrap.cc:492] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.292922 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.293467 16662 ts_tablet_manager.cc:1403] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.238s	user 0.068s	sys 0.071s
I20260709 13:05:58.293548 16616 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.296325 16659 ts_tablet_manager.cc:1403] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.000s
I20260709 13:05:58.296382 16662 raft_consensus.cc:359] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.297212 16662 raft_consensus.cc:385] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.297762 16662 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.298466 16662 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.300458 16662 ts_tablet_manager.cc:1434] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:58.301410 16662 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.301741 16659 raft_consensus.cc:359] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.302449 16659 raft_consensus.cc:385] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.302733 16659 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.303433 16659 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.296722 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.305156 16661 tablet_bootstrap.cc:654] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.297254 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.307260 16545 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:58.308698 16895 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.309247 16895 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.310108 16895 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.311208 16469 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.312304 16659 ts_tablet_manager.cc:1434] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:05:58.313467 16659 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:58.327813 16616 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.328949 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.329710 16836 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.330720 16836 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.331547 16836 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.343356 16662 tablet_bootstrap.cc:654] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.345391 16469 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.348273 16738 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.343762 16367 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.351133 16895 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.362736 16895 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.364811 16895 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.365953 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.366755 16616 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.370941 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.373723 16735 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.374197 16735 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.374594 16735 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.377542 16801 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.379789 16368 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.384919 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.385701 16470 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.386346 16735 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.387563 16661 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.387898 16659 tablet_bootstrap.cc:654] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.388024 16661 ts_tablet_manager.cc:1403] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.013s
I20260709 13:05:58.390412 16675 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.390992 16675 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.398015 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.402374 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:58.404578 16585 leader_election.cc:343] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.405817 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.406571 16470 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.409955 16661 raft_consensus.cc:359] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:58.410432 16582 leader_election.cc:343] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.411288 16582 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:58.412187 16677 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:58.416335 16661 raft_consensus.cc:385] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.416680 16661 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.420148 16661 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.396984 16675 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.426496 16661 ts_tablet_manager.cc:1434] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:05:58.426781 16662 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.427233 16662 ts_tablet_manager.cc:1403] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.025s
I20260709 13:05:58.427457 16661 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.431957 16662 raft_consensus.cc:359] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.432596 16662 raft_consensus.cc:385] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.433077 16662 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.435209 16662 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.437999 16677 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.438455 16677 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.440380 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.440460 16677 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.443759 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:58.441869 16735 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.445489 16662 ts_tablet_manager.cc:1434] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:05:58.444682 16542 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:58.446859 16615 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.447678 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.448304 16468 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:58.449573 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.450341 16677 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.450729 16677 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.451122 16677 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.454583 16662 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.455650 16801 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.459972 16677 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.465058 16836 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:58.467787 16365 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.470961 16659 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:58.471661 16659 ts_tablet_manager.cc:1403] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.158s	user 0.016s	sys 0.016s
I20260709 13:05:58.470928 16677 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.472353 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:58.473879 16545 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.475063 16661 tablet_bootstrap.cc:654] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.473278 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.491786 16615 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.495282 16545 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:58.496322 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.496332 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.498322 16675 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.499691 16675 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:58.500533 16675 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.503460 16659 raft_consensus.cc:359] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.504801 16659 raft_consensus.cc:385] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.505637 16659 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.495283 16466 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.518376 16662 tablet_bootstrap.cc:654] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.512396 16801 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.512151 16735 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:05:58.527850 16801 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.528788 16801 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.543982 16662 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.544396 16662 ts_tablet_manager.cc:1403] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.006s
I20260709 13:05:58.536347 16470 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.544889 16922 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:05:58.557947 16659 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.563349 16659 ts_tablet_manager.cc:1434] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.005s
I20260709 13:05:58.564635 16659 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
W20260709 13:05:58.615463 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75460.1us
I20260709 13:05:58.617177 16661 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.617635 16661 ts_tablet_manager.cc:1403] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.009s
I20260709 13:05:58.620190 16662 raft_consensus.cc:359] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.621013 16662 raft_consensus.cc:385] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.614609 16466 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:58.621731 16662 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.625582 16661 raft_consensus.cc:359] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.628750 16661 raft_consensus.cc:385] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.629051 16661 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.629652 16661 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.633728 16661 ts_tablet_manager.cc:1434] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:58.634702 16661 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.639381 16659 tablet_bootstrap.cc:654] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.632476 16662 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.648272 16662 ts_tablet_manager.cc:1434] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.011s
I20260709 13:05:58.653137 16662 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.668020 16662 tablet_bootstrap.cc:654] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.674063 16368 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:58.675267 16659 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:58.675648 16659 ts_tablet_manager.cc:1403] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.005s
W20260709 13:05:58.678357 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45941.2us
I20260709 13:05:58.672919 16365 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.688323 16668 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.720180 16923 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.721385 16923 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.722416 16738 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.721978 16659 raft_consensus.cc:359] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.724947 16659 raft_consensus.cc:385] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.725188 16659 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.726547 16923 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.730099 16661 tablet_bootstrap.cc:654] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.735275 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.738037 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.722910 16738 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.741627 16738 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.743187 16928 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.743805 16928 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.734103 16923 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:58.737509 16659 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.747524 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:58.748603 16544 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
W20260709 13:05:58.749975 16511 leader_election.cc:343] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.750825 16618 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.766450 16662 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.767143 16662 ts_tablet_manager.cc:1403] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.006s
I20260709 13:05:58.768707 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.769384 16659 ts_tablet_manager.cc:1434] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:05:58.769418 16615 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:58.770955 16659 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
W20260709 13:05:58.773944 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:58.778054 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.778877 16738 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.779230 16738 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.779557 16738 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.779927 16662 raft_consensus.cc:359] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.780577 16662 raft_consensus.cc:385] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.780908 16662 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.782449 16928 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:05:58.853116 16914 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.063s	user 0.007s	sys 0.015s
I20260709 13:05:58.789707 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:05:58.854379 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64783.9us
I20260709 13:05:58.784157 16662 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.807818 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.846185 16928 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:58.859673 16661 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:58.860132 16661 ts_tablet_manager.cc:1403] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.226s	user 0.016s	sys 0.013s
I20260709 13:05:58.865724 16668 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:58.866338 16661 raft_consensus.cc:359] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.867007 16661 raft_consensus.cc:385] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.867235 16661 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
W20260709 13:05:58.868746 16585 leader_election.cc:343] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.869136 16659 tablet_bootstrap.cc:654] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.839828 16738 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.875257 16662 ts_tablet_manager.cc:1434] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.001s
I20260709 13:05:58.876868 16662 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.872841 16661 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.878749 16661 ts_tablet_manager.cc:1434] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:05:58.860253 16923 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.879314 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:58.879739 16923 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.880189 16923 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.881078 16661 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:58.881752 16738 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.887337 16662 tablet_bootstrap.cc:654] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.890050 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:58.890661 16544 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.895339 16923 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.897267 16542 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:05:58.897886 16801 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.900897 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.901468 16616 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.909240 16661 tablet_bootstrap.cc:654] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.910847 16930 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.911476 16930 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.914294 16930 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:58.915400 16801 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.916254 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:58.918136 16585 leader_election.cc:343] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.921944 16659 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:58.922673 16659 ts_tablet_manager.cc:1403] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.152s	user 0.033s	sys 0.040s
I20260709 13:05:58.926612 16659 raft_consensus.cc:359] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.927923 16659 raft_consensus.cc:385] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.928167 16659 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.928764 16659 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.930414 16659 ts_tablet_manager.cc:1434] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:58.931156 16659 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:58.932639 16923 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.934453 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:58.934742 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:58.935279 16614 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.937794 16662 tablet_bootstrap.cc:492] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:58.938305 16662 ts_tablet_manager.cc:1403] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.006s
I20260709 13:05:58.938470 16801 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:58.940299 16511 leader_election.cc:343] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:58.942226 16614 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:58.943274 16662 raft_consensus.cc:359] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.943800 16662 raft_consensus.cc:385] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:58.944043 16662 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:58.943910 16544 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:58.944727 16662 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.947790 16659 tablet_bootstrap.cc:654] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.947695 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:58.949254 16801 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.949703 16801 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:58.950414 16801 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.951982 16662 ts_tablet_manager.cc:1434] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:05:58.952944 16662 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:58.954335 16616 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:58.956076 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.957194 16738 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:58.958009 16738 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:58.958953 16738 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.960188 16662 tablet_bootstrap.cc:654] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:58.964884 16895 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.965358 16895 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:58.967164 16895 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:58.969359 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:58.970046 16468 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.980058 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:58.981186 16930 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.980785 16616 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:58.985960 16675 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:58.994047 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:58.996500 16895 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:58.996889 16895 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.997442 16895 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:58.999135 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:59.000259 16675 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.006615 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.012159 16895 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:05:59.043546 16582 leader_election.cc:343] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.044023 16582 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:05:59.048871 16496 tablet.cc:2406] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:59.055637 16927 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.050978 16744 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:05:59.073508 16691 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.073961 16691 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.079111 16691 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.084123 16895 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.085106 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.072790 16933 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:59.085943 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:59.086526 16470 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.086932 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:59.087461 16619 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.095235 16619 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:59.096498 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:59.100939 16662 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.101455 16662 ts_tablet_manager.cc:1403] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.149s	user 0.034s	sys 0.058s
I20260709 13:05:59.105020 16924 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.098994 16368 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.107134 16924 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:05:59.107573 16950 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:05:59.113826 16662 raft_consensus.cc:359] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.114586 16662 raft_consensus.cc:385] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.114910 16662 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.115809 16662 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.119843 16659 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.120342 16659 ts_tablet_manager.cc:1403] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.189s	user 0.060s	sys 0.058s
I20260709 13:05:59.124020 16470 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:59.127159 16661 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.127683 16661 ts_tablet_manager.cc:1403] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.247s	user 0.020s	sys 0.013s
I20260709 13:05:59.108038 16924 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.129168 16662 ts_tablet_manager.cc:1434] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:05:59.134300 16661 raft_consensus.cc:359] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.135047 16661 raft_consensus.cc:385] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.135324 16661 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.135919 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.136682 16618 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:05:59.137665 16661 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.139633 16662 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.142168 16659 raft_consensus.cc:359] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.142899 16659 raft_consensus.cc:385] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.143337 16661 ts_tablet_manager.cc:1434] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:05:59.143250 16659 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.144428 16661 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.144331 16659 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.147511 16659 ts_tablet_manager.cc:1434] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:05:59.148734 16659 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.154441 16662 tablet_bootstrap.cc:654] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.151125 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:59.164961 16691 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.158290 16661 tablet_bootstrap.cc:654] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.173472 16659 tablet_bootstrap.cc:654] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.175422 16661 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.175918 16661 ts_tablet_manager.cc:1403] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:05:59.178644 16661 raft_consensus.cc:359] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.179419 16661 raft_consensus.cc:385] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.179772 16661 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.183930 16659 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.184427 16659 ts_tablet_manager.cc:1403] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.002s
I20260709 13:05:59.187234 16661 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.191064 16661 ts_tablet_manager.cc:1434] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:05:59.192193 16661 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.193481 16691 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.193763 16659 raft_consensus.cc:359] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.194492 16659 raft_consensus.cc:385] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.194795 16659 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.192669 16365 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.197822 16659 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.199046 16662 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.199676 16662 ts_tablet_manager.cc:1403] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.014s
I20260709 13:05:59.199867 16661 tablet_bootstrap.cc:654] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.201375 16659 ts_tablet_manager.cc:1434] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:05:59.199582 16365 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.202730 16662 raft_consensus.cc:359] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.203569 16662 raft_consensus.cc:385] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.203864 16662 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.204520 16662 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.206586 16662 ts_tablet_manager.cc:1434] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:59.209474 16659 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.212455 16661 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.212993 16661 ts_tablet_manager.cc:1403] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 13:05:59.216800 16675 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.217336 16675 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.218221 16662 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.219347 16675 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:59.221009 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.221648 16545 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:59.223316 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:05:59.224167 16675 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.224541 16675 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.224988 16675 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.229772 16662 tablet_bootstrap.cc:654] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.219511 16661 raft_consensus.cc:359] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.231129 16661 raft_consensus.cc:385] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.231426 16661 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.232142 16661 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.233516 16740 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.234364 16661 ts_tablet_manager.cc:1434] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:05:59.244796 16661 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.234201 16740 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.235369 16930 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.247957 16930 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.250087 16930 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:59.237659 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:59.252065 16661 tablet_bootstrap.cc:654] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:59.252372 16585 leader_election.cc:343] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.254556 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.243449 16675 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.255241 16545 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:59.256161 16740 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.257160 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.258594 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:59.260625 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.261435 16618 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
W20260709 13:05:59.262210 16585 leader_election.cc:343] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:59.282784 16582 leader_election.cc:343] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.284487 16582 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:59.286008 16659 tablet_bootstrap.cc:654] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.288923 16433 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:59.296249 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:59.293208 16930 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.296387 16738 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.301533 16675 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:59.298007 16738 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.304906 16662 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.305361 16662 ts_tablet_manager.cc:1403] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.026s
I20260709 13:05:59.303613 16738 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.304080 16933 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.306095 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:59.307964 16542 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.306730 16585 leader_election.cc:343] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.314707 16662 raft_consensus.cc:359] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.315263 16662 raft_consensus.cc:385] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.315495 16662 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.316061 16662 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.307579 16933 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.322068 16933 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.323974 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.322636 16661 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.324815 16661 ts_tablet_manager.cc:1403] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.024s
I20260709 13:05:59.327570 16662 ts_tablet_manager.cc:1434] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 13:05:59.327451 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:59.328414 16511 leader_election.cc:343] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.328676 16662 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
W20260709 13:05:59.329362 16511 leader_election.cc:343] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.329795 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:59.329592 16661 raft_consensus.cc:359] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.330407 16661 raft_consensus.cc:385] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.330752 16661 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.331583 16661 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.331838 16933 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.316890 16738 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.336613 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:59.337129 16545 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.338177 16661 ts_tablet_manager.cc:1434] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:59.339362 16661 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.333287 16542 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:59.343112 16545 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:59.345477 16662 tablet_bootstrap.cc:654] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.345294 16433 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:59.344070 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:59.346657 16740 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.346982 16744 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.347097 16740 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:59.348671 16740 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.350158 16744 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:05:59.351013 16744 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.353680 16738 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.354844 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:59.355455 16616 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.369683 16616 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:59.370946 16659 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.371475 16659 ts_tablet_manager.cc:1403] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.002s
I20260709 13:05:59.381686 16659 raft_consensus.cc:359] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.381564 16365 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:59.382486 16661 tablet_bootstrap.cc:654] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.382498 16659 raft_consensus.cc:385] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.382969 16659 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.383810 16659 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.386065 16659 ts_tablet_manager.cc:1434] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:05:59.387619 16659 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.388646 16662 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.389266 16662 ts_tablet_manager.cc:1403] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.001s
I20260709 13:05:59.392050 16662 raft_consensus.cc:359] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.392755 16662 raft_consensus.cc:385] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.393060 16662 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.393805 16662 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.396284 16662 ts_tablet_manager.cc:1434] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:59.397286 16662 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.400985 16659 tablet_bootstrap.cc:654] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.404496 16661 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.405129 16661 ts_tablet_manager.cc:1403] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.012s
I20260709 13:05:59.408164 16661 raft_consensus.cc:359] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.409094 16661 raft_consensus.cc:385] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.409467 16661 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.412278 16691 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.416066 16662 tablet_bootstrap.cc:654] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.416301 16933 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.400651 16368 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.410241 16661 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.427276 16661 ts_tablet_manager.cc:1434] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:05:59.431574 16661 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.452292 16659 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.452818 16659 ts_tablet_manager.cc:1403] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.022s
I20260709 13:05:59.456280 16662 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.457032 16662 ts_tablet_manager.cc:1403] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.010s
I20260709 13:05:59.465166 16659 raft_consensus.cc:359] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.469707 16661 tablet_bootstrap.cc:654] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.470016 16659 raft_consensus.cc:385] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.471166 16740 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.471355 16659 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.471639 16740 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.472144 16659 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.474278 16659 ts_tablet_manager.cc:1434] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:05:59.475255 16659 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.478643 16933 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.479090 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.481429 16659 tablet_bootstrap.cc:654] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:59.484598 16433 leader_election.cc:343] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.485831 16738 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.487712 16740 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.484301 16662 raft_consensus.cc:359] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.489552 16662 raft_consensus.cc:385] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.489802 16662 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.490432 16662 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.491930 16662 ts_tablet_manager.cc:1434] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.001s
I20260709 13:05:59.499527 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.500382 16619 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:05:59.509449 16662 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.509159 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:59.510701 16740 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.511226 16740 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.511646 16740 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.518714 16662 tablet_bootstrap.cc:654] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.541788 16738 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.542590 16738 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.553392 16738 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.555140 16922 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:59.555523 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.555176 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:59.557487 16436 leader_election.cc:343] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:59.558267 16433 leader_election.cc:343] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.558920 16433 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:59.560525 16738 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.566785 16740 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.594539 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:05:59.596722 16433 leader_election.cc:343] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.609927 16659 tablet_bootstrap.cc:492] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.610589 16659 ts_tablet_manager.cc:1403] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.136s	user 0.065s	sys 0.064s
I20260709 13:05:59.610762 16661 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.611406 16661 ts_tablet_manager.cc:1403] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.180s	user 0.025s	sys 0.032s
I20260709 13:05:59.613063 16744 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.613596 16744 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.613940 16659 raft_consensus.cc:359] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.614825 16659 raft_consensus.cc:385] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.615136 16659 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.615854 16659 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.616587 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:59.617266 16468 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:59.617125 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.615855 16744 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:05:59.619138 16582 leader_election.cc:343] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.618162 16659 ts_tablet_manager.cc:1434] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:59.624224 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:59.624228 16661 raft_consensus.cc:359] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.625185 16616 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.625422 16740 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.625435 16661 raft_consensus.cc:385] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.626098 16661 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.626891 16661 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.630600 16662 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.631119 16662 ts_tablet_manager.cc:1403] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.004s
I20260709 13:05:59.633862 16662 raft_consensus.cc:359] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.634604 16662 raft_consensus.cc:385] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.634892 16662 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.635536 16661 ts_tablet_manager.cc:1434] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:05:59.636699 16661 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:05:59.636256 16662 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.638233 16668 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.638695 16668 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.639222 16933 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.640523 16668 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.625224 16585 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:59.642246 16662 ts_tablet_manager.cc:1434] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:05:59.643335 16662 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.644276 16661 tablet_bootstrap.cc:654] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.645673 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.646981 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:59.648880 16511 leader_election.cc:343] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.649451 16662 tablet_bootstrap.cc:654] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.649768 16744 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.650223 16744 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.650647 16744 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.657225 16511 leader_election.cc:343] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.657845 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:59.658813 16922 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.661152 16659 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.663957 16662 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.664484 16662 ts_tablet_manager.cc:1403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:05:59.667832 16659 tablet_bootstrap.cc:654] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.671706 16662 raft_consensus.cc:359] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.672534 16662 raft_consensus.cc:385] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.672835 16662 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.674093 16616 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:05:59.673664 16662 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.675376 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:59.676985 16662 ts_tablet_manager.cc:1434] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:05:59.677973 16662 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.678385 16691 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.679047 16691 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:05:59.686034 16922 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.686699 16922 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.680102 16691 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.691345 16930 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.691845 16930 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.695461 16930 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:59.696615 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:59.698020 16585 leader_election.cc:343] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.698593 16659 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.699146 16659 ts_tablet_manager.cc:1403] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.012s
I20260709 13:05:59.702937 16659 raft_consensus.cc:359] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.703622 16659 raft_consensus.cc:385] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.703877 16659 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.704593 16659 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.706815 16659 ts_tablet_manager.cc:1434] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:59.707790 16659 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.710148 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:05:59.710448 16922 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.713506 16659 tablet_bootstrap.cc:654] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.715409 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:59.716032 16468 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:59.717326 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:59.718798 16933 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.720487 16662 tablet_bootstrap.cc:654] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.719326 16933 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.721653 16933 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:59.734551 16582 leader_election.cc:343] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.735153 16582 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:05:59.736151 16675 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.756656 16668 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.757186 16668 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.758925 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.759553 16619 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:05:59.758947 16668 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.757200 16744 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.761796 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:05:59.762485 16619 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:05:59.763336 16744 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:05:59.763530 16930 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.765909 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:05:59.766916 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:05:59.769137 16582 leader_election.cc:343] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.770018 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:59.770882 16467 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.773869 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:05:59.777170 16895 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.791291 16933 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.788700 16662 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:05:59.794200 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:05:59.794802 16468 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.794860 16662 ts_tablet_manager.cc:1403] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.045s
I20260709 13:05:59.802394 16659 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:05:59.802901 16659 ts_tablet_manager.cc:1403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.095s	user 0.029s	sys 0.016s
I20260709 13:05:59.812089 16895 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:59.827152 16468 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:59.839316 16662 raft_consensus.cc:359] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.840029 16662 raft_consensus.cc:385] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.840313 16662 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.832659 16659 raft_consensus.cc:359] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.844986 16659 raft_consensus.cc:385] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:59.845383 16659 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:05:59.846176 16659 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.850360 16662 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.851523 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:05:59.851799 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:05:59.852510 16619 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.863369 16659 ts_tablet_manager.cc:1434] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:05:59.834093 16933 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:05:59.871497 16927 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.886026 16467 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:05:59.890161 16927 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.863134 16924 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.891027 16619 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:05:59.898186 16661 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:05:59.898885 16661 ts_tablet_manager.cc:1403] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.262s	user 0.071s	sys 0.061s
I20260709 13:05:59.900261 16662 ts_tablet_manager.cc:1434] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.014s
I20260709 13:05:59.903244 16662 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:05:59.897473 16924 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:05:59.909345 16924 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.910213 16927 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:05:59.913149 16978 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:05:59.917651 16740 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:59.922525 16659 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:05:59.924118 16585 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:59.926821 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:05:59.927497 16465 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:05:59.928082 16744 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:59.946939 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:05:59.950820 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:59.959038 16988 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.960094 16659 tablet_bootstrap.cc:654] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.950937 16744 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:05:59.962874 16582 leader_election.cc:343] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:59.959812 16988 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.977684 16662 tablet_bootstrap.cc:654] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:59.979285 16738 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.976889 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:05:59.988832 16930 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:59.989316 16930 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.989714 16930 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:59.990202 16744 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.979887 16738 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:05:59.995904 16738 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:00.001057 16585 consensus_peers.cc:597] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.003847 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.004963 16988 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.006516 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:00.016297 16433 leader_election.cc:343] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:00.023495 16433 leader_election.cc:343] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.015939 16661 raft_consensus.cc:359] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.030192 16661 raft_consensus.cc:385] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.030601 16661 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.031565 16661 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.035859 16930 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.036979 16662 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.037477 16662 ts_tablet_manager.cc:1403] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.000s
I20260709 13:06:00.039045 16661 ts_tablet_manager.cc:1434] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.001s
I20260709 13:06:00.041515 16930 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:00.043205 16662 raft_consensus.cc:359] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.043947 16662 raft_consensus.cc:385] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.044243 16662 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.046164 16662 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.047510 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:00.049319 16582 leader_election.cc:343] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.050661 16662 ts_tablet_manager.cc:1434] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:06:00.053980 16662 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.054126 16368 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.060719 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:00.061444 16464 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.067535 16659 tablet_bootstrap.cc:492] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.067739 16661 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.068066 16659 ts_tablet_manager.cc:1403] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.014s
W20260709 13:06:00.066974 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 83385.9us
I20260709 13:06:00.074715 16464 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:00.076121 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.077816 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.078118 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.078812 16615 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.084306 16659 raft_consensus.cc:359] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.084949 16659 raft_consensus.cc:385] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.085181 16659 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.085795 16744 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.085939 16659 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.086833 16744 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:00.087937 16662 tablet_bootstrap.cc:654] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.089232 16659 ts_tablet_manager.cc:1434] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:06:00.091042 16367 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.092677 16661 tablet_bootstrap.cc:654] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.088616 16744 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.100526 16659 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
W20260709 13:06:00.110294 16436 leader_election.cc:343] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.111033 16436 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.114858 16738 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.122315 16662 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.122901 16662 ts_tablet_manager.cc:1403] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.017s
I20260709 13:06:00.124383 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.128057 16738 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.128479 16738 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.128388 16991 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:00.129000 16738 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.130450 16662 raft_consensus.cc:359] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.131240 16662 raft_consensus.cc:385] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.132000 16662 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.132817 16662 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.134372 16659 tablet_bootstrap.cc:654] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.135342 16662 ts_tablet_manager.cc:1434] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:00.136476 16662 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.146463 16661 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.146973 16661 ts_tablet_manager.cc:1403] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.002s
I20260709 13:06:00.147182 16691 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.150161 16661 raft_consensus.cc:359] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.151115 16661 raft_consensus.cc:385] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.151472 16661 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.156415 16662 tablet_bootstrap.cc:654] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.156944 16661 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.160678 16661 ts_tablet_manager.cc:1434] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:06:00.164587 16895 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.165819 16659 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.165689 16895 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.166316 16659 ts_tablet_manager.cc:1403] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.002s
I20260709 13:06:00.167963 16895 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.169778 16661 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.169700 16659 raft_consensus.cc:359] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.173013 16659 raft_consensus.cc:385] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.173411 16659 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.172619 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.178728 16464 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:00.181814 16991 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.182382 16991 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.184894 16365 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.187837 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.190300 16661 tablet_bootstrap.cc:654] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:00.191380 16433 leader_election.cc:343] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.188427 16991 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.141911 16738 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.174821 16659 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.194080 16930 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.194921 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.194756 16930 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.195537 16659 ts_tablet_manager.cc:1434] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 13:06:00.169874 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.197096 16659 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
W20260709 13:06:00.197928 16433 leader_election.cc:343] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.205106 16930 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:00.206511 16659 tablet_bootstrap.cc:654] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.206502 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:00.209097 16585 leader_election.cc:343] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.213112 16511 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.214084 16895 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.215925 16661 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.216388 16661 ts_tablet_manager.cc:1403] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.002s
I20260709 13:06:00.229555 16738 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.230455 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:00.251210 16582 leader_election.cc:343] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.251798 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:00.254391 16930 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.259773 16659 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.260196 16659 ts_tablet_manager.cc:1403] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.018s
I20260709 13:06:00.261036 16661 raft_consensus.cc:359] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.261669 16661 raft_consensus.cc:385] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.261840 16661 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.262297 16661 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.282339 16661 ts_tablet_manager.cc:1434] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:06:00.302517 16895 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.304180 16738 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.306612 16661 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.304622 16738 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.314126 16738 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.317117 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.318235 16659 raft_consensus.cc:359] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.320281 16541 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.320863 16659 raft_consensus.cc:385] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.321278 16659 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.322572 16659 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.325062 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:00.327607 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.328207 16613 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.328979 16738 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.329999 16738 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.330300 16738 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.334100 16662 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.334538 16662 ts_tablet_manager.cc:1403] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.198s	user 0.055s	sys 0.058s
I20260709 13:06:00.335089 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.335634 16618 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.342465 16618 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.343684 16659 ts_tablet_manager.cc:1434] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.000s
I20260709 13:06:00.344645 16659 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.344329 16738 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.346359 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.346966 16617 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.348378 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.348899 16545 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.351738 16661 tablet_bootstrap.cc:654] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.351869 16662 raft_consensus.cc:359] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.352576 16662 raft_consensus.cc:385] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.352871 16662 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.353605 16662 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.355724 16545 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.357223 16436 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.358465 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.359124 16988 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.360033 16662 ts_tablet_manager.cc:1434] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:06:00.360831 16988 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.361191 16988 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.361297 16662 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.361557 16988 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.363701 16659 tablet_bootstrap.cc:654] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.365378 16740 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.370782 16738 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.371888 16740 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:00.372754 16740 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.374421 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:00.380843 16368 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.389348 16987 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.391259 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.390027 16933 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.393944 16618 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.397014 16933 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.398669 16659 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.399052 16933 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.385551 16895 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:06:00.400327 16987 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:00.399127 16659 ts_tablet_manager.cc:1403] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.016s
I20260709 13:06:00.403560 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.404211 16464 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:06:00.401202 16987 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.404541 16988 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.406263 16924 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.407796 16469 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.408059 16924 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.410621 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.411908 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:00.413414 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.413908 16991 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.414170 16468 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:06:00.415630 16511 leader_election.cc:343] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.416550 16662 tablet_bootstrap.cc:654] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.414938 16924 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.421499 16895 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.414361 16991 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.422649 16895 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.423501 16895 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.424675 16988 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.425122 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.426497 16618 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.426949 16659 raft_consensus.cc:359] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.427889 16659 raft_consensus.cc:385] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.428206 16659 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.428746 16991 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.431018 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.431097 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.431659 16618 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:00.433399 16433 leader_election.cc:343] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.434455 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.434222 16659 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.435537 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:00.436755 16436 leader_election.cc:343] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.437588 16924 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.446931 16659 ts_tablet_manager.cc:1434] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:06:00.448897 16661 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.453024 16618 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.457516 16661 ts_tablet_manager.cc:1403] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.028s
I20260709 13:06:00.458020 16436 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.461287 16987 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.462033 16661 raft_consensus.cc:359] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.464141 16661 raft_consensus.cc:385] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.464511 16661 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.467538 16662 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.467960 16662 ts_tablet_manager.cc:1403] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.012s
I20260709 13:06:00.453820 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.463631 16987 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:00.470355 16895 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.470413 16662 raft_consensus.cc:359] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.471230 16987 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.475148 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.475303 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:00.475562 16922 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.476054 16468 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.479992 16895 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:00.481357 16511 leader_election.cc:343] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.465272 16661 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.484726 16468 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:00.486207 16541 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.493474 16927 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.495235 16933 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.495682 16933 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.498153 16933 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.486800 16661 ts_tablet_manager.cc:1434] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:06:00.487540 16659 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.500962 16433 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.501094 16661 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.500986 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.501885 16467 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:06:00.506325 17009 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.506673 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.506709 17009 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.508550 17009 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.512042 16659 tablet_bootstrap.cc:654] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.493219 16924 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.517493 16661 tablet_bootstrap.cc:654] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:00.522583 16511 leader_election.cc:343] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.471246 16662 raft_consensus.cc:385] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.523732 16662 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.524782 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.524873 16744 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.525830 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.525043 16662 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.527632 16933 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.527979 16933 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.528311 16933 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.529609 16744 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.529666 16662 ts_tablet_manager.cc:1434] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:06:00.532943 16922 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.517021 17009 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.533437 16922 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:00.537969 16922 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.537856 16367 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.538843 17009 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.539949 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.541329 16744 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.541822 16933 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:00.541365 16436 leader_election.cc:343] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.541822 16744 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.531992 16662 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.545897 16744 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:00.548790 16661 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.549283 16661 ts_tablet_manager.cc:1403] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.007s
I20260709 13:06:00.548463 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.551529 16659 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.553220 16659 ts_tablet_manager.cc:1403] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.004s
W20260709 13:06:00.553637 16585 leader_election.cc:343] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.557721 16933 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.559087 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:00.559842 16469 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:00.560271 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.560971 16545 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:00.559734 16659 raft_consensus.cc:359] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.561830 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.567588 16659 raft_consensus.cc:385] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.568061 16659 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.568976 16659 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:00.569350 16511 leader_election.cc:343] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.570017 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.562433 16661 raft_consensus.cc:359] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.571329 16661 raft_consensus.cc:385] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.571408 16895 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.571631 16661 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.572458 16661 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.574162 16662 tablet_bootstrap.cc:654] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.576818 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.577435 16541 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:06:00.578258 17009 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.578714 17009 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.580883 16433 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.581727 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.581866 16740 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.582517 17009 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.574682 16661 ts_tablet_manager.cc:1434] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:06:00.582639 16616 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.583827 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:00.584909 16661 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.585697 17007 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.585558 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:00.586143 17007 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.586491 17007 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.586764 16740 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.587100 16740 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.576279 16659 ts_tablet_manager.cc:1434] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:06:00.587416 16740 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.595227 16740 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.594219 17007 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.601225 17007 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:00.601922 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:00.603550 16585 leader_election.cc:343] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.604341 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:00.604918 16616 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.612332 16927 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.617597 16616 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.618621 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:00.625798 16691 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.626271 16691 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:00.627031 16691 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.629106 16659 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.632480 16740 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.635941 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.636634 16545 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.658972 16368 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.677350 16545 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:00.687301 16659 tablet_bootstrap.cc:654] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.688892 16661 tablet_bootstrap.cc:654] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.689868 16662 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.690279 16662 ts_tablet_manager.cc:1403] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.159s	user 0.029s	sys 0.026s
I20260709 13:06:00.690961 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.699904 16662 raft_consensus.cc:359] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.701583 16662 raft_consensus.cc:385] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.701864 16662 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.703299 16662 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.707015 16662 ts_tablet_manager.cc:1434] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
W20260709 13:06:00.707072 16433 leader_election.cc:343] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.708146 16662 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.711479 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:00.702893 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:00.720820 16433 leader_election.cc:343] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.731253 17030 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.731842 17030 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:00.733397 17009 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.732700 17030 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.737401 17009 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.739353 17009 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.746886 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:00.747608 16613 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:00.753012 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.749373 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:00.760310 16433 leader_election.cc:343] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.761782 16988 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:00.761515 16930 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.762652 16988 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.763022 16988 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.762766 16930 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.772811 16659 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.773330 16659 ts_tablet_manager.cc:1403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.016s
W20260709 13:06:00.774214 16433 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.776705 16930 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:00.777026 16659 raft_consensus.cc:359] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.781401 16659 raft_consensus.cc:385] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.781828 16659 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.783355 16661 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.779271 16367 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.784003 16661 ts_tablet_manager.cc:1403] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.199s	user 0.025s	sys 0.016s
I20260709 13:06:00.782774 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:00.776301 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:00.784840 16659 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.802147 16469 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:00.802879 16661 raft_consensus.cc:359] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.803763 16661 raft_consensus.cc:385] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.805063 16661 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.805478 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:00.805958 16661 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.807219 17030 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.806663 16662 tablet_bootstrap.cc:654] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.808496 16661 ts_tablet_manager.cc:1434] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:06:00.800976 16367 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.812005 16661 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.813592 16659 ts_tablet_manager.cc:1434] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:06:00.814611 16659 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.814723 16367 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.821939 16661 tablet_bootstrap.cc:654] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.822914 17030 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.791754 16988 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.827844 16988 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.828629 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:00.829413 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:00.829928 16433 leader_election.cc:343] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.830122 16614 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:00.829439 16659 tablet_bootstrap.cc:654] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.837761 16661 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.838505 16661 ts_tablet_manager.cc:1403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 13:06:00.839445 16659 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.840059 16659 ts_tablet_manager.cc:1403] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 13:06:00.842188 16614 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:00.842660 16659 raft_consensus.cc:359] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.844403 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:00.843364 16659 raft_consensus.cc:385] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.844983 16659 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.845468 16988 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:00.845615 16659 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.845991 16988 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:00.843317 16661 raft_consensus.cc:359] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.847004 16661 raft_consensus.cc:385] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.851572 16659 ts_tablet_manager.cc:1434] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:00.846966 16988 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.868239 16659 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.852910 16662 tablet_bootstrap.cc:492] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.869089 16662 ts_tablet_manager.cc:1403] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.161s	user 0.017s	sys 0.001s
I20260709 13:06:00.871281 16662 raft_consensus.cc:359] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.871862 16662 raft_consensus.cc:385] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.872078 16662 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.863729 16661 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.873049 16661 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.874166 16659 tablet_bootstrap.cc:654] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.879200 16661 ts_tablet_manager.cc:1434] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:06:00.880167 16661 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.849050 16365 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.887158 16662 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.902275 16662 ts_tablet_manager.cc:1434] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:06:00.903262 16662 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.909281 16662 tablet_bootstrap.cc:654] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.911788 16661 tablet_bootstrap.cc:654] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.911726 16367 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:00.939258 16661 tablet_bootstrap.cc:492] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:00.944380 16661 ts_tablet_manager.cc:1403] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.000s
I20260709 13:06:00.946847 16661 raft_consensus.cc:359] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.947525 16661 raft_consensus.cc:385] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.947784 16661 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.949736 16662 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:00.950271 16662 ts_tablet_manager.cc:1403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:06:00.950927 16659 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:00.951359 16659 ts_tablet_manager.cc:1403] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.083s	user 0.028s	sys 0.044s
I20260709 13:06:00.952479 16662 raft_consensus.cc:359] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.953087 16662 raft_consensus.cc:385] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.953447 16662 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.953115 16661 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.954257 16659 raft_consensus.cc:359] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.954169 16662 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.954931 16659 raft_consensus.cc:385] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:00.955508 16659 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:00.956378 16661 ts_tablet_manager.cc:1434] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:06:00.956203 16659 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.958273 16659 ts_tablet_manager.cc:1434] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:06:00.961284 16659 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Bootstrap starting.
I20260709 13:06:00.962145 16924 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.962612 16924 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:00.964578 16924 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:00.965216 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:00.967232 16511 leader_election.cc:343] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.967316 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:00.968564 16511 leader_election.cc:343] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:00.968677 16661 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:00.968962 16511 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:00.970679 16922 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:00.975162 16659 tablet_bootstrap.cc:654] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.975175 16661 tablet_bootstrap.cc:654] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:00.985826 16662 ts_tablet_manager.cc:1434] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:00.986852 16662 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:00.987216 16991 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:00.996564 17009 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.003049 16661 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:01.004792 16662 tablet_bootstrap.cc:654] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.003543 16661 ts_tablet_manager.cc:1403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.008s
I20260709 13:06:01.010385 17009 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.012617 16930 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.013374 16930 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.017051 16930 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:01.018435 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:01.019248 16469 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:01.021219 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:01.021981 16541 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 1: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:01.023535 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:01.026275 16928 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.040966 17027 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.056572 16540 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.080835 16924 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.081712 16928 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.010547 16661 raft_consensus.cc:359] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.086261 16661 raft_consensus.cc:385] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.086767 16661 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.086876 17009 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.087426 17009 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:01.094935 16416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:01.097077 16659 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: No bootstrap required, opened a new log
I20260709 13:06:01.101178 17009 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.102833 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:01.104156 16618 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:01.104882 16924 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.103511 16659 ts_tablet_manager.cc:1403] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent bootstrapping tablet: real 0.142s	user 0.029s	sys 0.040s
I20260709 13:06:01.105717 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:01.107456 16691 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.107810 16691 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.108361 16691 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.107807 16659 raft_consensus.cc:359] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.110356 16659 raft_consensus.cc:385] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.112108 16659 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.113422 16987 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.113035 16659 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.107168 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:01.117005 16542 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 0.
I20260709 13:06:01.117437 16659 ts_tablet_manager.cc:1434] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:01.119592 16691 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.125563 16662 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:01.126056 16662 ts_tablet_manager.cc:1403] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.139s	user 0.029s	sys 0.031s
I20260709 13:06:01.128573 16662 raft_consensus.cc:359] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.129457 16662 raft_consensus.cc:385] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.129732 16662 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.131418 16662 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.087481 16661 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.136404 16662 ts_tablet_manager.cc:1434] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:06:01.137418 16662 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:01.137414 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:01.138134 16542 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.140638 16661 ts_tablet_manager.cc:1434] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.133s	user 0.005s	sys 0.001s
I20260709 13:06:01.141376 16691 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.142400 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:01.143812 16618 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.144497 16661 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:01.151532 16662 tablet_bootstrap.cc:654] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.152539 16618 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:01.153551 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:01.154245 16987 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.154701 16987 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:01.155546 16987 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.157742 16661 tablet_bootstrap.cc:654] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.164142 16542 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:01.176370 16662 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:01.177302 16662 ts_tablet_manager.cc:1403] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 13:06:01.180008 16662 raft_consensus.cc:359] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.180672 16662 raft_consensus.cc:385] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.180963 16662 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.181552 16662 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.183727 16662 ts_tablet_manager.cc:1434] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:06:01.184629 16662 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Bootstrap starting.
I20260709 13:06:01.185603 16661 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:01.187881 16661 ts_tablet_manager.cc:1403] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.019s
I20260709 13:06:01.190402 16469 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.191203 16661 raft_consensus.cc:359] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.191912 16661 raft_consensus.cc:385] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.191974 16662 tablet_bootstrap.cc:654] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.193759 16661 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.199602 16661 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.202762 16661 ts_tablet_manager.cc:1434] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:06:01.203729 16661 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:01.204588 16987 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.205071 16987 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.205788 16691 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.212203 16987 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.213881 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:01.213754 16928 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.215214 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:01.215817 16542 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:01.217690 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:01.220391 17009 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.222047 17009 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:01.222436 17009 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.232597 16661 tablet_bootstrap.cc:654] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.241302 16675 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.250970 17009 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.257114 16464 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:01.261096 16675 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.256063 16366 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.262388 17007 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:01.263051 17007 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:01.264173 17007 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.265861 17007 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.286989 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:01.288481 16540 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.288681 16675 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.289755 16675 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.293689 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:01.294569 16467 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:06:01.296022 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:01.296945 16928 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.297305 16928 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.297680 16928 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.305785 16541 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.305650 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:01.307053 16582 leader_election.cc:343] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.313876 16691 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.305676 16675 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:01.322589 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:01.332003 16988 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.348827 16991 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:01.353636 17056 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:01.355640 16613 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:01.357048 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:01.358065 16987 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:01.359019 16987 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:01.366323 16987 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.364048 17009 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.368074 16928 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.371436 16541 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.372961 16662 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: No bootstrap required, opened a new log
I20260709 13:06:01.378203 16662 ts_tablet_manager.cc:1403] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Time spent bootstrapping tablet: real 0.194s	user 0.037s	sys 0.074s
I20260709 13:06:01.380270 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:01.382943 16464 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.385483 16662 raft_consensus.cc:359] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.386209 16662 raft_consensus.cc:385] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.386508 16662 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.387117 16662 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.388479 16928 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:01.381158 17007 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.382463 16661 tablet_bootstrap.cc:492] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:01.393652 16661 ts_tablet_manager.cc:1403] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.190s	user 0.027s	sys 0.042s
I20260709 13:06:01.394819 16662 ts_tablet_manager.cc:1434] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:01.395236 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:01.396759 16582 leader_election.cc:343] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:01.397015 16661 raft_consensus.cc:359] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.397819 16661 raft_consensus.cc:385] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.398113 16661 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.398907 16661 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.393774 17007 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.406234 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:01.406836 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:06:01.408098 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:01.408444 17007 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:01.409058 16675 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.409489 16675 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.409826 16675 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.410586 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:01.411235 16538 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 0.
I20260709 13:06:01.412972 16365 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.414850 16675 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.401238 16661 ts_tablet_manager.cc:1434] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:06:01.418963 16661 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Bootstrap starting.
I20260709 13:06:01.403249 16464 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:01.424206 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:01.426414 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:01.427106 16540 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.426213 17007 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.428516 16661 tablet_bootstrap.cc:654] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:01.428640 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:01.429368 16464 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.433579 16661 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: No bootstrap required, opened a new log
I20260709 13:06:01.434705 16661 ts_tablet_manager.cc:1403] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:06:01.436033 16464 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:01.437302 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:01.438104 16661 raft_consensus.cc:359] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.438910 16661 raft_consensus.cc:385] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:01.439167 16930 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.439282 16661 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Initialized, Role: FOLLOWER
I20260709 13:06:01.439769 16930 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:01.440269 16661 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.440681 16930 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.443053 16661 ts_tablet_manager.cc:1434] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:01.446683 16675 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:01.449668 16540 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:01.443890 17007 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:01.463759 17007 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.475167 16365 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.491658 16365 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.734858 16987 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.746371 16988 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.808883 16922 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.809333 16922 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.810843 16922 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.811605 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:01.811865 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:01.812152 16469 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:06:01.812477 16617 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 0.
I20260709 13:06:01.813102 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:01.813773 16922 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:01.814064 16922 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.814370 16922 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.816120 16924 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.816622 16924 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.818776 16924 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.819319 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:01.819880 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:01.819689 16922 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.820111 16469 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 1: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:01.821352 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:01.821637 16922 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:01.821974 16924 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.823076 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:01.823351 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:01.823563 16469 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.823977 16617 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:01.828177 16469 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:01.829560 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:01.830374 16922 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:01.830927 16922 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:01.831051 16617 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:01.831840 16922 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:01.829954 16924 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:01.840482 17007 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.842970 16366 catalog_manager.cc:5697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.857887 16675 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.858208 16930 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:01.871994 16675 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:01.882042 16617 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.883261 16988 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:01.892433 16540 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.899468 16540 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:01.900864 17009 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:02.074247 16924 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.074755 16924 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:02.076562 16924 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:02.077122 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:02.077301 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:02.077735 16467 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:02.078012 16617 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:02.078838 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:02.079572 16924 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:02.080176 16924 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.080475 16924 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.084964 16924 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:02.086949 16924 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:02.087422 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:02.087958 16467 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.088003 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:02.088682 16617 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.093575 16467 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:02.093825 16617 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:02.094828 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:02.095522 16924 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:02.096097 16924 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:02.096907 16924 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:02.107054 16366 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 0 to 2, leader changed from <none> to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.349272 16924 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.359412 17076 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:02.543958 16617 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:02.545147 16922 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:02.558503 16467 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:06:02.559675 17076 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:03.105754 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:03.134876 17081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:03.135174 17082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:03.135558 17084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:03.137669 15321 server_base.cc:1061] running on GCE node
I20260709 13:06:03.139276 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:03.139626 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:03.139947 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602363139928 us; error 0 us; skew 500 ppm
I20260709 13:06:03.140707 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:03.144145 15321 webserver.cc:533] Webserver started at http://127.14.246.68:43161/ using document root <none> and password file <none>
I20260709 13:06:03.144757 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:03.145059 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:03.145391 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:03.146569 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-3-root/instance:
uuid: "98881185daee4f13b69385e36026216c"
format_stamp: "Formatted at 2026-07-09 13:06:03 on dist-test-slave-bhv2"
I20260709 13:06:03.151561 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:06:03.155189 17089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:03.156090 15321 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:06:03.156388 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
uuid: "98881185daee4f13b69385e36026216c"
format_stamp: "Formatted at 2026-07-09 13:06:03 on dist-test-slave-bhv2"
I20260709 13:06:03.156646 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:03.175839 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:03.177263 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:03.179035 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:03.181676 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:03.181893 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:03.182147 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:03.182334 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:03.251310 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.68:34961
I20260709 13:06:03.251421 17151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.68:34961 every 8 connection(s)
I20260709 13:06:03.258271 15321 auto_leader_rebalancer-test.cc:384] add a tserver: 98881185daee4f13b69385e36026216c
I20260709 13:06:03.272233 17152 heartbeater.cc:344] Connected to a master server at 127.14.246.126:40851
I20260709 13:06:03.272671 17152 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:03.273509 17152 heartbeater.cc:507] Master 127.14.246.126:40851 requested a full tablet report, sending...
I20260709 13:06:03.275612 16366 ts_manager.cc:194] Registered new tserver with Master: 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:03.277350 16366 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32886
I20260709 13:06:04.280097 17152 heartbeater.cc:499] Master 127.14.246.126:40851 was elected leader, sending a full tablet report...
I20260709 13:06:04.293404 16541 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.304523 16613 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.307283 16467 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.311203 16924 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.313620 17166 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:04.321357 16509 consensus_peers.cc:597] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bf604205a574ee6a5fba699476010ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.322866 16801 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.324604 16467 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.326994 16613 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.351548 16366 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.355474 16469 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.383384 16544 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.383795 16617 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.385217 17157 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.386461 17156 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.397917 17157 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.404757 16544 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.408706 16617 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:04.423756 16434 consensus_peers.cc:597] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2cd1155e69c4429b642e17940dde1e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.427796 16469 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.438452 16544 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.439252 16618 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.440657 17156 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:04.442725 17181 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:04.444110 16434 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8806363158d645279801d4633a1c7d74. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.445888 16367 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.464650 17181 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.477553 16541 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.490022 16544 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.492586 16365 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:04.498476 16509 consensus_peers.cc:597] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 486137446c7c411e8a8ec3d1dd300579. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.499004 16613 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.500103 16467 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:04.500676 17171 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.504438 17171 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.505731 16617 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:04.522243 16491 debug-util.cc:398] Leaking SignalData structure 0x7b080005e880 after lost signal to thread 15324
W20260709 13:06:04.523249 16491 debug-util.cc:398] Leaking SignalData structure 0x7b080016ba60 after lost signal to thread 16402
W20260709 13:06:04.526969 16491 debug-util.cc:398] Leaking SignalData structure 0x7b080025bd40 after lost signal to thread 16643
I20260709 13:06:04.526544 17166 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.528086 16469 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.536511 16617 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:04.558902 16367 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.812042 17191 ts_tablet_manager.cc:933] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:04.815356 17191 tablet_copy_client.cc:323] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:04.847409 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet c2cd1155e69c4429b642e17940dde1e6 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:04.848058 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet c2cd1155e69c4429b642e17940dde1e6 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-c2cd1155e69c4429b642e17940dde1e6
I20260709 13:06:04.858777 16480 tablet_copy_source_session.cc:215] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:04.863116 17191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2cd1155e69c4429b642e17940dde1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:04.883549 17191 tablet_copy_client.cc:806] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:04.884178 17191 tablet_copy_client.cc:670] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:04.898524 17191 tablet_copy_client.cc:538] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:04.910305 17191 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:04.945618 17191 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:04.946666 17191 tablet_bootstrap.cc:492] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:04.950428 17191 ts_tablet_manager.cc:1403] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.040s	user 0.030s	sys 0.000s
I20260709 13:06:04.953464 17191 raft_consensus.cc:359] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.954412 17191 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:04.955137 17191 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:04.978492 17191 ts_tablet_manager.cc:1434] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 13:06:04.981935 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-c2cd1155e69c4429b642e17940dde1e6 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:04.982517 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-c2cd1155e69c4429b642e17940dde1e6 on tablet c2cd1155e69c4429b642e17940dde1e6 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:04.988547 17194 ts_tablet_manager.cc:933] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:04.992025 17194 tablet_copy_client.cc:323] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:05.016688 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 9bf604205a574ee6a5fba699476010ee from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:05.017257 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 9bf604205a574ee6a5fba699476010ee from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-9bf604205a574ee6a5fba699476010ee
I20260709 13:06:05.022178 16555 tablet_copy_source_session.cc:215] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:05.024986 17194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf604205a574ee6a5fba699476010ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.027107 17191 ts_tablet_manager.cc:933] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:05.071386 17200 ts_tablet_manager.cc:933] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:05.082398 17200 tablet_copy_client.cc:323] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:05.087031 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 486137446c7c411e8a8ec3d1dd300579 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:05.087610 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 486137446c7c411e8a8ec3d1dd300579 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-486137446c7c411e8a8ec3d1dd300579
I20260709 13:06:05.095330 16555 tablet_copy_source_session.cc:215] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:05.099064 17191 tablet_copy_client.cc:323] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:05.101111 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 486137446c7c411e8a8ec3d1dd300579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.101009 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 8806363158d645279801d4633a1c7d74 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:05.101653 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 8806363158d645279801d4633a1c7d74 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-8806363158d645279801d4633a1c7d74
I20260709 13:06:05.103451 17194 tablet_copy_client.cc:806] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:05.104075 17194 tablet_copy_client.cc:670] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:05.109647 16480 tablet_copy_source_session.cc:215] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:05.108095 17194 tablet_copy_client.cc:538] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:05.113041 17191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8806363158d645279801d4633a1c7d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.116791 17200 tablet_copy_client.cc:806] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:05.117403 17200 tablet_copy_client.cc:670] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:05.123497 17200 tablet_copy_client.cc:538] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:05.125576 17194 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:05.138836 17191 tablet_copy_client.cc:806] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:05.139513 17191 tablet_copy_client.cc:670] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:05.147967 17191 tablet_copy_client.cc:538] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:05.151429 17200 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:05.158650 17191 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:05.183024 17194 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:05.188108 17194 tablet_bootstrap.cc:492] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:05.188930 17194 ts_tablet_manager.cc:1403] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.016s
I20260709 13:06:05.198577 17127 raft_consensus.cc:1217] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:05.209937 17200 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:05.210896 17200 tablet_bootstrap.cc:492] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:05.211555 17200 ts_tablet_manager.cc:1403] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.060s	user 0.020s	sys 0.005s
I20260709 13:06:05.240888 17194 raft_consensus.cc:359] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.241950 17194 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:05.242782 17194 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.242231 17200 raft_consensus.cc:359] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.244346 17200 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:05.245023 17200 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.265796 17200 ts_tablet_manager.cc:1434] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.010s
I20260709 13:06:05.267940 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-486137446c7c411e8a8ec3d1dd300579 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:05.268553 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-486137446c7c411e8a8ec3d1dd300579 on tablet 486137446c7c411e8a8ec3d1dd300579 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:05.275307 17194 ts_tablet_manager.cc:1434] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 13:06:05.280170 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-9bf604205a574ee6a5fba699476010ee received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:05.280592 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-9bf604205a574ee6a5fba699476010ee on tablet 9bf604205a574ee6a5fba699476010ee with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:05.290653 17191 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:05.291744 17191 tablet_bootstrap.cc:492] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:05.292514 17191 ts_tablet_manager.cc:1403] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.134s	user 0.033s	sys 0.017s
I20260709 13:06:05.295171 17191 raft_consensus.cc:359] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.295775 17191 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:05.296294 17191 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:05.298398 17191 ts_tablet_manager.cc:1434] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:06:05.299923 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-8806363158d645279801d4633a1c7d74 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:05.300364 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-8806363158d645279801d4633a1c7d74 on tablet 8806363158d645279801d4633a1c7d74 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:05.343740 17127 raft_consensus.cc:1217] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:05.501458 17127 raft_consensus.cc:1217] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:05.591693 17127 raft_consensus.cc:1217] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:05.638123 17156 raft_consensus.cc:1064] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:05.641255 17156 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:05.655344 17127 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.657153 16613 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.659168 17157 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.662101 17183 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.664183 16542 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.680155 17157 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:05.719907 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58282.4us
I20260709 13:06:05.723286 17208 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.726945 16542 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.731675 17171 raft_consensus.cc:1064] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:05.739142 17171 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:05.764535 17127 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.789269 16615 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.789811 16469 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.795229 16801 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.792484 17126 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:05.804172 17166 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.818140 16615 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.819550 16801 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:05.829092 16365 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:05.854982 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49540.5us
I20260709 13:06:05.893023 17215 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.899987 16467 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.908131 16617 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.925314 16368 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.940084 17126 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.958420 16467 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:05.981779 17126 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:05.983851 17214 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:05.986716 16541 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:05.994068 17156 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:05.996421 16614 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:05.997782 17215 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.001912 17125 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.009217 17127 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.010914 17213 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.015269 16801 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:06.026311 17127 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.026639 16614 raft_consensus.cc:2955] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.030648 16541 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.032584 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bf604205a574ee6a5fba699476010ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:06.033387 17157 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.040490 16541 raft_consensus.cc:2955] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.048738 16366 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.055965 17207 raft_consensus.cc:1064] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:06.061715 17207 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:06.081015 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c2cd1155e69c4429b642e17940dde1e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:06.082204 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bf604205a574ee6a5fba699476010ee with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:06.087225 16368 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.100380 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet c2cd1155e69c4429b642e17940dde1e6 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:06.113970 17125 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.115477 17208 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.118822 16617 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.123037 17183 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.130820 17227 tablet_replica.cc:333] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:06.087218 17226 tablet_replica.cc:333] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:06.136447 16542 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.146039 17226 raft_consensus.cc:2243] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.146838 17226 raft_consensus.cc:2272] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.147655 17227 raft_consensus.cc:2243] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.148358 17227 raft_consensus.cc:2272] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.159451 17213 raft_consensus.cc:1064] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:06.164287 17227 ts_tablet_manager.cc:1916] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:06.164479 17213 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:06.148411 17157 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:06:06.151824 17226 ts_tablet_manager.cc:1916] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:06.168004 17208 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.171005 16616 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.179190 17127 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.182979 17217 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.188522 16368 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.192513 17226 ts_tablet_manager.cc:1929] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:06.193089 17226 log.cc:1199] T 9bf604205a574ee6a5fba699476010ee P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/9bf604205a574ee6a5fba699476010ee
I20260709 13:06:06.194782 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 9bf604205a574ee6a5fba699476010ee (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:06.202004 16616 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.202919 16468 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:06.203555 17213 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.205924 17217 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.206691 17125 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.208081 17227 ts_tablet_manager.cc:1929] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:06.208526 17227 log.cc:1199] T c2cd1155e69c4429b642e17940dde1e6 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/c2cd1155e69c4429b642e17940dde1e6
I20260709 13:06:06.210201 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet c2cd1155e69c4429b642e17940dde1e6 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:06.217262 16540 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:06.232606 17230 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:06.247292 16467 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:06.251051 17217 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.252601 16616 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.271376 16614 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.272935 17214 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.279927 17126 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.281639 16366 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.286688 17208 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.288977 16614 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.300499 17127 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.310992 17183 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.315740 16468 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.316569 17127 raft_consensus.cc:2955] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.329280 16365 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.335062 16541 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:06.340667 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8806363158d645279801d4633a1c7d74 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:06.348088 17126 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.349968 16801 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.357416 16616 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:06.360646 16801 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:06.362509 17215 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.368978 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 8806363158d645279801d4633a1c7d74 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:06.372412 16614 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.364550 17127 raft_consensus.cc:2955] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:06.384567 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 486137446c7c411e8a8ec3d1dd300579 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:06.388995 17235 tablet_replica.cc:333] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:06.390112 17235 raft_consensus.cc:2243] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.390805 17235 raft_consensus.cc:2272] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.394654 17235 ts_tablet_manager.cc:1916] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:06.426206 16366 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.451144 17235 ts_tablet_manager.cc:1929] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:06.451815 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 486137446c7c411e8a8ec3d1dd300579 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:06.452883 17226 tablet_replica.cc:333] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:06.455060 17235 log.cc:1199] T 8806363158d645279801d4633a1c7d74 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/8806363158d645279801d4633a1c7d74
I20260709 13:06:06.463071 17226 raft_consensus.cc:2243] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.463660 17226 raft_consensus.cc:2272] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.466992 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 8806363158d645279801d4633a1c7d74 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:06.466710 17226 ts_tablet_manager.cc:1916] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:06.482000 17226 ts_tablet_manager.cc:1929] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:06.482393 17226 log.cc:1199] T 486137446c7c411e8a8ec3d1dd300579 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/486137446c7c411e8a8ec3d1dd300579
I20260709 13:06:06.483799 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 486137446c7c411e8a8ec3d1dd300579 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:07.540669 16544 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:07.553874 16509 consensus_peers.cc:597] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4caba52d3ee04ab8b71cd4236ee0ccde. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.554133 16614 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.555487 16468 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.556074 16801 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.558425 16801 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.588950 16801 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.591578 16614 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.594334 16464 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.634361 16368 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.679718 16616 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:07.689785 16464 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.691433 16544 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.691601 17238 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.697044 17162 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.728264 17162 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:07.737944 16583 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c87fc9474b4fd2806ea6a4c1104e22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.729323 16544 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.754194 16464 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.758435 16614 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:07.779309 16468 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:07.781759 16583 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7735d77d64e14457985553596120e4cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.781963 17162 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.783550 16544 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.790140 17162 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.792162 16367 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.808753 17238 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.813831 16468 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.834085 16544 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.848286 16367 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.869416 16467 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:07.887826 16614 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:07.888468 16434 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e30da0730b354efb9fefd9ef646ce15f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.889683 17183 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.891219 16542 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:07.893155 17183 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.918135 17183 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.920627 16616 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.925581 16542 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:07.956604 16368 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.960386 17260 ts_tablet_manager.cc:933] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:07.989326 17260 tablet_copy_client.cc:323] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:08.000049 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 4caba52d3ee04ab8b71cd4236ee0ccde from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:08.000747 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 4caba52d3ee04ab8b71cd4236ee0ccde from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-4caba52d3ee04ab8b71cd4236ee0ccde
I20260709 13:06:08.043984 16555 tablet_copy_source_session.cc:215] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:08.049041 17260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4caba52d3ee04ab8b71cd4236ee0ccde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:08.096756 17260 tablet_copy_client.cc:806] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:08.097620 17260 tablet_copy_client.cc:670] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.374763 17260 tablet_copy_client.cc:538] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:08.663587 17260 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:08.681167 17277 ts_tablet_manager.cc:933] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:08.687871 17278 ts_tablet_manager.cc:933] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:08.680588 17276 ts_tablet_manager.cc:933] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:08.696364 17276 tablet_copy_client.cc:323] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:08.698552 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet e30da0730b354efb9fefd9ef646ce15f from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:08.699119 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet e30da0730b354efb9fefd9ef646ce15f from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-e30da0730b354efb9fefd9ef646ce15f
I20260709 13:06:08.708778 16480 tablet_copy_source_session.cc:215] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:08.712932 17276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30da0730b354efb9fefd9ef646ce15f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:08.713372 17277 tablet_copy_client.cc:323] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:08.733198 17278 tablet_copy_client.cc:323] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:08.746824 17276 tablet_copy_client.cc:806] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:08.761143 17276 tablet_copy_client.cc:670] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.767163 17276 tablet_copy_client.cc:538] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:08.775642 17260 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.776279 17276 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:08.777076 17260 tablet_bootstrap.cc:492] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:08.788941 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 7735d77d64e14457985553596120e4cc from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:08.789492 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 7735d77d64e14457985553596120e4cc from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-7735d77d64e14457985553596120e4cc
I20260709 13:06:08.789498 17260 ts_tablet_manager.cc:1403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.126s	user 0.051s	sys 0.021s
I20260709 13:06:08.787807 16629 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet b6c87fc9474b4fd2806ea6a4c1104e22 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:08.793586 16629 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet b6c87fc9474b4fd2806ea6a4c1104e22 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-b6c87fc9474b4fd2806ea6a4c1104e22
I20260709 13:06:08.802173 17260 raft_consensus.cc:359] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.803175 17260 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:08.804800 17260 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.809391 16628 tablet_copy_source_session.cc:215] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:08.813097 17278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7735d77d64e14457985553596120e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:08.821596 16629 tablet_copy_source_session.cc:215] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:08.825362 17277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c87fc9474b4fd2806ea6a4c1104e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:08.826870 17260 ts_tablet_manager.cc:1434] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.008s
I20260709 13:06:08.831274 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-4caba52d3ee04ab8b71cd4236ee0ccde received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:08.831758 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-4caba52d3ee04ab8b71cd4236ee0ccde on tablet 4caba52d3ee04ab8b71cd4236ee0ccde with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:08.852851 17278 tablet_copy_client.cc:806] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:08.853534 17278 tablet_copy_client.cc:670] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.855551 17276 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.857831 17276 tablet_bootstrap.cc:492] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:08.856822 17277 tablet_copy_client.cc:806] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:08.859457 17277 tablet_copy_client.cc:670] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.862053 17278 tablet_copy_client.cc:538] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:08.864666 17277 tablet_copy_client.cc:538] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:08.869066 17276 ts_tablet_manager.cc:1403] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.093s	user 0.025s	sys 0.002s
I20260709 13:06:08.876538 17276 raft_consensus.cc:359] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.877557 17276 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:08.878712 17276 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.873178 17278 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:08.885766 17276 ts_tablet_manager.cc:1434] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:08.887322 17277 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:08.889875 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-e30da0730b354efb9fefd9ef646ce15f received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:08.892287 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-e30da0730b354efb9fefd9ef646ce15f on tablet e30da0730b354efb9fefd9ef646ce15f with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:08.927404 17277 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.928265 17277 tablet_bootstrap.cc:492] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:08.928992 17277 ts_tablet_manager.cc:1403] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.006s
I20260709 13:06:08.933144 17277 raft_consensus.cc:359] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.940984 17277 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:08.941797 17277 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.942713 17278 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.944028 17278 tablet_bootstrap.cc:492] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:08.948994 17277 ts_tablet_manager.cc:1434] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.006s
I20260709 13:06:08.949857 17278 ts_tablet_manager.cc:1403] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.077s	user 0.021s	sys 0.004s
I20260709 13:06:08.953356 16629 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-b6c87fc9474b4fd2806ea6a4c1104e22 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:08.953851 16629 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-b6c87fc9474b4fd2806ea6a4c1104e22 on tablet b6c87fc9474b4fd2806ea6a4c1104e22 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:08.958889 17278 raft_consensus.cc:359] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.961192 17278 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:08.961983 17278 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:08.965827 17278 ts_tablet_manager.cc:1434] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:06:08.970286 16629 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-7735d77d64e14457985553596120e4cc received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:08.971683 16629 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-7735d77d64e14457985553596120e4cc on tablet 7735d77d64e14457985553596120e4cc with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:09.076822 17123 raft_consensus.cc:1217] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:09.100389 17123 raft_consensus.cc:1217] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:09.187762 17123 raft_consensus.cc:1217] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:09.307307 17123 raft_consensus.cc:1217] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:09.415338 16566 debug-util.cc:398] Leaking SignalData structure 0x7b080015e2a0 after lost signal to thread 15324
W20260709 13:06:09.416397 16566 debug-util.cc:398] Leaking SignalData structure 0x7b0800132980 after lost signal to thread 16402
W20260709 13:06:09.417533 16566 debug-util.cc:398] Leaking SignalData structure 0x7b0800296360 after lost signal to thread 16494
W20260709 13:06:09.418499 16566 debug-util.cc:398] Leaking SignalData structure 0x7b080031dae0 after lost signal to thread 16569
W20260709 13:06:09.420210 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08002eca60 after lost signal to thread 17151
I20260709 13:06:09.653172 17190 raft_consensus.cc:1064] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:09.656324 17190 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:09.731482 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 86909us
I20260709 13:06:09.739248 17270 raft_consensus.cc:1064] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:09.823086 17270 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:09.848248 16542 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.852588 16467 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:09.854681 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 75697.2us
I20260709 13:06:09.854220 17272 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:09.859405 17190 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:09.900933 17289 raft_consensus.cc:1064] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:09.904533 16470 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.909843 17274 raft_consensus.cc:1064] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:09.911998 16542 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.913966 17274 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:09.903858 17289 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:09.929548 17290 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:09.934894 17124 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.936007 17272 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:09.944168 17123 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.946588 17297 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:09.950619 17297 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:09.976097 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84235.3us
I20260709 13:06:09.979478 17127 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:09.986603 16464 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:09.986630 17214 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:09.984109 17190 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.009057 16542 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.012861 17299 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:10.041148 16614 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.062139 17127 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.064579 16470 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.064966 17289 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:10.066376 17292 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:10.071802 17214 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.079646 16541 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.104947 17124 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.111611 17263 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:10.113385 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83800.8us
I20260709 13:06:10.116077 16613 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:10.120831 17289 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:10.132488 17270 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.139343 16469 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.112758 16368 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.170069 16367 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:10.178428 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 67590.8us
W20260709 13:06:10.179484 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 65186.6us
I20260709 13:06:10.184324 17127 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.200821 16542 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.202834 17126 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.216447 16541 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.240614 16616 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.256345 17292 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.258270 16470 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.291289 16618 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:10.344808 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48329.4us
I20260709 13:06:10.354722 17123 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.378068 16470 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:10.384001 17124 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.384001 16542 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.386042 17321 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:10.386807 17263 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.396417 17208 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.402878 16542 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.412736 16368 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.430904 17123 raft_consensus.cc:2955] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.446202 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e30da0730b354efb9fefd9ef646ce15f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:10.452132 16365 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.492923 16542 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:10.500696 16614 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:10.513556 16618 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:10.520435 16366 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.527014 16470 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.527520 17124 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.528008 17126 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.529156 17311 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:10.529862 17291 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:10.530437 17292 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.532673 17123 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.535255 17291 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.537480 16469 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.539770 17270 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.542893 17290 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.545522 16469 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.546965 17291 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.551220 16470 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.552156 17215 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.550033 17123 raft_consensus.cc:2955] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.558974 17126 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.568388 17124 raft_consensus.cc:2955] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.575984 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet e30da0730b354efb9fefd9ef646ce15f with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:10.576521 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7735d77d64e14457985553596120e4cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:10.582089 16366 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.608064 17323 tablet_replica.cc:333] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:10.609160 17323 raft_consensus.cc:2243] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:10.616952 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6c87fc9474b4fd2806ea6a4c1104e22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:10.616320 16367 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.625257 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 7735d77d64e14457985553596120e4cc with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:10.629703 16366 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:10.634057 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 4caba52d3ee04ab8b71cd4236ee0ccde with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:10.638638 16470 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:10.641538 17324 tablet_replica.cc:333] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:10.642874 17324 raft_consensus.cc:2243] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:10.646250 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4caba52d3ee04ab8b71cd4236ee0ccde with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:10.609789 17323 raft_consensus.cc:2272] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:10.659494 17324 raft_consensus.cc:2272] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:10.667666 17323 ts_tablet_manager.cc:1916] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:10.719794 17323 ts_tablet_manager.cc:1929] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:10.720268 17323 log.cc:1199] T e30da0730b354efb9fefd9ef646ce15f P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/e30da0730b354efb9fefd9ef646ce15f
I20260709 13:06:10.720954 17294 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.726634 17324 ts_tablet_manager.cc:1916] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:10.731941 17323 tablet_replica.cc:333] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:06:10.736694 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88154.1us
I20260709 13:06:10.742233 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet e30da0730b354efb9fefd9ef646ce15f (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:10.749478 16469 raft_consensus.cc:2955] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:10.750972 17324 ts_tablet_manager.cc:1929] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:10.751453 17324 log.cc:1199] T 7735d77d64e14457985553596120e4cc P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/7735d77d64e14457985553596120e4cc
I20260709 13:06:10.765820 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 7735d77d64e14457985553596120e4cc (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:10.766326 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet b6c87fc9474b4fd2806ea6a4c1104e22 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:10.770244 17324 tablet_replica.cc:333] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:10.771423 17324 raft_consensus.cc:2243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:10.772284 17324 raft_consensus.cc:2272] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:10.780732 17324 ts_tablet_manager.cc:1916] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:10.804956 17324 ts_tablet_manager.cc:1929] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:10.805442 17324 log.cc:1199] T b6c87fc9474b4fd2806ea6a4c1104e22 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/b6c87fc9474b4fd2806ea6a4c1104e22
I20260709 13:06:10.809125 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet b6c87fc9474b4fd2806ea6a4c1104e22 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:10.820633 17323 raft_consensus.cc:2243] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:10.821414 17323 raft_consensus.cc:2272] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:10.824726 17323 ts_tablet_manager.cc:1916] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:10.838271 17323 ts_tablet_manager.cc:1929] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:10.838641 17323 log.cc:1199] T 4caba52d3ee04ab8b71cd4236ee0ccde P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/4caba52d3ee04ab8b71cd4236ee0ccde
I20260709 13:06:10.840966 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 4caba52d3ee04ab8b71cd4236ee0ccde (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:11.750803 16616 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:11.757427 16539 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.758062 16467 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.758704 17291 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:11.759635 16583 consensus_peers.cc:597] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a1257c346f6436b83f5cc36b5c04f18. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.759994 17270 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.766868 17291 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.768589 16467 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.779922 16616 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:11.788843 16366 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.807336 16542 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.810027 17272 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:11.816152 16583 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0499df31d9f40178fb10011eef7ece6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.816567 16539 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.820617 16470 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.823431 17272 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:11.837055 17272 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.849159 16542 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.862762 16470 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:11.886539 16467 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:11.956209 16616 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.959949 16539 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:11.965656 17263 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:11.967896 17263 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:11.985476 16367 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:12.012624 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48268.4us
I20260709 13:06:12.013831 17263 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.015820 16542 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:12.025275 16434 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74c0af8eb7234215a518fd144bd450af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.041457 16539 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.048722 16367 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:12.057081 16509 consensus_peers.cc:597] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 400e1c04ef6646108d16357968e6e8d1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:12.058633 16616 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.057967 16614 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.061072 17289 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.064071 16467 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:12.065471 17215 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:12.103317 17295 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.106179 16467 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.106513 16616 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.140309 16367 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:12.257109 17344 ts_tablet_manager.cc:933] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:12.263911 17344 tablet_copy_client.cc:323] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:12.266028 16629 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 9a1257c346f6436b83f5cc36b5c04f18 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:12.266558 16629 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 9a1257c346f6436b83f5cc36b5c04f18 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-9a1257c346f6436b83f5cc36b5c04f18
I20260709 13:06:12.276619 17345 ts_tablet_manager.cc:933] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:12.288527 16629 tablet_copy_source_session.cc:215] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.292090 17344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a1257c346f6436b83f5cc36b5c04f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.306542 17345 tablet_copy_client.cc:323] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:12.308462 16629 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet d0499df31d9f40178fb10011eef7ece6 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:12.309070 16629 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet d0499df31d9f40178fb10011eef7ece6 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-d0499df31d9f40178fb10011eef7ece6
I20260709 13:06:12.316998 16629 tablet_copy_source_session.cc:215] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.317346 17344 tablet_copy_client.cc:806] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.318858 17344 tablet_copy_client.cc:670] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.322774 17344 tablet_copy_client.cc:538] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.323379 17345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0499df31d9f40178fb10011eef7ece6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.331718 17344 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:12.357769 17345 tablet_copy_client.cc:806] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.358392 17345 tablet_copy_client.cc:670] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.368631 17344 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.369692 17344 tablet_bootstrap.cc:492] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:12.370421 17344 ts_tablet_manager.cc:1403] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.013s
I20260709 13:06:12.371049 17345 tablet_copy_client.cc:538] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.374650 17344 raft_consensus.cc:359] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.375555 17344 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:12.380347 17344 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.401232 17344 ts_tablet_manager.cc:1434] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.003s
I20260709 13:06:12.408073 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-9a1257c346f6436b83f5cc36b5c04f18 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:12.408511 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-9a1257c346f6436b83f5cc36b5c04f18 on tablet 9a1257c346f6436b83f5cc36b5c04f18 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:12.419870 17345 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:12.456229 17345 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.457255 17345 tablet_bootstrap.cc:492] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:12.457914 17345 ts_tablet_manager.cc:1403] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.010s
I20260709 13:06:12.460697 17345 raft_consensus.cc:359] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.461522 17345 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:12.462159 17345 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.464844 17345 ts_tablet_manager.cc:1434] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:06:12.467875 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-d0499df31d9f40178fb10011eef7ece6 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:12.468305 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-d0499df31d9f40178fb10011eef7ece6 on tablet d0499df31d9f40178fb10011eef7ece6 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:12.469290 17344 ts_tablet_manager.cc:933] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:12.498373 17344 tablet_copy_client.cc:323] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:12.502947 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 400e1c04ef6646108d16357968e6e8d1 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:12.503520 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 400e1c04ef6646108d16357968e6e8d1 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-400e1c04ef6646108d16357968e6e8d1
I20260709 13:06:12.510725 16555 tablet_copy_source_session.cc:215] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.514081 17344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 400e1c04ef6646108d16357968e6e8d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.536715 17344 tablet_copy_client.cc:806] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.537297 17344 tablet_copy_client.cc:670] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.540918 17344 tablet_copy_client.cc:538] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.549535 17344 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:12.555670 17345 ts_tablet_manager.cc:933] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:12.586026 17344 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.586912 17344 tablet_bootstrap.cc:492] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:12.587558 17344 ts_tablet_manager.cc:1403] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.000s
I20260709 13:06:12.588850 17345 tablet_copy_client.cc:323] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:12.590822 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 74c0af8eb7234215a518fd144bd450af from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:12.591339 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 74c0af8eb7234215a518fd144bd450af from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-74c0af8eb7234215a518fd144bd450af
I20260709 13:06:12.591317 17344 raft_consensus.cc:359] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.592414 17344 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:12.593180 17344 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.599859 17344 ts_tablet_manager.cc:1434] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:06:12.598882 16480 tablet_copy_source_session.cc:215] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:12.602108 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-400e1c04ef6646108d16357968e6e8d1 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:12.602571 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-400e1c04ef6646108d16357968e6e8d1 on tablet 400e1c04ef6646108d16357968e6e8d1 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:12.607545 17345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74c0af8eb7234215a518fd144bd450af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:12.631381 17345 tablet_copy_client.cc:806] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:12.633466 17345 tablet_copy_client.cc:670] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:12.637158 17345 tablet_copy_client.cc:538] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:12.646131 17345 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:12.645949 17126 raft_consensus.cc:1217] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:12.692157 17345 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:12.693074 17345 tablet_bootstrap.cc:492] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:12.693760 17345 ts_tablet_manager.cc:1403] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.003s
I20260709 13:06:12.698428 17345 raft_consensus.cc:359] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.699035 17345 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:12.699565 17345 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:12.701692 17345 ts_tablet_manager.cc:1434] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:12.704282 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-74c0af8eb7234215a518fd144bd450af received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:12.704752 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-74c0af8eb7234215a518fd144bd450af on tablet 74c0af8eb7234215a518fd144bd450af with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:12.719755 17126 raft_consensus.cc:1217] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:12.894025 17126 raft_consensus.cc:1217] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.069348 17126 raft_consensus.cc:1217] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:13.099119 17270 raft_consensus.cc:1064] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:13.103916 17270 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.206269 17126 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.210441 17272 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:13.235735 17358 raft_consensus.cc:1064] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:13.238768 16539 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.238807 16469 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.242363 17272 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.253780 17359 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:06:13.280809 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 70031.6us
I20260709 13:06:13.310760 17358 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.311923 17126 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.307512 17359 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.322746 16542 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.420243 16365 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.427477 16469 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.434216 16470 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.436698 17270 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.443024 17126 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.444864 17358 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.455212 16542 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.459621 17272 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.483093 17291 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.510967 16544 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.518682 17289 raft_consensus.cc:1064] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:13.521687 17289 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.531827 17126 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.561290 16470 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.561866 16615 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.555485 16469 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.563952 17295 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.571954 17124 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.580988 17289 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.583741 17294 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:13.599498 16366 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.604928 16614 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.609364 17289 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.617103 16615 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.623999 17124 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.651850 17123 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.654865 16467 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.656390 17359 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.658417 17359 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.666862 17270 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.675187 17123 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.681095 16469 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.696956 17337 raft_consensus.cc:1064] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:13.703557 17337 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.711342 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0499df31d9f40178fb10011eef7ece6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:13.721107 16467 raft_consensus.cc:2955] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.741573 16614 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.760318 16542 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.762390 17127 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.764359 17361 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.765681 16539 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.766482 17361 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.767289 17272 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.766724 16365 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.773538 16616 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:13.778039 17354 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:13.792492 16542 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.802309 17126 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.811637 16365 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.817417 17272 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.775297 17359 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.825145 17126 raft_consensus.cc:2955] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.832933 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a1257c346f6436b83f5cc36b5c04f18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:13.843564 17361 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.891860 16365 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:13.894832 17127 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:13.902871 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 92934.7us
I20260709 13:06:13.958670 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet d0499df31d9f40178fb10011eef7ece6 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
W20260709 13:06:13.958364 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91407.3us
I20260709 13:06:13.961298 17388 tablet_replica.cc:333] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:13.965057 17388 raft_consensus.cc:2243] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:13.966815 16542 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:13.969542 17388 raft_consensus.cc:2272] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:13.973176 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 59625.7us
I20260709 13:06:13.975900 17388 ts_tablet_manager.cc:1916] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:13.984509 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a1257c346f6436b83f5cc36b5c04f18 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:13.991405 16613 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:13.992566 16368 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:13.993484 16542 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.019934 17384 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:13.999532 16619 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.038599 17389 tablet_replica.cc:333] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:14.009060 17127 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.039949 17389 raft_consensus.cc:2243] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.041370 17389 raft_consensus.cc:2272] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.044827 17215 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.051419 17295 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.056944 17126 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.065749 17389 ts_tablet_manager.cc:1916] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.070902 16467 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:14.075839 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 400e1c04ef6646108d16357968e6e8d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.076673 17127 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.078104 17388 ts_tablet_manager.cc:1929] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.078600 17388 log.cc:1199] T d0499df31d9f40178fb10011eef7ece6 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/d0499df31d9f40178fb10011eef7ece6
I20260709 13:06:14.078644 16542 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:14.081028 17383 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.082810 17381 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.086956 16367 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.088291 17383 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.089911 16542 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.097002 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet d0499df31d9f40178fb10011eef7ece6 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:14.076933 16619 raft_consensus.cc:2955] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.092900 17127 raft_consensus.cc:2955] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:14.117334 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 400e1c04ef6646108d16357968e6e8d1 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:14.129317 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74c0af8eb7234215a518fd144bd450af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:14.133917 17389 ts_tablet_manager.cc:1929] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.136314 17389 log.cc:1199] T 9a1257c346f6436b83f5cc36b5c04f18 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/9a1257c346f6436b83f5cc36b5c04f18
I20260709 13:06:14.140904 17389 tablet_replica.cc:333] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:14.141021 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 9a1257c346f6436b83f5cc36b5c04f18 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:14.157424 17389 raft_consensus.cc:2243] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.159235 17389 raft_consensus.cc:2272] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.170985 16368 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.176035 17389 ts_tablet_manager.cc:1916] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.181541 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 74c0af8eb7234215a518fd144bd450af with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:14.196439 17390 tablet_replica.cc:333] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:14.197556 17390 raft_consensus.cc:2243] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:14.198549 17390 raft_consensus.cc:2272] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:14.203007 17390 ts_tablet_manager.cc:1916] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:14.207988 17389 ts_tablet_manager.cc:1929] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.208576 17389 log.cc:1199] T 400e1c04ef6646108d16357968e6e8d1 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/400e1c04ef6646108d16357968e6e8d1
I20260709 13:06:14.210325 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 400e1c04ef6646108d16357968e6e8d1 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:14.215660 17390 ts_tablet_manager.cc:1929] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:14.216056 17390 log.cc:1199] T 74c0af8eb7234215a518fd144bd450af P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/74c0af8eb7234215a518fd144bd450af
I20260709 13:06:14.217577 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 74c0af8eb7234215a518fd144bd450af (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:15.299119 16541 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:15.307152 16619 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:15.307950 16509 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53c1c59c7dab4ee3afd08075f673c2c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.309407 16467 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.311141 17295 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.312572 17295 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.342954 17384 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.355991 16469 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.363467 16613 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.373935 16368 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.381246 16619 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:15.397912 16583 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: deb27cdf9e08471584fe7bce6bffd303. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.401576 16541 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.405831 17359 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.406370 16469 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.413393 17359 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.424728 17391 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.433331 16470 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.436895 16544 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.455830 16368 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.481487 16544 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:15.506299 16509 consensus_peers.cc:597] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 866175a9d3d74ca692d4573f642d17a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.517488 16470 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.518050 16613 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:15.519510 17397 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.520747 17295 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.538596 17384 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.552917 16470 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.556735 16619 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.559681 16366 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.568506 16544 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:15.603294 16509 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 922b28b4b68e4191b6f4e8c9291cd40d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.605135 16613 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.605489 16469 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:15.607340 17295 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.608345 17396 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:15.621694 17295 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.623433 16613 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.625680 16470 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:15.647161 16368 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:15.802539 17413 ts_tablet_manager.cc:933] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:15.812974 17413 tablet_copy_client.cc:323] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:15.814620 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 53c1c59c7dab4ee3afd08075f673c2c8 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:15.815160 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 53c1c59c7dab4ee3afd08075f673c2c8 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-53c1c59c7dab4ee3afd08075f673c2c8
I20260709 13:06:15.823347 16555 tablet_copy_source_session.cc:215] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.828320 17413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c1c59c7dab4ee3afd08075f673c2c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.841794 17413 tablet_copy_client.cc:806] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.842398 17413 tablet_copy_client.cc:670] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.846699 17413 tablet_copy_client.cc:538] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.856225 17413 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:15.872663 17413 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:15.873812 17413 tablet_bootstrap.cc:492] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:15.874743 17413 ts_tablet_manager.cc:1403] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 13:06:15.877648 17413 raft_consensus.cc:359] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:15.878484 17413 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:15.878986 17413 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:15.882339 17413 ts_tablet_manager.cc:1434] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:06:15.883889 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-53c1c59c7dab4ee3afd08075f673c2c8 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:15.884289 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-53c1c59c7dab4ee3afd08075f673c2c8 on tablet 53c1c59c7dab4ee3afd08075f673c2c8 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:15.936496 17413 ts_tablet_manager.cc:933] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:15.938438 17413 tablet_copy_client.cc:323] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:15.939870 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 866175a9d3d74ca692d4573f642d17a9 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:15.940294 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 866175a9d3d74ca692d4573f642d17a9 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-866175a9d3d74ca692d4573f642d17a9
I20260709 13:06:15.945639 16555 tablet_copy_source_session.cc:215] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.948472 17413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 866175a9d3d74ca692d4573f642d17a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.955538 17418 ts_tablet_manager.cc:933] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:15.963219 17418 tablet_copy_client.cc:323] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:15.964747 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet deb27cdf9e08471584fe7bce6bffd303 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:15.965276 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet deb27cdf9e08471584fe7bce6bffd303 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-deb27cdf9e08471584fe7bce6bffd303
I20260709 13:06:15.967826 17413 tablet_copy_client.cc:806] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.968401 17413 tablet_copy_client.cc:670] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.970939 16628 tablet_copy_source_session.cc:215] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:15.971861 17413 tablet_copy_client.cc:538] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.973742 17418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb27cdf9e08471584fe7bce6bffd303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:15.982702 17413 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:16.001869 17418 tablet_copy_client.cc:806] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.002521 17418 tablet_copy_client.cc:670] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.010913 17418 tablet_copy_client.cc:538] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.012205 17413 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.013154 17413 tablet_bootstrap.cc:492] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:16.013767 17413 ts_tablet_manager.cc:1403] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.018s
I20260709 13:06:16.016594 17413 raft_consensus.cc:359] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.017446 17413 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:16.017555 17418 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:16.018081 17413 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.020689 17413 ts_tablet_manager.cc:1434] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:06:16.025187 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-866175a9d3d74ca692d4573f642d17a9 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:16.025610 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-866175a9d3d74ca692d4573f642d17a9 on tablet 866175a9d3d74ca692d4573f642d17a9 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:16.060393 17413 ts_tablet_manager.cc:933] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:16.065832 17418 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.069554 17413 tablet_copy_client.cc:323] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:16.072203 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 922b28b4b68e4191b6f4e8c9291cd40d from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:16.072721 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 922b28b4b68e4191b6f4e8c9291cd40d from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-922b28b4b68e4191b6f4e8c9291cd40d
I20260709 13:06:16.072901 17418 tablet_bootstrap.cc:492] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:16.074718 17418 ts_tablet_manager.cc:1403] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.014s
I20260709 13:06:16.077696 17418 raft_consensus.cc:359] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.078500 17418 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:16.079101 17418 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.084887 17418 ts_tablet_manager.cc:1434] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:06:16.087280 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-deb27cdf9e08471584fe7bce6bffd303 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:16.087690 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-deb27cdf9e08471584fe7bce6bffd303 on tablet deb27cdf9e08471584fe7bce6bffd303 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:16.096841 16555 tablet_copy_source_session.cc:215] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:16.102488 17413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 922b28b4b68e4191b6f4e8c9291cd40d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:16.117933 17413 tablet_copy_client.cc:806] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:16.118532 17413 tablet_copy_client.cc:670] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:16.122015 17413 tablet_copy_client.cc:538] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:16.129896 17413 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:16.147634 17413 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:16.148492 17413 tablet_bootstrap.cc:492] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:16.149127 17413 ts_tablet_manager.cc:1403] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.003s
I20260709 13:06:16.151888 17413 raft_consensus.cc:359] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.152643 17413 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:16.153234 17413 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:16.155342 17413 ts_tablet_manager.cc:1434] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:16.156905 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-922b28b4b68e4191b6f4e8c9291cd40d received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:16.157331 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-922b28b4b68e4191b6f4e8c9291cd40d on tablet 922b28b4b68e4191b6f4e8c9291cd40d with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:16.252590 17127 raft_consensus.cc:1217] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.469790 17127 raft_consensus.cc:1217] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:06:16.479341 17127 raft_consensus.cc:1217] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.517975 17127 raft_consensus.cc:1217] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:16.753409 17396 raft_consensus.cc:1064] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:16.759728 17396 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:16.783394 17127 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.784502 16619 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.785301 17295 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.787690 17429 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.795223 16469 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.797079 17295 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.802517 17384 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:16.806295 16613 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:16.834069 17127 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:16.848095 16469 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:16.854600 16368 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:16.912295 17384 raft_consensus.cc:1064] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:16.914943 17384 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:16.927460 16467 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.926636 17127 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.927459 16611 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.929404 17396 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.932648 17384 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.933936 17295 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.947022 17424 raft_consensus.cc:1064] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:16.950197 17424 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:16.961143 17429 raft_consensus.cc:1064] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:16.964017 17429 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:16.974907 17126 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.976593 17405 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.981683 16469 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.987871 17427 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.993765 16542 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:16.997965 17427 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.998176 16544 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:17.006899 17126 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.010871 17396 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:17.016727 17405 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.046120 17126 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.064416 16468 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:17.064252 16467 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.067243 17127 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:17.074918 16611 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:06:17.068650 17447 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.069207 17448 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:17.079268 16541 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.088874 17396 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:17.093221 16366 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.069413 17449 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:17.108469 16470 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.113073 16467 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.114631 17295 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.096894 17426 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:06:17.154178 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 73781.2us
I20260709 13:06:17.210368 16468 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.229676 17127 raft_consensus.cc:2955] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.210439 17123 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.239229 16614 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.244985 16366 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.256244 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53c1c59c7dab4ee3afd08075f673c2c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.285499 17447 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.290918 16613 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.292053 17123 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.298410 16614 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:17.309180 16468 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.312295 17424 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.314051 16365 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.317536 16367 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.318993 17427 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.310323 17123 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.320431 16467 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.322274 17424 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.332819 16544 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:17.323225 16470 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.337376 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 53c1c59c7dab4ee3afd08075f673c2c8 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:17.355883 16541 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:17.357893 17127 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.359257 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet deb27cdf9e08471584fe7bce6bffd303 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.360220 17123 raft_consensus.cc:2955] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.361766 16468 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:17.362022 17447 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.374414 17454 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:17.367085 17127 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:17.367877 17457 tablet_replica.cc:333] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:17.369349 16613 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:06:17.376348 17447 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.379446 17454 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:17.376180 17457 raft_consensus.cc:2243] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.381759 17457 raft_consensus.cc:2272] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.381419 17426 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.383116 17126 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.387193 17452 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.388785 17457 ts_tablet_manager.cc:1916] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.391105 16613 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.392329 16366 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.394694 17124 raft_consensus.cc:2955] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.415014 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 922b28b4b68e4191b6f4e8c9291cd40d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.416169 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 866175a9d3d74ca692d4573f642d17a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:17.404661 16365 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.436589 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet deb27cdf9e08471584fe7bce6bffd303 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:17.438544 16467 raft_consensus.cc:2955] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.460342 17458 tablet_replica.cc:333] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:17.461470 17458 raft_consensus.cc:2243] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.464448 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 922b28b4b68e4191b6f4e8c9291cd40d with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:17.466606 17458 raft_consensus.cc:2272] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.468163 17457 ts_tablet_manager.cc:1929] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.471882 17457 log.cc:1199] T 53c1c59c7dab4ee3afd08075f673c2c8 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/53c1c59c7dab4ee3afd08075f673c2c8
I20260709 13:06:17.471210 17458 ts_tablet_manager.cc:1916] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.476158 16367 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:17.481475 17457 tablet_replica.cc:333] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:17.481586 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 53c1c59c7dab4ee3afd08075f673c2c8 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:17.482628 17457 raft_consensus.cc:2243] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.483275 17457 raft_consensus.cc:2272] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.486768 17457 ts_tablet_manager.cc:1916] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.501935 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 866175a9d3d74ca692d4573f642d17a9 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:17.512349 17458 ts_tablet_manager.cc:1929] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.512918 17458 log.cc:1199] T deb27cdf9e08471584fe7bce6bffd303 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/deb27cdf9e08471584fe7bce6bffd303
I20260709 13:06:17.513661 17457 ts_tablet_manager.cc:1929] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:17.514219 17457 log.cc:1199] T 922b28b4b68e4191b6f4e8c9291cd40d P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/922b28b4b68e4191b6f4e8c9291cd40d
I20260709 13:06:17.514707 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet deb27cdf9e08471584fe7bce6bffd303 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:17.516669 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 922b28b4b68e4191b6f4e8c9291cd40d (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:17.517241 17459 tablet_replica.cc:333] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:17.524744 17459 raft_consensus.cc:2243] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:17.525435 17459 raft_consensus.cc:2272] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:17.528337 17459 ts_tablet_manager.cc:1916] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:17.540048 17459 ts_tablet_manager.cc:1929] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:06:17.540395 17459 log.cc:1199] T 866175a9d3d74ca692d4573f642d17a9 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/866175a9d3d74ca692d4573f642d17a9
I20260709 13:06:17.541916 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 866175a9d3d74ca692d4573f642d17a9 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:18.576973 16614 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:18.583557 16541 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:18.584712 16583 consensus_peers.cc:597] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d994045524f7444ba202d5cf05c49d7f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.585299 16470 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.585382 17460 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.587620 17427 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.597741 17462 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.602802 16470 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.605746 16541 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.614563 16467 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:18.622514 16366 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:18.634598 16434 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4021ce342efc430996265ce4a5a65e87. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.638898 16614 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.640676 16541 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.641099 17392 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:18.645635 17392 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.656359 17383 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.658241 16541 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.678027 16544 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:18.714329 16613 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.716061 17454 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.716473 16470 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.720109 17452 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:18.726467 16509 consensus_peers.cc:597] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11dd34f18a6f4fcf882d199ba467c56c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.732263 16614 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.731932 16364 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.737958 17454 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.739212 16467 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.743798 16615 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.764361 16366 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:18.773687 16467 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:18.796479 16614 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.796839 16544 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:18.799342 17474 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:18.800791 17392 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:18.803341 16434 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5eccbd91402541c4bb6edc9c47f3cf8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:18.809059 17474 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.810778 16544 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.813483 16614 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:18.834750 16364 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:19.089995 17484 ts_tablet_manager.cc:933] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:19.092207 17484 tablet_copy_client.cc:323] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:19.094365 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 4021ce342efc430996265ce4a5a65e87 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:19.094935 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 4021ce342efc430996265ce4a5a65e87 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-4021ce342efc430996265ce4a5a65e87
I20260709 13:06:19.102481 16480 tablet_copy_source_session.cc:215] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.105398 17484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4021ce342efc430996265ce4a5a65e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.121354 17484 tablet_copy_client.cc:806] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.121997 17484 tablet_copy_client.cc:670] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.125746 17484 tablet_copy_client.cc:538] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.133702 17484 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:19.151484 17484 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.152264 17484 tablet_bootstrap.cc:492] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:19.152899 17484 ts_tablet_manager.cc:1403] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:06:19.155391 17484 raft_consensus.cc:359] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.156109 17484 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:19.156749 17484 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.159968 17484 ts_tablet_manager.cc:1434] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:06:19.161681 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-4021ce342efc430996265ce4a5a65e87 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:19.162142 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-4021ce342efc430996265ce4a5a65e87 on tablet 4021ce342efc430996265ce4a5a65e87 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:19.172084 17484 ts_tablet_manager.cc:933] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:19.179808 17489 ts_tablet_manager.cc:933] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:19.193590 17489 tablet_copy_client.cc:323] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:19.193647 17484 tablet_copy_client.cc:323] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:19.195283 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 5eccbd91402541c4bb6edc9c47f3cf8f from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:19.195814 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet d994045524f7444ba202d5cf05c49d7f from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:19.196394 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet d994045524f7444ba202d5cf05c49d7f from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-d994045524f7444ba202d5cf05c49d7f
I20260709 13:06:19.195840 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 5eccbd91402541c4bb6edc9c47f3cf8f from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-5eccbd91402541c4bb6edc9c47f3cf8f
I20260709 13:06:19.208110 16628 tablet_copy_source_session.cc:215] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.208974 16480 tablet_copy_source_session.cc:215] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.211758 17484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d994045524f7444ba202d5cf05c49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.212469 17489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5eccbd91402541c4bb6edc9c47f3cf8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.227209 17484 tablet_copy_client.cc:806] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.228397 17484 tablet_copy_client.cc:670] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.229267 17489 tablet_copy_client.cc:806] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.229892 17489 tablet_copy_client.cc:670] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.241007 17484 tablet_copy_client.cc:538] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.242561 17491 ts_tablet_manager.cc:933] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:19.243702 17489 tablet_copy_client.cc:538] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.254160 17484 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:19.257110 17491 tablet_copy_client.cc:323] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:19.259045 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 11dd34f18a6f4fcf882d199ba467c56c from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:19.259578 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 11dd34f18a6f4fcf882d199ba467c56c from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-11dd34f18a6f4fcf882d199ba467c56c
I20260709 13:06:19.260006 17489 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:19.267391 16555 tablet_copy_source_session.cc:215] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:19.272433 17491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd34f18a6f4fcf882d199ba467c56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:19.288415 17484 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.289513 17484 tablet_bootstrap.cc:492] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:19.290310 17484 ts_tablet_manager.cc:1403] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.005s
I20260709 13:06:19.293516 17484 raft_consensus.cc:359] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.294795 17484 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:19.295456 17484 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.301745 17484 ts_tablet_manager.cc:1434] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:06:19.302845 17491 tablet_copy_client.cc:806] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:19.303500 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-d994045524f7444ba202d5cf05c49d7f received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:19.304261 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-d994045524f7444ba202d5cf05c49d7f on tablet d994045524f7444ba202d5cf05c49d7f with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:19.305967 17491 tablet_copy_client.cc:670] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:19.313174 17491 tablet_copy_client.cc:538] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:19.324121 17491 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:19.345112 17489 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.347590 17489 tablet_bootstrap.cc:492] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:19.348565 17489 ts_tablet_manager.cc:1403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.089s	user 0.040s	sys 0.006s
I20260709 13:06:19.353667 17489 raft_consensus.cc:359] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.354831 17489 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:19.355654 17489 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.358289 17489 ts_tablet_manager.cc:1434] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:19.364883 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-5eccbd91402541c4bb6edc9c47f3cf8f received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:19.365331 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-5eccbd91402541c4bb6edc9c47f3cf8f on tablet 5eccbd91402541c4bb6edc9c47f3cf8f with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:19.378629 17491 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:19.379401 17491 tablet_bootstrap.cc:492] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:19.379966 17491 ts_tablet_manager.cc:1403] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.056s	user 0.018s	sys 0.025s
I20260709 13:06:19.382468 17491 raft_consensus.cc:359] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.383174 17491 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:19.383765 17491 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:19.386088 17491 ts_tablet_manager.cc:1434] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:06:19.387771 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-11dd34f18a6f4fcf882d199ba467c56c received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:19.388191 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-11dd34f18a6f4fcf882d199ba467c56c on tablet 11dd34f18a6f4fcf882d199ba467c56c with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:19.560923 17124 raft_consensus.cc:1217] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.573802 17124 raft_consensus.cc:1217] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.646481 17124 raft_consensus.cc:1217] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:19.726393 17124 raft_consensus.cc:1217] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:20.112635 17476 raft_consensus.cc:1064] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:20.115224 17476 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.122531 17124 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.122773 16615 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.123298 16467 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.124161 17476 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.125077 17454 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.125808 17478 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.153474 17454 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.164600 17124 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.174618 17392 raft_consensus.cc:1064] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:20.177986 17392 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.191032 17465 raft_consensus.cc:1064] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:20.194592 17465 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.205111 16365 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.215132 16615 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.216864 16544 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.216998 17392 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.218624 17497 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.249202 17497 raft_consensus.cc:1064] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:20.250310 17123 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.251761 17497 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.254189 17124 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:06:20.254421 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91451.7us
I20260709 13:06:20.256340 16470 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.257988 16470 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.259207 17460 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.261214 17496 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.260664 16544 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.262104 17460 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:20.262006 17474 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.280273 16614 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.256032 16541 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.294037 17465 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.306865 17126 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.324097 16614 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.334960 16613 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.335418 16542 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.334966 17123 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:20.336946 17504 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.337808 17474 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.339242 17496 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:20.341990 17427 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.356873 16544 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.357390 16470 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.405222 16364 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:20.407215 17504 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.409499 16542 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.463801 17126 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:20.475708 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59124.9us
I20260709 13:06:20.496395 16364 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.504586 17123 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.517264 16542 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.522414 16615 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.525666 16365 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.526422 16613 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.526786 17123 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.529495 17476 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.530534 17503 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:06:20.539108 16613 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.549121 16542 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.542929 17454 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.551259 17460 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.545663 17124 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.546453 17126 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.556847 17460 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.567072 16619 raft_consensus.cc:2955] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.567982 17460 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.575721 16542 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.582301 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11dd34f18a6f4fcf882d199ba467c56c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.586632 17126 raft_consensus.cc:2955] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.591800 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d994045524f7444ba202d5cf05c49d7f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.611384 16366 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.613149 16470 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.618788 17126 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.618870 16613 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.620334 17497 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.621356 17521 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.623085 16455 tablet_service.cc:1558] Processing DeleteTablet for tablet 11dd34f18a6f4fcf882d199ba467c56c with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:20.627624 16367 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.628710 17521 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.630623 17124 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.642181 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5eccbd91402541c4bb6edc9c47f3cf8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.654935 17529 tablet_replica.cc:333] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:20.655988 17529 raft_consensus.cc:2243] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.656469 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet d994045524f7444ba202d5cf05c49d7f with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:20.656814 17529 raft_consensus.cc:2272] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.658094 16613 raft_consensus.cc:2955] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.660797 16365 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:20.673357 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 5eccbd91402541c4bb6edc9c47f3cf8f with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:20.681550 17530 tablet_replica.cc:333] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:20.683959 17529 ts_tablet_manager.cc:1916] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.702407 17530 raft_consensus.cc:2243] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.704562 17530 raft_consensus.cc:2272] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.707593 17530 ts_tablet_manager.cc:1916] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.727454 17529 ts_tablet_manager.cc:1929] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.727893 17529 log.cc:1199] T 11dd34f18a6f4fcf882d199ba467c56c P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/11dd34f18a6f4fcf882d199ba467c56c
I20260709 13:06:20.729399 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 11dd34f18a6f4fcf882d199ba467c56c (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:20.732028 17529 tablet_replica.cc:333] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:20.732142 17530 ts_tablet_manager.cc:1929] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.733349 17529 raft_consensus.cc:2243] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.733776 17530 log.cc:1199] T 5eccbd91402541c4bb6edc9c47f3cf8f P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/5eccbd91402541c4bb6edc9c47f3cf8f
I20260709 13:06:20.734148 17529 raft_consensus.cc:2272] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.738647 17529 ts_tablet_manager.cc:1916] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.739655 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 5eccbd91402541c4bb6edc9c47f3cf8f (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:20.754662 17529 ts_tablet_manager.cc:1929] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.755133 17529 log.cc:1199] T d994045524f7444ba202d5cf05c49d7f P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/d994045524f7444ba202d5cf05c49d7f
I20260709 13:06:20.756569 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet d994045524f7444ba202d5cf05c49d7f (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:20.848065 16470 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:20.852869 17124 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.853447 16619 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:20.854231 17497 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.855180 17512 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:20.861181 17497 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.863209 17124 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.863438 16619 raft_consensus.cc:2955] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.879134 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4021ce342efc430996265ce4a5a65e87 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:20.881170 16365 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:20.894902 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 4021ce342efc430996265ce4a5a65e87 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:20.895875 17530 tablet_replica.cc:333] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:20.896909 17530 raft_consensus.cc:2243] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:20.897614 17530 raft_consensus.cc:2272] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:20.900686 17530 ts_tablet_manager.cc:1916] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:20.915040 17530 ts_tablet_manager.cc:1929] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:20.915362 17530 log.cc:1199] T 4021ce342efc430996265ce4a5a65e87 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/4021ce342efc430996265ce4a5a65e87
I20260709 13:06:20.916600 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 4021ce342efc430996265ce4a5a65e87 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:21.960820 16468 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:21.966260 16619 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:21.966719 16434 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92aeb38730a646668d4f528d66afd917. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:21.967506 16542 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:21.967509 17531 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:21.968910 17392 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:21.975088 17512 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:21.977002 16542 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:21.981809 16619 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:21.987277 16542 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:21.990599 16367 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.004136 16468 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:22.004468 16509 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df33d6051c004b71a5d0f086053be1fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.004652 16619 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.005851 17476 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.009637 17454 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.029194 17454 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.039295 16468 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.043615 16470 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.052201 16619 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:06:22.062043 16434 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55e23c7e0edd4ed18d5cf6b93c2b1607. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.066640 16544 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.068158 16619 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.068060 17531 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.069582 17512 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.083571 16365 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.094138 17531 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.095808 16544 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.104013 16619 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.113341 16366 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.113547 16613 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.146798 16542 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:22.147365 16583 consensus_peers.cc:597] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8de1d4f10dad40289b4f0b93992ff9b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:22.149073 17460 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.154325 16470 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:22.155622 17460 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:22.157905 17525 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.166739 16544 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.167443 16470 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:22.182215 16365 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:22.441694 17553 ts_tablet_manager.cc:933] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:22.450239 17553 tablet_copy_client.cc:323] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:22.451831 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 92aeb38730a646668d4f528d66afd917 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:22.452395 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 92aeb38730a646668d4f528d66afd917 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-92aeb38730a646668d4f528d66afd917
I20260709 13:06:22.458308 16480 tablet_copy_source_session.cc:215] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.461916 17553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92aeb38730a646668d4f528d66afd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.473245 17555 ts_tablet_manager.cc:933] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:22.474519 17553 tablet_copy_client.cc:806] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.475342 17553 tablet_copy_client.cc:670] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.477242 17555 tablet_copy_client.cc:323] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:22.478914 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet df33d6051c004b71a5d0f086053be1fe from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:22.479463 17553 tablet_copy_client.cc:538] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.479430 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet df33d6051c004b71a5d0f086053be1fe from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-df33d6051c004b71a5d0f086053be1fe
I20260709 13:06:22.489087 17553 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:22.491433 16555 tablet_copy_source_session.cc:215] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.494815 17555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df33d6051c004b71a5d0f086053be1fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.511543 17555 tablet_copy_client.cc:806] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.512176 17555 tablet_copy_client.cc:670] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.516068 17555 tablet_copy_client.cc:538] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.523707 17553 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.524653 17553 tablet_bootstrap.cc:492] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:22.525326 17553 ts_tablet_manager.cc:1403] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.011s
I20260709 13:06:22.527501 17555 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:22.530453 17553 raft_consensus.cc:359] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.531071 17553 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:22.531600 17553 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.550112 17553 ts_tablet_manager.cc:1434] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.007s
I20260709 13:06:22.555161 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-92aeb38730a646668d4f528d66afd917 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:22.555593 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-92aeb38730a646668d4f528d66afd917 on tablet 92aeb38730a646668d4f528d66afd917 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:22.558781 17553 ts_tablet_manager.cc:933] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:22.578550 17555 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.579409 17555 tablet_bootstrap.cc:492] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:22.580054 17555 ts_tablet_manager.cc:1403] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.000s
I20260709 13:06:22.581521 17553 tablet_copy_client.cc:323] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:22.583873 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:22.584406 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-55e23c7e0edd4ed18d5cf6b93c2b1607
I20260709 13:06:22.584059 17555 raft_consensus.cc:359] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.584998 17555 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:22.585651 17555 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.588708 17555 ts_tablet_manager.cc:1434] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 13:06:22.591962 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-df33d6051c004b71a5d0f086053be1fe received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:22.592407 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-df33d6051c004b71a5d0f086053be1fe on tablet df33d6051c004b71a5d0f086053be1fe with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:22.596626 16480 tablet_copy_source_session.cc:215] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.600477 17553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.613780 17553 tablet_copy_client.cc:806] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.614339 17553 tablet_copy_client.cc:670] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.618130 17553 tablet_copy_client.cc:538] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.626052 17553 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:22.644069 17553 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.644949 17553 tablet_bootstrap.cc:492] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:22.645588 17553 ts_tablet_manager.cc:1403] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:06:22.648418 17553 raft_consensus.cc:359] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.649246 17553 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:22.649856 17553 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.652292 17553 ts_tablet_manager.cc:1434] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:22.654085 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-55e23c7e0edd4ed18d5cf6b93c2b1607 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:22.654501 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-55e23c7e0edd4ed18d5cf6b93c2b1607 on tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:22.718070 17553 ts_tablet_manager.cc:933] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:22.721395 17553 tablet_copy_client.cc:323] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:22.722892 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 8de1d4f10dad40289b4f0b93992ff9b6 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:22.723342 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 8de1d4f10dad40289b4f0b93992ff9b6 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-8de1d4f10dad40289b4f0b93992ff9b6
I20260709 13:06:22.729053 16628 tablet_copy_source_session.cc:215] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.731841 17553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de1d4f10dad40289b4f0b93992ff9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.747488 17553 tablet_copy_client.cc:806] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.748096 17553 tablet_copy_client.cc:670] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.751832 17553 tablet_copy_client.cc:538] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:22.758678 17553 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:22.777361 17553 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:22.778247 17553 tablet_bootstrap.cc:492] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:22.778852 17553 ts_tablet_manager.cc:1403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.000s
I20260709 13:06:22.781317 17553 raft_consensus.cc:359] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.782058 17553 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:22.782595 17553 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:22.784610 17553 ts_tablet_manager.cc:1434] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:06:22.786994 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-8de1d4f10dad40289b4f0b93992ff9b6 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:22.787407 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-8de1d4f10dad40289b4f0b93992ff9b6 on tablet 8de1d4f10dad40289b4f0b93992ff9b6 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:22.842824 17124 raft_consensus.cc:1217] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:22.926033 17124 raft_consensus.cc:1217] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:23.125893 17124 raft_consensus.cc:1217] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:23.339633 17124 raft_consensus.cc:1217] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:23.442835 17547 raft_consensus.cc:1064] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:23.445452 17547 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.455261 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:23.476714 17124 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.478658 16613 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.482813 16544 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.482686 17573 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:23.486280 17512 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.489156 17547 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.496165 17454 raft_consensus.cc:1064] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:23.498328 17454 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.523074 17126 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.525665 17531 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.543546 16542 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.536067 17579 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:23.549535 16615 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.551209 16468 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.554188 17567 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.553799 16619 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:23.572474 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 47429.3us
I20260709 13:06:23.576155 17126 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.583091 17512 raft_consensus.cc:1064] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:23.579739 17582 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:23.586045 16366 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:23.588225 17512 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.650059 16619 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.654088 16542 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.655227 17573 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.659595 17573 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:23.673048 17126 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.675814 17512 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.707513 17582 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.712114 17123 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.759567 17573 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.765367 16468 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.771119 17550 raft_consensus.cc:1064] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:23.775949 17550 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.783897 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:23.784688 16544 raft_consensus.cc:606] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:23.787544 17126 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.796901 16615 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.800217 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:23.800822 16544 raft_consensus.cc:606] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:23.812080 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:23.812636 16544 raft_consensus.cc:606] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:23.817423 17581 raft_consensus.cc:993] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:23.817976 17581 raft_consensus.cc:1081] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:23.819852 16619 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.820971 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:23.821591 16544 raft_consensus.cc:606] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:23.822086 16542 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.825675 17550 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.825107 17126 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.829128 17570 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.832331 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:23.832906 16544 raft_consensus.cc:606] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:23.833382 16470 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:23.834789 17570 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:23.835808 16544 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.846647 16615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:23.930821 16615 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.931191 16615 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.930491 16468 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.912434 16365 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.916165 17580 raft_consensus.cc:993] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:23.935213 17580 raft_consensus.cc:1081] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:23.935458 16365 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.927644 17571 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:23.937121 17123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:06:23.937625 17123 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.937939 17123 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.944864 17581 raft_consensus.cc:993] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:23.945405 17581 raft_consensus.cc:1081] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:23.947014 17124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:06:23.947530 17124 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:23.947870 17124 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.954167 17123 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.959570 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:23.960211 16542 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:23.960506 16542 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:23.961186 16542 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.961849 16470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:23.962229 16542 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.962447 16470 raft_consensus.cc:606] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:23.971524 17124 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.973666 17124 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:23.974412 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:24.028299 16539 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.028649 16539 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:24.029506 16539 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.030709 16539 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.975073 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:23.978986 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:24.006970 16615 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.033222 16613 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:23.979592 17123 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:24.036552 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:23.983419 16470 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.037185 16538 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.037539 16538 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:24.038316 16538 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.039475 16538 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:23.983255 16467 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:23.993606 16542 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:24.010299 16544 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.017344 16541 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.018033 17594 raft_consensus.cc:993] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:24.053951 17594 raft_consensus.cc:1081] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:24.055744 17127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:06:24.056247 17127 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.056564 17127 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.059607 16538 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:24.033099 16619 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.046648 17123 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.045133 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:24.065176 16468 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.048398 16542 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.044484 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:24.070271 17558 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:24.070528 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:24.071475 17570 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.071933 17570 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:24.072151 17125 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.072847 17570 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.074281 17573 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.076951 16619 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.079275 17126 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.076323 17573 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.080641 17547 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.022910 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:24.082062 16614 raft_consensus.cc:606] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:24.083956 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:06:24.084610 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:24.085716 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:24.085137 17595 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.093657 17531 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.094607 16542 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.062038 16615 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:24.083591 17127 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.099730 17124 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.101418 17581 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.102455 17127 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:24.103463 16613 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:24.105759 17126 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.105901 17125 raft_consensus.cc:2955] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.110973 16470 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.113871 16468 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:24.114777 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92aeb38730a646668d4f528d66afd917 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.001310 16365 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.120318 17580 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:24.123095 16539 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.124305 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:24.133157 16538 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.135210 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.137789 17580 raft_consensus.cc:993] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:24.137827 16613 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.138958 16538 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:24.144970 16538 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.149624 16538 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.150429 17594 raft_consensus.cc:1081] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:24.154384 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:24.155387 16613 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.155766 16613 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.143894 17607 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.177651 16613 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.195055 16366 catalog_manager.cc:5697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.183408 16367 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.206845 16613 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:24.206588 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 122091us
I20260709 13:06:24.207748 17558 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:24.227795 17127 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.230906 16470 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:24.252569 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80632.6us
I20260709 13:06:24.257138 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:24.257970 16468 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.213194 17567 raft_consensus.cc:2955] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.265403 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:24.266026 16539 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.266342 16539 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:24.258754 17558 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.272643 16539 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.275377 16539 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.280623 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:24.281281 16613 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.283305 16539 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:24.289584 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:24.292879 16468 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:24.295328 16613 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.295568 16538 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.296043 17570 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.300242 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:24.302523 17606 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.303017 17606 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:24.303901 17606 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.310514 17595 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:06:24.366756 16613 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.373147 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 92aeb38730a646668d4f528d66afd917 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:24.378384 16365 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:24.401558 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 106445us
I20260709 13:06:24.414234 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df33d6051c004b71a5d0f086053be1fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.391462 17607 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:24.414405 16614 raft_consensus.cc:2955] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.412703 17125 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.414243 17570 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:24.465817 17610 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:24.486860 17616 tablet_replica.cc:333] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:24.487974 17616 raft_consensus.cc:2243] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.488677 17616 raft_consensus.cc:2272] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.469216 17607 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:24.512634 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47295.4us
I20260709 13:06:24.537932 17570 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:24.540759 17616 ts_tablet_manager.cc:1916] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.552989 17531 raft_consensus.cc:993] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:24.553737 17531 raft_consensus.cc:1081] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:24.555733 16538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:24.563254 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:24.556493 16538 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.566532 16366 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.567492 16538 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.569900 16367 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 3 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:24.576278 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 145878us
I20260709 13:06:24.582396 16542 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:24.586046 17611 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.591780 17609 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:06:24.598726 16468 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.600652 17123 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.609704 17550 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:24.612011 16539 raft_consensus.cc:2955] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.619524 16364 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.621523 16538 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:24.633476 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet df33d6051c004b71a5d0f086053be1fe with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:24.641808 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8de1d4f10dad40289b4f0b93992ff9b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:24.673832 16538 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:24.674506 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:24.674856 17622 tablet_replica.cc:333] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:24.675185 16468 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.675530 16468 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:24.676396 16468 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:24.677632 16468 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.683190 17622 raft_consensus.cc:2243] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.684589 17622 raft_consensus.cc:2272] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.686973 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:24.688228 16614 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.693760 17570 raft_consensus.cc:993] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:24.694257 17570 raft_consensus.cc:1081] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:24.696008 17123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:06:24.696544 17123 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:24.698709 17123 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.699064 16538 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:24.705619 17619 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:24.713848 17616 ts_tablet_manager.cc:1929] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:24.714331 17616 log.cc:1199] T 92aeb38730a646668d4f528d66afd917 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/92aeb38730a646668d4f528d66afd917
I20260709 13:06:24.716058 17616 tablet_replica.cc:333] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:24.717079 17616 raft_consensus.cc:2243] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.717868 17616 raft_consensus.cc:2272] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.722931 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 92aeb38730a646668d4f528d66afd917 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:24.731457 17616 ts_tablet_manager.cc:1916] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.743768 16614 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:24.744451 16613 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.738178 17123 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.741752 17622 ts_tablet_manager.cc:1916] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:24.748203 17607 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.770362 16613 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:24.771745 17606 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.773797 17123 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:24.768509 16468 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:24.785828 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:24.786767 17579 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.787492 17579 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:24.788380 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:24.780301 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:24.791492 16619 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:24.791849 16619 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:24.778424 16365 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:24.789847 17579 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:24.797181 16539 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.792614 16619 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.801625 16619 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:24.810379 16619 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.817633 17616 ts_tablet_manager.cc:1929] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:24.818168 17616 log.cc:1199] T df33d6051c004b71a5d0f086053be1fe P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/df33d6051c004b71a5d0f086053be1fe
I20260709 13:06:24.820451 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet df33d6051c004b71a5d0f086053be1fe (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:24.826228 16539 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:24.829084 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:24.832043 17607 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:24.832722 17607 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:24.833925 17607 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:24.881583 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 8de1d4f10dad40289b4f0b93992ff9b6 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:24.883373 16539 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:24.916281 16364 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.919636 16539 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:24.918632 17612 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:24.940528 17607 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:24.949184 16365 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.954632 16364 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.965844 17622 ts_tablet_manager.cc:1929] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:24.966487 17622 log.cc:1199] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/55e23c7e0edd4ed18d5cf6b93c2b1607
W20260709 13:06:24.970119 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48654.4us
I20260709 13:06:24.973959 16539 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:24.974704 17632 tablet_replica.cc:333] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:24.975795 17632 raft_consensus.cc:2243] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.977286 17632 raft_consensus.cc:2272] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.001483 17632 ts_tablet_manager.cc:1916] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:25.004158 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 55e23c7e0edd4ed18d5cf6b93c2b1607 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:24.988883 17606 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:06:25.022495 16615 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.025269 17633 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.051752 16364 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.083818 17632 ts_tablet_manager.cc:1929] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:25.084415 17632 log.cc:1199] T 8de1d4f10dad40289b4f0b93992ff9b6 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/8de1d4f10dad40289b4f0b93992ff9b6
I20260709 13:06:25.092373 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 8de1d4f10dad40289b4f0b93992ff9b6 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:25.093987 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.134073 16468 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.135200 17619 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.145140 16539 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.159590 17611 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.171679 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:25.214923 16538 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.216075 17606 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.225703 16468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:25.226305 16468 raft_consensus.cc:606] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:25.232717 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:25.233057 16613 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.233284 16464 raft_consensus.cc:606] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:25.236217 17606 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.236979 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8806363158d645279801d4633a1c7d74"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:25.237493 16464 raft_consensus.cc:606] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:25.244122 16613 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.245635 16542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:25.248508 16542 raft_consensus.cc:606] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:25.251407 17581 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.253186 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:25.253793 16613 raft_consensus.cc:606] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:25.256687 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:25.257269 16464 raft_consensus.cc:606] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:25.258467 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:25.259941 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.265691 16464 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:25.266886 17454 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.349493 17618 raft_consensus.cc:993] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:25.350000 17608 raft_consensus.cc:1081] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:25.351649 16542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:25.352264 16542 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.352643 16542 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.358059 16542 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.359997 16542 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.361059 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:25.361260 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.361649 16468 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:25.361824 16619 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.362010 16468 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:25.362720 16468 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.363826 16468 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:25.368691 16619 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:25.371779 16468 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:25.375137 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:25.376089 17454 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:25.376627 17454 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:25.377548 17454 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.391369 16365 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 3, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.411042 17618 raft_consensus.cc:993] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.411497 17608 raft_consensus.cc:1081] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.413094 17126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8806363158d645279801d4633a1c7d74"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53654
I20260709 13:06:25.413535 17126 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.413787 17126 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.418345 17618 raft_consensus.cc:993] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:25.418896 17608 raft_consensus.cc:1081] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:25.419616 17126 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.420527 16542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:25.421085 16542 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.421370 16542 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.421779 17126 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.422458 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:25.423107 16468 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.423043 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.423579 16468 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:25.423818 16619 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.424502 16468 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.425859 16468 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.428196 16542 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.428581 16619 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.429821 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:25.430254 16542 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.430696 17606 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.431214 17606 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:25.431778 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.432371 16619 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.432056 17606 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.432523 16468 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.433120 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:25.435930 16464 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.436280 16464 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:25.437186 16464 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.437947 16619 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:25.438391 16464 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.439137 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:25.439981 17454 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.440412 17454 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:25.441286 17454 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:25.445483 16464 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:25.448705 16365 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.460408 16366 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.598743 17579 raft_consensus.cc:993] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.599267 17454 raft_consensus.cc:1081] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.600802 17123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:06:25.601348 17123 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.601687 17123 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.606220 17123 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.608433 17123 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.608563 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:25.609407 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.609526 16542 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.610072 16542 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:25.610167 16619 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.610862 16542 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.612020 16542 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.616503 16619 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.617504 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:25.618312 17634 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.618605 16542 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.618846 17634 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:25.619736 17634 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.627885 16365 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.630138 17609 raft_consensus.cc:993] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.630755 17619 raft_consensus.cc:1081] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.633602 17126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53658
I20260709 13:06:25.634188 17126 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.634586 17126 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.640563 17126 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.641765 17618 raft_consensus.cc:993] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.642261 17608 raft_consensus.cc:1081] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:25.643251 17126 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.643916 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:25.644254 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.644577 16542 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.644500 17123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53654
I20260709 13:06:25.644929 16615 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.645179 17123 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.645361 16615 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:25.645620 17123 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.646255 16615 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.647235 16615 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.650364 17123 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.652637 16615 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.653827 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:25.654597 17634 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.655073 17634 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:25.655977 17634 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.656639 16542 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.658480 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:25.658624 17123 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:25.659103 16468 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:25.659440 16468 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:25.660581 16468 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.661916 16468 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.665261 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:25.665894 16615 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:25.669781 16468 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.671352 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:25.672099 17606 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:25.672573 17606 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:25.673568 17606 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:25.675328 16615 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:25.681631 16365 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.694085 16365 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.832136 16468 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.833287 17454 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.840085 16468 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.841454 17606 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:25.844357 16615 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:25.845688 17655 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:25.872275 16619 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:25.878021 17606 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.973438 16464 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:25.980253 16434 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fec5040680744828ce3ed1844be1ac1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:25.980695 16538 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:25.982214 17618 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.983400 16619 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:25.984635 17573 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:25.994201 17573 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:25.994439 16538 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:25.995143 16619 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.018062 16367 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.021659 16619 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.025957 17655 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.033949 16464 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.056131 16467 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:26.062927 17454 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.078836 16619 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.080555 17606 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.107072 16619 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.108855 17606 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.127554 16615 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:06:26.129000 16434 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13ae44ac0f4e496caaa8405cb3f946d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.129285 17669 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.133998 16611 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.137609 16468 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.130295 16538 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.146625 16538 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.146562 17618 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:26.150506 17634 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.163877 17607 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.164687 17634 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.181720 16544 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:26.189005 17634 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.208730 17608 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.211613 16611 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.223783 16538 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.240990 16539 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.255452 16364 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.260954 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.264387 16613 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.266242 16464 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.266454 17454 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.268034 17454 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:26.270434 16509 consensus_peers.cc:597] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 343fbc074bb94714900a4da026ab998a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.294992 17579 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.306277 16614 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.326012 16467 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:26.332864 16434 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6689ca00362248ce81b56252a62e85a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:26.336311 16614 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.336462 16539 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:26.341566 17573 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.343976 16366 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.345611 16467 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.346350 17669 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:26.347285 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.369153 17618 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.390348 16539 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.397171 16365 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.402431 16611 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:26.424486 17688 ts_tablet_manager.cc:933] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:26.433029 17688 tablet_copy_client.cc:323] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:26.435350 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 1fec5040680744828ce3ed1844be1ac1 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:26.435940 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 1fec5040680744828ce3ed1844be1ac1 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-1fec5040680744828ce3ed1844be1ac1
I20260709 13:06:26.443768 16480 tablet_copy_source_session.cc:215] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.446556 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fec5040680744828ce3ed1844be1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.458115 17688 tablet_copy_client.cc:806] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.458639 17688 tablet_copy_client.cc:670] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.460896 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:26.461475 16611 raft_consensus.cc:606] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:26.462255 17688 tablet_copy_client.cc:538] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.464135 16467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92aeb38730a646668d4f528d66afd917"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:26.464679 16467 raft_consensus.cc:606] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:06:26.467336 16542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:26.467845 16542 raft_consensus.cc:606] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:26.470044 17688 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:26.470424 16467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:26.470986 16467 raft_consensus.cc:606] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:26.472219 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:26.473726 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:26.492513 17688 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.493474 17688 tablet_bootstrap.cc:492] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:26.494119 17688 ts_tablet_manager.cc:1403] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:06:26.497068 17688 raft_consensus.cc:359] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.497694 17688 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:26.498356 17688 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.500738 17688 ts_tablet_manager.cc:1434] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:06:26.502405 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-1fec5040680744828ce3ed1844be1ac1 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:26.502797 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-1fec5040680744828ce3ed1844be1ac1 on tablet 1fec5040680744828ce3ed1844be1ac1 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:26.530900 17685 raft_consensus.cc:993] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:26.531431 17618 raft_consensus.cc:1081] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:06:26.532873 17123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92aeb38730a646668d4f528d66afd917"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53654
I20260709 13:06:26.533396 17123 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.533717 17123 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.539368 17123 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:26.541270 17123 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:26.541499 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:26.543044 16467 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.543371 16467 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:26.544054 16467 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:26.544870 17688 ts_tablet_manager.cc:933] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:26.545117 16467 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.546518 17688 tablet_copy_client.cc:323] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:26.548041 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 13ae44ac0f4e496caaa8405cb3f946d8 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:26.541739 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:26.548532 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 13ae44ac0f4e496caaa8405cb3f946d8 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-13ae44ac0f4e496caaa8405cb3f946d8
I20260709 13:06:26.549037 16542 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.553748 16542 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:26.554709 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:26.555464 17606 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.555860 16480 tablet_copy_source_session.cc:215] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.555951 17606 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:26.556931 17606 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:26.559945 16467 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:26.563057 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ae44ac0f4e496caaa8405cb3f946d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.571326 16365 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.588384 17688 tablet_copy_client.cc:806] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.588968 17688 tablet_copy_client.cc:670] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.592469 17688 tablet_copy_client.cc:538] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.628276 17688 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:26.665262 17688 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.665962 17688 tablet_bootstrap.cc:492] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:26.666487 17688 ts_tablet_manager.cc:1403] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.005s
I20260709 13:06:26.669006 17688 raft_consensus.cc:359] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.669653 17688 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:26.670281 17688 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.674829 17694 ts_tablet_manager.cc:933] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:26.685611 17688 ts_tablet_manager.cc:1434] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 13:06:26.693575 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-13ae44ac0f4e496caaa8405cb3f946d8 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:26.694025 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-13ae44ac0f4e496caaa8405cb3f946d8 on tablet 13ae44ac0f4e496caaa8405cb3f946d8 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:26.696884 17694 tablet_copy_client.cc:323] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:06:26.698550 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 343fbc074bb94714900a4da026ab998a from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:06:26.699065 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 343fbc074bb94714900a4da026ab998a from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-343fbc074bb94714900a4da026ab998a
I20260709 13:06:26.706688 16555 tablet_copy_source_session.cc:215] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.709904 17618 raft_consensus.cc:993] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:26.710347 17694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343fbc074bb94714900a4da026ab998a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.710680 17685 raft_consensus.cc:1081] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:26.712376 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:26.712908 16539 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.713276 16539 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.721323 16539 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.723186 16539 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:26.726203 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:26.726827 16468 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.727149 16468 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:26.727985 17694 tablet_copy_client.cc:806] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:26.727958 16468 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.728894 17694 tablet_copy_client.cc:670] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:26.729815 16468 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.732470 17694 tablet_copy_client.cc:538] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:26.732900 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:26.733482 16611 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.736459 17655 raft_consensus.cc:993] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:26.736989 17655 raft_consensus.cc:1081] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:26.739952 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:26.740497 16613 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:26.740917 16613 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.741266 16611 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:26.747768 16613 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.750101 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:26.750898 17579 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.751360 17579 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:26.752197 17579 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.755779 16468 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:26.750052 17694 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:26.766212 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:26.766837 16468 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.771560 17688 ts_tablet_manager.cc:933] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:06:26.773339 16613 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:26.773628 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:26.774775 16539 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:26.775225 16539 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:26.777580 17688 tablet_copy_client.cc:323] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:06:26.781211 16539 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.782613 16468 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:26.783226 16539 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:26.825800 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 6689ca00362248ce81b56252a62e85a9 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:06:26.824318 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:26.827106 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 6689ca00362248ce81b56252a62e85a9 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-6689ca00362248ce81b56252a62e85a9
I20260709 13:06:26.795890 17694 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:26.844967 17619 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:26.851203 17694 tablet_bootstrap.cc:492] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:26.853752 17694 ts_tablet_manager.cc:1403] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.004s
I20260709 13:06:26.876847 16365 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.900345 17123 raft_consensus.cc:1217] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:26.921789 16480 tablet_copy_source_session.cc:215] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:26.926635 17688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6689ca00362248ce81b56252a62e85a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:26.942955 16539 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:26.886577 17619 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:26.959961 17123 raft_consensus.cc:1217] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:26.949070 17619 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:26.966114 17694 raft_consensus.cc:359] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.967206 17694 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:26.968035 17694 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:26.983290 17694 ts_tablet_manager.cc:1434] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.004s
I20260709 13:06:27.010699 16464 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:27.027120 17609 raft_consensus.cc:993] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:27.027858 17700 raft_consensus.cc:1081] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:27.031566 17606 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.033249 16464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:06:27.034001 16464 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:27.034350 16464 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.047982 16464 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:27.059072 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-343fbc074bb94714900a4da026ab998a received from {username='slave'} at 127.0.0.1:37072
I20260709 13:06:27.059726 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-343fbc074bb94714900a4da026ab998a on tablet 343fbc074bb94714900a4da026ab998a with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:27.077920 16464 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:27.082084 16366 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.086067 17688 tablet_copy_client.cc:806] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:27.086663 17688 tablet_copy_client.cc:670] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:27.087095 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:27.087868 16611 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:27.088347 16611 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:27.089711 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:27.090430 16542 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.094118 16611 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:27.096074 16611 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:27.102126 16539 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:27.103633 17606 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:27.110526 17688 tablet_copy_client.cc:538] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:27.127689 16542 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:27.130059 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:27.131299 16611 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:27.131843 17685 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:27.138177 17685 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:27.139223 17685 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:27.140717 17688 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:27.158869 16366 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:27.288504 17123 raft_consensus.cc:1217] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.290688 16611 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.301564 17579 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.309021 17688 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:27.310647 17688 tablet_bootstrap.cc:492] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:27.311245 17688 ts_tablet_manager.cc:1403] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.171s	user 0.032s	sys 0.009s
I20260709 13:06:27.313876 17688 raft_consensus.cc:359] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:27.314623 17688 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:27.315295 17688 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:27.318863 17688 ts_tablet_manager.cc:1434] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:27.324223 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-6689ca00362248ce81b56252a62e85a9 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:06:27.324746 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-6689ca00362248ce81b56252a62e85a9 on tablet 6689ca00362248ce81b56252a62e85a9 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:27.329459 17123 raft_consensus.cc:1217] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:06:27.354966 16467 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.356374 17579 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.362066 17685 raft_consensus.cc:1064] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:27.366048 17685 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.385404 16538 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.387617 17609 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.388252 17123 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.388410 16611 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.390933 17608 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.391361 16542 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.392319 17685 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.402099 17608 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.417774 17685 raft_consensus.cc:1064] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:27.428356 17685 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.435333 17618 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.442677 16469 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.446028 17701 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:27.445186 17125 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.474794 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.490597 16366 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.493402 16614 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.502552 17126 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.503453 16613 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.505195 16544 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.506350 17720 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.498582 16542 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.508149 17721 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.523089 17608 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.559495 17685 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.566473 16544 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.570137 17720 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.575659 17125 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.580585 16467 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.595510 16542 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:27.620270 17718 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:06:27.621235 16538 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.624298 17722 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.624642 16613 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:27.629436 17721 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:27.637527 16364 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.638466 17125 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.642204 17721 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.644805 16539 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.656960 17720 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:27.647065 16611 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.674552 16464 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.675133 17125 raft_consensus.cc:2955] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.698448 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13ae44ac0f4e496caaa8405cb3f946d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:27.699371 17126 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.700889 17685 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.703254 16613 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:27.708261 17721 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:27.710837 17720 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.735304 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1fec5040680744828ce3ed1844be1ac1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:27.730609 17125 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.737346 16611 raft_consensus.cc:2955] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.750029 16364 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.773340 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ae44ac0f4e496caaa8405cb3f946d8 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:27.779181 16368 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.790680 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.794593 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 1fec5040680744828ce3ed1844be1ac1 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50260
I20260709 13:06:27.801458 17730 tablet_replica.cc:333] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:06:27.802609 17730 raft_consensus.cc:2243] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:27.803303 17730 raft_consensus.cc:2272] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:27.808678 17729 tablet_replica.cc:333] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:27.810024 17729 raft_consensus.cc:2243] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:27.810825 17729 raft_consensus.cc:2272] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:27.813679 17720 raft_consensus.cc:1064] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:27.820446 17659 raft_consensus.cc:1064] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
W20260709 13:06:27.820979 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.824388 17720 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.826284 17729 ts_tablet_manager.cc:1916] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:27.823979 17659 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:27.844085 17730 ts_tablet_manager.cc:1916] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:27.902001 16542 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.902001 17126 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.904207 16611 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.906457 17573 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.909125 17126 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.910912 17454 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.908643 17573 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:27.915241 17685 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.917984 17729 ts_tablet_manager.cc:1929] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:27.918504 17729 log.cc:1199] T 13ae44ac0f4e496caaa8405cb3f946d8 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/13ae44ac0f4e496caaa8405cb3f946d8
I20260709 13:06:27.920639 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 13ae44ac0f4e496caaa8405cb3f946d8 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:27.904871 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:27.923825 16464 raft_consensus.cc:606] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:27.927423 16464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84545dee228c4faea4411a58c683bb27"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:27.928742 16464 raft_consensus.cc:606] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:27.929383 17730 ts_tablet_manager.cc:1929] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:27.932343 17730 log.cc:1199] T 1fec5040680744828ce3ed1844be1ac1 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/1fec5040680744828ce3ed1844be1ac1
I20260709 13:06:27.932626 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:27.933257 16613 raft_consensus.cc:606] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:27.935014 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 1fec5040680744828ce3ed1844be1ac1 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:27.936288 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:27.937076 16539 raft_consensus.cc:606] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:27.940670 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:27.941223 16539 raft_consensus.cc:606] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:27.942478 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:27.941632 17608 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.944216 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:27.949473 16611 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.953274 17125 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.950491 16613 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:27.958384 17454 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:27.960963 16367 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:27.980908 16464 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:06:27.987491 17579 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:27.997649 16539 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.006299 17655 raft_consensus.cc:993] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:28.008315 17579 raft_consensus.cc:1081] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:28.006708 17454 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.014997 16469 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:28.023519 17125 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.025159 17720 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.032528 17573 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.041797 17125 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.047816 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6689ca00362248ce81b56252a62e85a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.049876 16367 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.056013 17126 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:28.061726 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55915.6us
I20260709 13:06:28.063683 16613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:28.064244 16613 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.064620 16613 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.067003 16365 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 1 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.077911 17454 raft_consensus.cc:993] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:28.078477 17739 raft_consensus.cc:1081] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:28.082571 16467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57652
I20260709 13:06:28.083657 16469 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.085335 16539 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:28.092075 17685 raft_consensus.cc:993] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:28.092628 17685 raft_consensus.cc:1081] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:28.094190 16542 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.096143 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84545dee228c4faea4411a58c683bb27"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:28.096729 16539 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.097179 16539 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.098601 17608 raft_consensus.cc:993] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:28.099035 16467 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.099110 17720 raft_consensus.cc:1081] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:06:28.098436 16611 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.102411 16544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:06:28.102804 17126 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.099625 16467 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.116971 16544 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.117435 16544 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.108024 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 6689ca00362248ce81b56252a62e85a9 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41778
I20260709 13:06:28.096575 16613 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.121539 17729 tablet_replica.cc:333] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:06:28.122572 17729 raft_consensus.cc:2243] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.123317 17729 raft_consensus.cc:2272] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.124198 16613 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:28.124334 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:28.124935 16538 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:28.125262 16538 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:28.125065 16544 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.125591 17659 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.126010 16538 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.127032 16538 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.129794 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:28.130439 16469 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.131618 16469 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:28.142601 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:28.143362 16463 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:28.143949 16469 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.146412 16469 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.133229 17655 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.150321 16467 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:28.150548 17685 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.152267 16467 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:28.136979 17125 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.153693 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:28.154389 16542 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.154692 16542 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:28.155514 16542 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:28.155942 16538 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:28.156690 16542 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.157317 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:28.108717 16539 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.159893 17701 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:28.160466 17701 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:28.159970 16539 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:28.170267 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:28.170848 17126 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.177361 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:28.155527 16540 raft_consensus.cc:2955] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.177986 16614 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.165704 16542 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:28.132941 17729 ts_tablet_manager.cc:1916] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.162683 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:28.183370 16468 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.183713 16468 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:28.166244 17619 raft_consensus.cc:993] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:28.179957 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:28.139026 16544 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:28.192888 17608 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.194414 17619 raft_consensus.cc:1081] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:28.192433 16468 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.196902 16468 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.196563 17701 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.195971 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:28.201433 16613 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.202682 17608 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:28.204087 16469 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:28.211161 17608 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:28.209438 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51267us
I20260709 13:06:28.210032 16468 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:28.229947 16463 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:28.226202 17126 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:28.268438 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 343fbc074bb94714900a4da026ab998a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:28.269124 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:28.270298 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52721.9us
I20260709 13:06:28.278270 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:28.280300 16614 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:28.287521 17747 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.307310 16463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:06:28.308017 16463 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:28.297902 17659 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:28.309029 17659 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:28.310017 17659 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.308449 16463 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.315686 16617 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:28.315531 17747 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:28.316749 17747 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:28.330286 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 200602us
I20260709 13:06:28.382844 16613 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
W20260709 13:06:28.398300 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 162810us
I20260709 13:06:28.403360 16615 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:06:28.362026 16463 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.433000 16463 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:28.459086 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:28.459800 16618 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:28.460103 16618 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:28.460161 16368 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:28.460922 16618 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:28.479213 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:28.479841 16538 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:28.503767 16538 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:28.509737 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:28.532047 16365 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 1 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.537768 17722 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:28.540792 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71307.8us
I20260709 13:06:28.555603 17722 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:28.574353 17729 ts_tablet_manager.cc:1929] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.575191 17729 log.cc:1199] T 6689ca00362248ce81b56252a62e85a9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/6689ca00362248ce81b56252a62e85a9
I20260709 13:06:28.574340 16364 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.556700 17722 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:28.598170 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 185059us
I20260709 13:06:28.615594 17454 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:28.619805 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 343fbc074bb94714900a4da026ab998a with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57620
I20260709 13:06:28.634580 16617 raft_consensus.cc:2955] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:28.646889 16618 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:28.670775 17755 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.208s	user 0.001s	sys 0.004s
I20260709 13:06:28.674484 16618 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:28.675181 17766 tablet_replica.cc:333] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:06:28.676069 17766 raft_consensus.cc:2243] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:28.676812 17766 raft_consensus.cc:2272] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:28.659212 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 6689ca00362248ce81b56252a62e85a9 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:28.681453 17766 ts_tablet_manager.cc:1916] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:28.688701 16367 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.700520 17766 ts_tablet_manager.cc:1929] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:06:28.701166 17766 log.cc:1199] T 343fbc074bb94714900a4da026ab998a P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/343fbc074bb94714900a4da026ab998a
I20260709 13:06:28.700481 16367 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.703146 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 343fbc074bb94714900a4da026ab998a (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:06:28.711179 17125 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:28.712836 17722 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:28.718688 16467 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.720628 17744 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:28.719977 16368 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:28.727311 16617 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.728658 17757 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:28.764142 16544 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:28.768044 16545 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:28.770643 17685 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:28.771989 17753 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:28.776216 16467 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.781217 17579 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.945225 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.954782 16467 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.956643 17655 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:28.983759 16617 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:28.986424 17739 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:29.003546 16538 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:29.009547 17720 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:29.508972 16617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.027s	sys 0.036s
W20260709 13:06:29.509356 16617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.027s	sys 0.036s
I20260709 13:06:29.598985 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.298108 17739 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:30.299232 17739 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:30.300110 17757 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:30.300751 17757 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:30.302946 17757 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:30.303198 17739 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:30.304256 17739 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.305194 17739 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.309068 17739 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:30.346448 16399 debug-util.cc:398] Leaking SignalData structure 0x7b0800034cc0 after lost signal to thread 15324
I20260709 13:06:30.350392 17739 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.350859 17757 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.352744 17739 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:30.353204 17757 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:30.363616 17757 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:30.363793 17739 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:30.437227 16538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.414s	user 0.008s	sys 0.012s
W20260709 13:06:30.438062 16538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.009s	sys 0.012s
I20260709 13:06:30.497421 17758 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:30.498171 17758 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.772524 17757 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.773267 17757 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:30.775568 17757 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:30.802966 17757 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:30.810699 17757 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.833415 17761 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.846956 17764 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.847733 17739 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.847600 17764 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.864993 17764 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:30.860011 17739 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:30.868398 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08000353a0 after lost signal to thread 16402
I20260709 13:06:30.872639 17764 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:30.849442 17758 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:30.889024 17764 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.941138 17764 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:30.941815 17764 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:30.942335 17764 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.909140 17758 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.944578 17764 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:30.837577 17761 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:30.966790 17764 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:30.970538 17761 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:30.975379 17739 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:30.954589 17758 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.008914 17781 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.009325 17750 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.009826 17788 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:30.983034 17739 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.016072 17750 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.040139 17789 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.040803 17750 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.012455 17786 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.040737 17789 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.041388 17750 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.042821 17787 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:31.043308 17092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.013s
I20260709 13:06:31.003892 17764 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:31.050108 17092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.005s	sys 0.013s
I20260709 13:06:31.047767 17791 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.050206 17782 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.039629 17739 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.046427 17786 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.060177 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1452) took 2037 ms. Trace:
I20260709 13:06:31.052256 17761 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.073424 17790 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.061764 16538 rpcz_store.cc:276] 0709 13:06:29.020917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.021081 (+   164us) service_pool.cc:224] Handling call
0709 13:06:29.021422 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.021784 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.021818 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.022315 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.438989 (+1416674us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:30.439072 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.439263 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.058286 (+619023us) raft_consensus.cc:1685] finished
0709 13:06:31.058305 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.058446 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2169,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":110,"thread_start_us":1415643,"threads_started":1,"wal-append.queue_time_us":1987992}
I20260709 13:06:31.045718 17788 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.048905 17750 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.066540 17758 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.087217 17786 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.071750 17739 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.066450 17761 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.074003 17790 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.045539 17781 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.059063 17787 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.072053 17782 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.102959 17761 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.103506 17761 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.103983 17761 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.106724 17787 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.107245 17787 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.107700 17787 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.096962 17796 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.066123 17791 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.109706 17794 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.109189 17796 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.120801 17785 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.123811 17750 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.117914 17789 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.124027 17764 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.133648 17792 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.127686 17750 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.136505 17783 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.124732 17785 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.138767 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1205) took 2148 ms. Trace:
I20260709 13:06:31.139133 16467 rpcz_store.cc:276] 0709 13:06:28.990490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.138012 (+2147522us) service_pool.cc:224] Handling call
0709 13:06:31.138329 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.138476 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.138500 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.138535 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:31.138561 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.138607 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.138711 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.141778 17781 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.141708 17750 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.143878 17790 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.144678 17750 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.144439 17783 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.146364 17655 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.142112 17795 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.152730 17789 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.152910 17784 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.150939 17655 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.150944 17796 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.154261 17739 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.154430 17797 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.154458 17789 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.160504 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.147706 17781 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.156198 17655 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.156435 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.148690 17787 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.162737 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.161177 16542 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.161875 16540 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.162444 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1253) took 2171 ms. Trace:
I20260709 13:06:31.162664 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.124219 17794 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.134326 17792 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.166054 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.166522 17619 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.159549 17797 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.158668 17784 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.161432 17609 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.164480 17781 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.168068 17619 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.168395 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.167508 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.178598 16542 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.178897 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.168002 16539 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:31.169320 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.163538 16617 rpcz_store.cc:276] 0709 13:06:28.988678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.988821 (+   143us) service_pool.cc:224] Handling call
0709 13:06:28.989074 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.989417 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.989445 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.989869 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.509760 (+519891us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:29.512593 (+  2833us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.160082 (+1647489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.160165 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.160207 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:31.160220 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.160338 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1647253,"prepare.queue_time_us":1500721,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":4859,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":521966,"threads_started":2,"wal-append.queue_time_us":2091611}
I20260709 13:06:31.180187 17125 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.180702 17751 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.179486 16544 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.164314 17788 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.184957 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.185516 17125 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.186314 17794 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.187181 17800 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.187762 17800 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.189841 17800 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.183048 17785 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.169288 17791 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.196758 17619 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.165709 17739 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.183128 17655 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.184203 17761 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.152763 17795 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.184132 17609 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.181263 17751 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.403082 17619 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.239431 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.205919 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.425745 17126 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.426021 16542 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:31.392428 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.430902 17619 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.323937 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.432960 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.194357 17752 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.245814 17745 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.436550 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.443969 17125 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.441097 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.398480 17722 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.443251 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.295002 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:31.452347 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 269988us
I20260709 13:06:31.453212 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.294860 17789 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.441787 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.293000 17685 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.222050 17742 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.221947 17798 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.322418 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.446606 17795 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.448465 17609 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.433842 17720 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.449229 17793 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.365366 17781 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.442589 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.449680 17762 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.450436 17619 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.472290 17619 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.472719 17619 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:31.442122 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.323791 17797 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.198475 17782 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.237623 17783 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.346869 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.465827 17739 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.319000 17792 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.456465 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.448496 17751 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.462179 17745 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.455263 17791 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.469465 16615 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.461478 17752 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.470618 17808 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.469062 17121 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.460436 17761 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.488330 17761 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.321147 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.245790 17784 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.488826 17761 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.489588 17752 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.472165 17720 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.490451 17791 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.490901 17791 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.444581 17655 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.480369 17809 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.457924 17722 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.484624 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.484941 17619 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.459952 17685 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.495325 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.501072 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.496548 17802 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.501739 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.502377 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.503950 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.504657 16542 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.502148 17802 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.509053 17802 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.502571 16541 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.512221 17090 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.513494 17807 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.491680 17792 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.510608 16509 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.514516 17619 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.513494 17810 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:31.515038 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 80800.6us
I20260709 13:06:31.515017 17619 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.519279 16509 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.516396 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.471421 17793 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.524736 16509 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.522861 17804 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.497301 17797 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.526854 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.469337 17742 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.515002 17795 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.502980 17744 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.509861 17751 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.534719 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.518278 17789 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.471438 17798 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.540884 17619 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.549471 17619 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.549484 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.549998 17619 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.551218 17619 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.551501 17619 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.551775 17619 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.518499 17792 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.523484 17739 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.552968 17619 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.553094 17792 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.553210 17739 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.553573 17619 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.553892 17739 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.554067 17619 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.557427 17819 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.557987 17819 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.559736 17819 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.560154 17819 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.522500 17802 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.488247 17808 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.523835 17720 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.560982 17802 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.561318 17720 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.561445 17802 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.561864 17720 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.563134 17808 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.563846 17808 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.529703 17788 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.563920 17720 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.564548 17788 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.565141 17788 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.566665 17720 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.548256 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.568270 17802 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.567221 17720 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.560518 17819 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.569350 17785 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.571412 17785 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.571281 17792 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.572002 17785 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.572546 17819 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.575080 17720 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.575080 17792 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.570673 17802 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.530381 17797 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.484436 17762 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.536881 17795 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.513684 17815 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.529975 17752 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.536846 17803 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:31.542238 17609 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.578105 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.546346 17789 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.579756 17742 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.533463 17807 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.620483 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.604063 17793 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.549117 16612 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.596093 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:31.600044 16399 debug-util.cc:398] Leaking SignalData structure 0x7b0800269a20 after lost signal to thread 16494
I20260709 13:06:31.622056 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.622150 17125 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:31.576793 17800 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.584869 17797 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.580332 17804 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.619144 17722 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.571033 17808 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.589771 17795 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.548538 17751 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.521332 17809 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.576160 17812 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.579308 17811 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.622704 16617 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.533432 17810 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.605330 17752 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.628314 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.595299 17803 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.617503 17789 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.636400 17720 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.633574 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:31.623378 16399 debug-util.cc:398] Leaking SignalData structure 0x7b0800269a60 after lost signal to thread 16495
I20260709 13:06:31.619403 17813 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.621798 17819 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.622078 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.618937 17815 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.626543 17818 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.623989 17800 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.576246 17744 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.631817 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:31.643631 16613 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.617765 17609 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.647032 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.657328 16618 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.645236 16619 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.645943 17803 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.655575 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.669238 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.649150 17685 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.640683 17816 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.674538 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.675112 16618 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.654409 17655 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.654259 17800 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.680620 16615 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:31.644958 17720 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.729805 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.730475 16617 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:31.683087 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.683312 17785 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.732134 16619 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.658490 17121 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:31.736545 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.652443 17820 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.685161 17818 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.740582 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.653825 17819 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:31.640921 17812 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.747368 17822 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.647068 17811 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.748207 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:31.752586 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 115393us
I20260709 13:06:31.659253 17821 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.746093 17816 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.753907 16583 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:31.756837 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.730355 17745 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.760751 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.761401 16611 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:31.682823 17739 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.732306 17828 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.765632 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.749996 17793 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:31.763849 17808 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.763854 17798 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.814664 17804 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.816107 17815 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.824609 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:31.821125 17757 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.811771 17722 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.811192 17793 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.829352 17120 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.830197 17720 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.807984 17745 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.830770 17609 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.841377 17825 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.850616 16544 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.824065 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.821820 17807 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.802129 17821 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.845477 17827 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.831522 17804 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:31.831231 17785 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.825855 17751 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.858448 16539 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.861225 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.868595 17800 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.660914 17813 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.755162 17820 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.833860 17809 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.851788 17752 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.876164 17804 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.830265 17744 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:31.879035 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:31.908201 16542 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:31.887735 17619 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:31.888449 16399 debug-util.cc:398] Leaking SignalData structure 0x7b0800366440 after lost signal to thread 16569
I20260709 13:06:31.869755 17825 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:31.872383 17720 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.849655 17745 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.806715 17828 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.918391 16467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:53502
I20260709 13:06:31.881052 17789 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.913642 17825 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.926194 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:31.915230 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:31.915484 17720 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.919119 16467 raft_consensus.cc:606] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:31.869724 17722 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.925393 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:31.907671 17804 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:31.926710 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:31.883040 17810 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:31.955852 17126 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.916337 17788 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.817399 17822 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.921069 17811 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.925433 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:31.927356 17685 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.914714 17791 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:31.970155 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 189644us
I20260709 13:06:31.956187 17819 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:31.964155 16399 debug-util.cc:398] Leaking SignalData structure 0x7b080032a0c0 after lost signal to thread 16643
I20260709 13:06:31.966338 17793 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.958477 17817 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:31.977823 16616 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:31.989718 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 235891us
I20260709 13:06:31.959997 17809 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:31.992561 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:31.991475 17122 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:31.996601 16468 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:31.988406 17739 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:31.986302 17815 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:31.976465 17685 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:31.886595 17827 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:31.995879 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:32.004400 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 198163us
I20260709 13:06:32.005373 17127 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:32.004577 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:32.001706 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8680 after lost signal to thread 17151
I20260709 13:06:32.010649 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.009809 16619 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:32.012562 16464 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.018728 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.019699 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.004925 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.021133 17816 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.020431 17806 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:32.019381 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd980 after lost signal to thread 17634
I20260709 13:06:32.010988 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.009066 17808 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.031797 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:31.996868 17817 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.012342 17800 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.030467 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.003415 17815 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:32.054608 17761 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.004s
I20260709 13:06:32.020424 17831 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.023568 17826 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.080598 17814 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.051442 17808 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.049620 17812 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.033160 17820 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.113610 17720 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.120339 17722 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.140194 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.161801 17793 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.162421 17793 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.162866 17793 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.080049 17761 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.123272 17826 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:32.163991 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 132294us
I20260709 13:06:32.149530 17791 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.191838 17123 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:32.178305 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0d00 after lost signal to thread 17721
I20260709 13:06:32.193431 16470 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.195159 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.196309 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.123278 17814 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.192584 17685 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.199615 17817 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.199806 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.199980 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.200364 17118 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:32.114024 17806 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:32.190442 17797 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:06:32.177448 17830 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.174400 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:32.195885 16399 debug-util.cc:398] Leaking SignalData structure 0x7b080033aae0 after lost signal to thread 17729
I20260709 13:06:32.178171 17788 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.206277 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:32.203012 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.202296 17810 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.211890 17810 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.212285 17810 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.212611 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.213483 16463 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.217666 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.221782 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:32.217280 17822 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:32.209662 17795 consensus_meta.cc:287] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:06:32.147289 17831 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:32.223284 17803 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.002s
I20260709 13:06:32.223834 17795 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.232282 16469 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.227118 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.229399 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.239907 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.240110 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:32.230993 17808 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:32.227985 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0ea0 after lost signal to thread 17749
W20260709 13:06:32.241619 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08000941a0 after lost signal to thread 17756
I20260709 13:06:32.231068 17758 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.242146 17795 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.242457 17758 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:32.242892 17758 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.243006 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.209810 16466 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.208688 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.219624 17797 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.225632 17739 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.251940 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.245146 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.253316 16616 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:32.254415 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.258672 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:32.246976 17800 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.237488 17827 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.274931 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.247242 17815 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.278741 16616 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:32.280303 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.271665 17119 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:32.233253 17803 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.256850 17831 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.251214 17739 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:32.287863 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.267627 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.270430 17783 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.310225 17783 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:32.310775 17783 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.311017 17797 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.227746 17830 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.270826 17757 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.315035 17757 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.315564 17757 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.284341 17786 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.306332 17739 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.307367 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.273481 17800 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.297267 17121 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.316921 16545 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:32.318009 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59449.7us
I20260709 13:06:32.319074 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.323220 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:32.323689 16541 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.325309 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.317718 17786 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:32.317433 17784 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.318156 17761 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.329728 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.324182 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.340651 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.321473 17800 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.341777 17840 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.345207 17814 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.346118 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.346617 17821 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.347295 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.348407 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.349112 17806 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.352886 17758 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.354930 17758 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.340256 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.356570 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.357692 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.344177 17784 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.361753 17784 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.363242 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.349303 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.364400 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.364948 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.365510 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.365978 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.326376 17573 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:32.320392 17804 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.350241 16541 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:32.350967 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.367925 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.371688 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.372130 17806 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.374897 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.374827 17793 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.375258 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.376087 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.334684 17786 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.377516 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:32.376729 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.377031 16612 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.387526 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.366591 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.379288 17573 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.379885 17803 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.380013 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.390089 17818 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:32.380574 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.391866 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.381268 16542 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.392812 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.392899 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:32.393541 16613 raft_consensus.cc:606] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:32.394006 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.395046 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.395527 16470 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:32.395677 16613 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.396256 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.397635 17804 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.397572 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.398387 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.381402 17762 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.366879 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.387147 17822 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.373185 17806 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.403482 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.390106 17573 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.400753 17800 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.360468 17783 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.404644 17573 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:32.408483 17783 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.408749 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.409240 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 98) took 1254 ms. Trace:
I20260709 13:06:32.409545 16540 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:32.409613 16538 rpcz_store.cc:276] 0709 13:06:31.154674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.155012 (+   338us) service_pool.cc:224] Handling call
0709 13:06:31.155245 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.184969 (+ 29724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.185014 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.185068 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.185110 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.409033 (+1223923us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b540024fed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:32.409081 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.409192 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67807616}
I20260709 13:06:32.410179 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.412256 17800 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.390115 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.408658 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.406934 17806 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:32.420140 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.420045 17825 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.420394 17806 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.421641 17806 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.402526 17822 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.408526 17573 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.424537 17822 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.425060 17573 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.381774 17793 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.407667 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.426908 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.427551 16464 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:32.416910 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.428424 16470 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:32.422495 16613 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.423604 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.429044 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.429443 16469 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:32.429600 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.428463 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.430310 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.431617 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.374264 17840 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.467257 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.413013 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.390295 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.474934 17126 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:32.478338 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 121560us
I20260709 13:06:32.478132 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.482456 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.481449 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:32.486872 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 129683us
I20260709 13:06:32.434765 17840 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.488262 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.488353 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.490214 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.499182 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:32.484338 17685 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:32.476331 17739 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.470793 17821 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:32.490302 17800 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.507668 17800 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.507761 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.508108 17800 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.508193 17813 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.509521 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:32.510394 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 87847.9us
I20260709 13:06:32.510699 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.511627 17813 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.511866 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.513787 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.514792 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.507330 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:32.481390 16462 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:32.490072 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.505493 17825 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.505935 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.506413 17745 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.507097 17819 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.487884 17810 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.518641 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:32.502368 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.519382 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.517827 17796 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.521492 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.521791 17796 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.522198 17796 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.522378 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.519805 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.518502 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.519179 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.504395 17802 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:32.501405 17803 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.523645 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:32.516844 17813 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.525403 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.525928 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.525226 17802 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:32.526052 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.527717 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.522691 17739 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.529618 16464 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:32.520459 17119 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:32.529174 17802 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:32.531108 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.530910 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.533327 17823 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.527886 17761 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.533973 17761 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.520327 17819 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:32.533921 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.530447 16470 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:32.525367 17821 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.525808 17803 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.536177 17819 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.535272 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:32.534504 17761 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.546025 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.538182 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.541100 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.541874 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.542838 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.548797 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.549468 17823 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.549942 17823 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.543735 17819 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.535014 17844 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.554811 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.546399 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:32.546748 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.550186 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.542601 17803 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.555559 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.555683 16467 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:32.556803 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:32.554548 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.550228 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.550729 17797 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.545624 17810 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.554996 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.563683 17750 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.567830 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.601981 16619 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:32.563057 17844 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.602710 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:32.567234 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 67660.4us
I20260709 13:06:32.567867 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.561841 17826 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.565840 17795 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.565871 17797 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.612936 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.615608 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:32.620198 17823 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.628894 16462 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:32.629056 17823 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.609727 17844 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.602965 17750 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:32.634081 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.613095 17794 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.600821 17757 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.622054 17795 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.622011 17797 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.612528 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.645551 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.643546 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.640264 17750 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.651609 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.651719 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:32.657775 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.631253 17810 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.663241 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:32.664275 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.664568 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.641667 17830 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:32.669109 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 106154us
I20260709 13:06:32.662860 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.653935 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.671277 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.654523 17789 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.674716 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.660100 17795 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.670822 17800 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.680946 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.679298 17824 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.663682 17804 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.682626 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.683535 16542 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:32.668193 17794 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.685484 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.685783 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:32.670256 17791 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.686645 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.656383 17786 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.694682 17786 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.669759 17822 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.695370 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.696448 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.697126 17822 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.697326 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.697532 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.697968 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.673689 17790 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.686434 16545 raft_consensus.cc:606] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:32.687951 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.684038 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.678110 17823 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.688935 17685 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:32.691098 17818 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.703938 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.700152 16509 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.706075 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:32.668848 17810 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.709301 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.706676 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.710438 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.711247 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.713179 16461 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.689972 17791 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:32.713361 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.713830 17807 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.696528 17796 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.715379 16539 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.707381 17834 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.717372 17800 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:32.728412 16511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.532s (SENT) [suppressed 57 similar messages]
I20260709 13:06:32.737748 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.685297 17804 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:32.729899 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 242029us
I20260709 13:06:32.706537 17757 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.698975 16543 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:32.714515 17811 raft_consensus.cc:993] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:32.715941 17805 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.734071 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.742890 16540 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:32.736621 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:32.728103 17123 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:32.739918 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.744434 17793 raft_consensus.cc:1081] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:06:32.744499 17119 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.745370 17805 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:32.731786 17758 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.750802 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.751032 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.741185 16544 raft_consensus.cc:2410] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:32.740309 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.732153 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.735867 17807 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.748579 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.733759 17791 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.754805 16470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:06:32.737174 17834 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.766080 16470 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.766525 16470 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.704448 17832 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:32.726817 17802 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.740885 17804 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.746013 17785 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.740865 17762 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:32.770188 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.756860 16536 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:32.765170 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.770367 17762 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.771082 17119 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:32.771302 17762 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.771551 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.772518 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.752418 17812 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.777153 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.780591 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.785220 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.787081 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.789458 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.791239 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.792802 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.794174 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.788434 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.807173 16468 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:32.808408 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:32.810103 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.811599 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.815775 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.817330 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.833128 16540 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:32.818922 16545 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:32.819821 16536 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:32.821084 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.822244 16542 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:32.826191 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44656.9us
I20260709 13:06:32.759418 17807 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:32.828220 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 51141.9us
W20260709 13:06:32.844823 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 116446us
I20260709 13:06:32.845378 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.766175 17834 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.832036 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.768546 16463 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:32.840499 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.778474 17812 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:32.844413 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.850306 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.842983 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:32.772012 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:32.832669 17825 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.865258 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:32.866496 17745 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:32.849555 17793 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.867944 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:32.828624 17803 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:32.876713 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.863794 17812 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.879870 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.870990 17799 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:32.886788 17573 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.887189 17573 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:32.889153 17796 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:32.889657 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.890861 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.859263 17801 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:32.778206 17805 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.872666 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:32.896313 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:32.897547 17801 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:32.897915 17801 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:32.898753 17801 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.883095 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:32.945073 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 48790.8us
I20260709 13:06:32.951064 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:32.929553 16470 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:32.957610 17785 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:32.959842 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:32.961421 16470 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:32.979413 17810 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:32.981041 17801 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:32.899921 17799 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:32.990962 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:33.032652 16583 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43cea492ee7e4f91b2ad509449c832f1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:33.033283 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 49858.6us
W20260709 13:06:33.038076 17848 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:06:33.042476 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:33.044194 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.045876 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:33.048581 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.055022 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:33.047386 17785 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.052357 17835 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.056561 17797 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.057163 17835 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:33.057562 17835 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.058372 17127 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.061600 17797 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.051215 17802 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:33.066155 17762 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.051745 17804 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:33.071071 17804 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.073470 16618 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.074489 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.075721 17750 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.067744 17762 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.051224 17803 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.084654 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.090636 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.091217 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.092011 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.091591 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.092517 17811 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:33.092060 16539 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.093096 17811 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.093703 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.094235 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.094673 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.094931 16542 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.095202 17811 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.095690 17811 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:33.095875 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.095901 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.096138 17811 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.096035 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.096626 16545 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.097270 17797 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.111004 17797 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.111811 17807 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.112223 17797 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.113327 17835 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.116258 16465 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:33.101084 17844 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.117158 16543 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.118155 17844 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.082929 17799 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:33.118736 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.119439 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:33.102417 17840 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.002s
I20260709 13:06:33.107306 17791 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.108006 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:33.108561 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:06:33.100385 17761 consensus_meta.cc:287] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 13:06:33.125351 17809 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.126402 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:33.126891 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.132121 17838 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.132508 17838 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.133859 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.135167 16541 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.134070 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.136014 17818 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.136283 16545 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.139232 17814 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.139385 16542 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:33.139436 16543 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.133204 17825 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.131474 17761 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.141742 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.142531 16536 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.142419 17761 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.142993 17125 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.143587 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.146226 16541 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.146502 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.147437 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.148824 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.148838 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.149462 17791 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.149744 16543 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.149797 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.150213 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.151062 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.151826 16536 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.152519 17793 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.152923 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.153096 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.153554 17793 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.153733 16542 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.153972 17793 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:33.128954 17840 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.154395 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.154899 17793 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.155601 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:33.156136 17793 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.156203 17840 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.157052 16538 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:33.157469 17701 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:33.157963 17701 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.158593 16537 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.158677 17838 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.160488 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.161381 17807 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.161546 17573 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.162206 17750 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.162431 17573 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.165181 17838 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.165310 16619 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.167119 17701 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.147092 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.166929 17795 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.168421 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.148290 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.178062 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.173261 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.173272 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.127170 17835 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:33.180666 17790 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:33.185931 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.181783 17811 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.182730 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.184417 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.184967 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.187309 17818 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:33.187849 17809 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.183199 17814 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.190552 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.190722 17789 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.184033 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:06:33.193544 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 62288.3us
I20260709 13:06:33.201994 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:33.193993 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.196313 17790 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.196491 16614 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:33.196635 16617 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:33.190929 17794 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:33.198339 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.198432 17798 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.199393 17821 raft_consensus.cc:2764] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:33.194686 17573 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.198652 17818 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:33.206063 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.212746 17090 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.203074 17835 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.203236 17791 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.211076 17701 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.198104 17828 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.198807 17822 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:33.215382 17818 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.211163 17722 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.209136 17790 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.218290 17801 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:33.216848 17847 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:06:33.221191 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.221232 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.207084 17793 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:33.226756 17855 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.230690 16461 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:33.230818 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.225914 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.211817 17809 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:33.218474 17701 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:33.235190 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.235623 17701 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.234041 17857 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.218519 17789 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.236141 17857 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:33.220602 17798 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.237824 17857 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.247830 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.225431 17807 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.249780 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.252833 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.254990 17573 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.255026 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.256556 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.256989 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.257052 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.257678 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.259522 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.260306 17573 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:33.261176 17573 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.261510 17573 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.260450 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.262167 17573 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.262794 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.263113 17573 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.233709 17812 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.253038 17822 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.250085 17814 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:06:33.264598 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.252743 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.255848 17811 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.257437 17828 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.257530 17825 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.275218 17795 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.261232 17809 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.246534 17834 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.265702 17821 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.263017 17854 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.266817 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.291709 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:33.259268 17855 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:33.299016 16616 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:33.304421 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 91763.5us
I20260709 13:06:33.305439 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.306409 17791 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.307878 17812 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.257822 17790 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.294117 17836 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.301754 17814 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.317943 17122 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.322676 17859 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:33.313706 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 54244.3us
I20260709 13:06:33.293609 17856 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.324667 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.324663 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.326470 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:33.316574 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51987us
I20260709 13:06:33.329470 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.330194 17859 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.330654 17834 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.331728 17860 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.299803 17822 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:33.333501 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 135196us
I20260709 13:06:33.336025 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.336133 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.334707 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.338493 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.338589 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.316045 17791 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.340062 17789 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.333853 17795 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.340512 17791 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.341005 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.341750 17791 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.335572 17854 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.342789 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:33.344547 17762 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.345005 17762 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:33.347273 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.345423 17742 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.348788 17856 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.349128 17847 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.345021 16537 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.364128 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:33.365598 17127 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:33.352543 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.358387 17701 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.366106 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.337782 17860 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.351998 17120 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.353718 17122 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.372999 17823 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:33.334172 17822 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.374495 17822 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.375265 17786 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:33.375778 17822 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.376312 16364 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 257) took 1794 ms. Trace:
I20260709 13:06:33.376420 17786 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.376796 16364 rpcz_store.cc:276] 0709 13:06:31.581451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.581589 (+   138us) service_pool.cc:224] Handling call
0709 13:06:33.376226 (+1794637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252695,"reported_tablets":6,"spinlock_wait_cycles":225536}
I20260709 13:06:33.377496 17786 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.377867 17786 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.347322 17834 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.355719 17762 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.347630 17865 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.355155 17854 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.384441 17796 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.358265 17818 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.386341 17796 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.384441 17685 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.387943 17685 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.388175 17796 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.389169 17685 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.390281 17685 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.393790 17835 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.394205 17835 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:33.362054 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 100396us
I20260709 13:06:33.363803 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.363301 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.395341 17745 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.368695 16618 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.395076 17822 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.395491 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.370728 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:33.367586 17847 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.363390 17812 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:33.371703 17817 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.372758 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.372408 17860 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.367226 17836 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.409214 17750 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:33.409626 17750 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.378070 17701 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:33.378536 17739 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.400786 17822 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.411437 17750 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.412750 17750 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:33.380748 16368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 245) took 1078 ms. Trace:
I20260709 13:06:33.414444 16368 rpcz_store.cc:276] 0709 13:06:32.302365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.302610 (+   245us) service_pool.cc:224] Handling call
0709 13:06:33.380690 (+1078080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":796172,"reported_tablets":1}
I20260709 13:06:33.383581 17862 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.415591 17862 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.383999 17762 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.383863 17786 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.417421 17786 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.389712 17796 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.369118 17123 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.369437 17864 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.397599 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.399544 17847 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.401561 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.405362 17823 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:33.406360 17806 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.406495 17790 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.406584 17722 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.400563 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.428306 17846 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.427001 17859 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.411835 17739 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.358210 17857 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.421325 16466 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.421159 17834 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:33.421161 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.416503 17862 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.424053 17125 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.425755 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.427320 17838 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.426151 16367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 160) took 2304 ms. Trace:
W20260709 13:06:33.427688 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 55015us
I20260709 13:06:33.427124 17722 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.428089 17823 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.430192 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.422223 17812 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:33.424309 17805 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.429239 17822 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.427021 17806 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.426028 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.462791 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.457842 17122 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:33.470364 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.463406 16367 rpcz_store.cc:276] 0709 13:06:31.121346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.121485 (+   139us) service_pool.cc:224] Handling call
0709 13:06:33.424926 (+2303441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":704613,"reported_tablets":6}
I20260709 13:06:33.467598 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.433413 17821 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:33.466295 17834 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.457378 16537 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.471921 17834 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:33.472716 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.472815 17834 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.474083 17834 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.476827 17835 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.468283 17784 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.478024 17835 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.478504 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.480557 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:33.480942 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.468458 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.482321 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.483047 17745 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.483446 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.483755 17745 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.464046 17722 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.462911 17846 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.469520 17806 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.464178 17823 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.483132 17836 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.459117 17862 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.484661 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.455827 17854 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:33.486958 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60973us
I20260709 13:06:33.495141 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.484351 17811 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.493165 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.493677 17819 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.484989 17722 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.499851 17864 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.500800 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.496578 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.498659 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.499532 17844 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.491943 16465 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:06:33.487914 17784 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:33.506348 17784 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:33.506803 17784 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.502216 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.504377 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.504887 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.510139 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.510738 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.511000 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:33.511986 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.513453 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.514523 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.515336 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.517417 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.525727 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.526010 16544 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.526948 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.502552 17790 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:33.522892 17810 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.527987 17868 ts_tablet_manager.cc:933] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.529371 16367 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.500486 17838 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.502660 17836 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.534562 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.534658 17861 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.529258 17864 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.516979 17844 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.536165 17841 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.529480 17822 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.509076 17762 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.503412 17800 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:33.508980 17857 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.536090 17838 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.521006 17685 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.529644 17806 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.530618 17794 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.507642 17832 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:33.548625 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.555270 16541 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.501277 17739 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.559237 16542 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.552592 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.541687 17819 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:33.564246 17832 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.560825 17794 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:33.565217 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.547720 17742 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:33.561077 17818 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:33.572721 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.546118 17864 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:33.577369 17821 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.565079 17701 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.577924 17821 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.578806 17821 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.572567 17812 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.581089 17742 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.581535 17742 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:33.582437 17742 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:33.578703 17794 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.584301 17794 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.584419 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:33.593528 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.593890 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:33.594224 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 78929.4us
I20260709 13:06:33.595034 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.596278 16511 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.597146 17802 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.592500 17739 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.600289 17762 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.570652 17832 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.580404 17821 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.602900 17832 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.607796 17832 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.608408 17811 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.611043 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.611544 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.571756 17857 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:06:33.611740 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.592085 17742 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.615903 17826 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.616393 17802 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.616663 17745 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.609223 17786 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.617069 17864 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.617174 17867 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.619029 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.566751 17859 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:33.620820 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:33.604725 17784 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.639387 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.640550 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.620234 17838 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.641750 17838 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.633517 17826 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.639837 17745 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.643512 17826 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.643925 17802 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.644891 17836 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.645594 16616 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.649878 17786 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.644663 17826 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.653903 16536 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.650563 17802 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.655428 17859 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:33.666774 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.670189 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.674471 17840 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.675307 17818 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.675743 17818 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.676116 16537 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.682189 17834 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.682868 17868 tablet_copy_client.cc:323] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:33.683135 17835 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.683535 17835 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:33.676512 17818 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.684481 17818 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.684361 17835 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.685678 17835 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.687144 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.691574 17800 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.693106 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.693845 17800 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.695405 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.694897 16466 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.696110 17786 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.699782 17859 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.702527 16616 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.706562 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:33.703152 17800 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:33.708045 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.708637 17800 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.709021 17800 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.709350 16610 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.709781 17800 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:33.710269 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.710780 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.711009 17800 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.711958 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.712392 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.714749 16616 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.715476 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.717167 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.717345 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.718439 16616 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.703333 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 43cea492ee7e4f91b2ad509449c832f1 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:33.722671 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.724704 16618 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.722194 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 43cea492ee7e4f91b2ad509449c832f1 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-43cea492ee7e4f91b2ad509449c832f1
I20260709 13:06:33.741511 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.741775 16365 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:33.700932 17786 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:33.751497 17122 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:33.741511 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:33.744159 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:33.769054 17785 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:33.770146 17785 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.770462 17785 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.752938 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.771251 17785 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.748749 17739 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.772533 17785 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:33.790381 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:33.797578 17871 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:33.780849 17810 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:33.802140 17810 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.802501 17810 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.802631 17846 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:33.803310 17810 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:33.780424 17764 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:33.814884 17764 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.815271 17764 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.817739 17841 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:33.818136 17841 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.823115 16463 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.796274 17784 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:33.782732 16466 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:33.826423 17796 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:33.829277 17122 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.816133 17764 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.842937 17125 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:33.835048 17810 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:33.835886 16462 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:33.834120 17838 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:33.866662 16434 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:33.860176 17764 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:33.687644 17685 consensus_queue.cc:1175] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8e851f11d27b4a83aa395e05c4be6808" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:06:33.485510 17860 consensus_queue.cc:1175] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98881185daee4f13b69385e36026216c" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:33.869407 17832 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:33.882876 17832 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:33.893647 16610 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:33.896903 17806 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:33.890900 16461 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:33.933809 16467 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:33.943789 17832 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:33.948993 16628 tablet_copy_source_session.cc:215] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:33.956866 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 181485us
I20260709 13:06:33.961977 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:33.964006 17785 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.964109 17784 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:33.965516 17803 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:33.965888 17803 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:33.971508 17800 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:33.971212 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.994321 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:33.995023 16470 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.006155 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:33.991393 17844 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:34.007354 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.009356 17786 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.001144 17859 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:34.011623 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.017710 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.021493 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.018873 17818 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.989159 17841 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.082739 17841 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.047335 17818 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.094676 17818 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.030963 17802 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.096517 17802 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.097613 17802 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.101876 16536 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.102119 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.102443 17784 raft_consensus.cc:993] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:34.102782 16544 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.102955 17844 raft_consensus.cc:1081] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:34.029085 17764 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.075413 16462 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.078214 17868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43cea492ee7e4f91b2ad509449c832f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:34.103717 17764 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.104689 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.104645 17764 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.105425 17125 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
W20260709 13:06:34.108152 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 84924.8us
I20260709 13:06:34.110797 16434 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.113489 17722 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.113927 17722 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.114287 17722 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.117961 16614 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:34.118516 16616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:34.119084 16616 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.119441 16616 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.120996 16462 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.122394 17859 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.127291 17803 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.128712 17803 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.130466 16616 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.079368 16610 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:34.001930 17846 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:06:34.018142 17881 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:34.131973 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.144114 16368 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.150384 16368 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.152515 16368 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.161681 16616 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.164398 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:34.165176 16462 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.174372 17802 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:34.174662 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.174871 17802 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.177162 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.177899 16544 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:34.178265 16544 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.179183 16544 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.175915 17802 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.188661 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:34.192329 17764 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.192862 17764 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.193698 17764 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.171213 17794 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:06:34.205595 16544 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.206020 17785 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:34.206430 17785 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.214596 16544 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:34.205663 16610 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:34.216349 17794 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.218676 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.222980 17742 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:34.223541 17742 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:34.206364 16462 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:34.227771 16466 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:34.234805 17785 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.236152 17785 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.239338 17802 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.224537 17742 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.253731 17722 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.274755 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.275314 16544 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.280117 17722 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.282135 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:34.282747 17125 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.282858 16544 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.287990 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:34.289554 17125 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.289045 17722 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.293392 17722 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:34.294220 17722 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.302356 17868 tablet_copy_client.cc:806] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:34.303143 17868 tablet_copy_client.cc:670] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:34.308591 17868 tablet_copy_client.cc:538] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:34.296854 16368 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.319343 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.320395 17868 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:34.354664 16367 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 2 to 3, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.367571 16364 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.369947 16364 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.371748 16364 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.387094 17868 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:06:34.390497 17868 tablet_bootstrap.cc:492] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:34.391161 17868 ts_tablet_manager.cc:1403] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.004s
I20260709 13:06:34.394058 17868 raft_consensus.cc:359] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.395411 17868 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:34.396044 17868 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:34.400894 16367 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.402225 17868 ts_tablet_manager.cc:1434] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:34.410097 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-43cea492ee7e4f91b2ad509449c832f1 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:34.410555 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-43cea492ee7e4f91b2ad509449c832f1 on tablet 43cea492ee7e4f91b2ad509449c832f1 with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:34.440541 16536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:34.441148 16536 raft_consensus.cc:606] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.441473 16536 raft_consensus.cc:614] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:34.444248 16536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:34.444849 16536 raft_consensus.cc:606] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.446038 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:06:34.447118 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.470403 17841 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.470942 17841 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.473724 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.473779 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.474500 17125 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:34.475674 17841 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.475677 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.476572 17841 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.477006 17841 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.477306 17841 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.480166 17722 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.480669 17722 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.482987 17722 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.483445 17841 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.484740 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.487475 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.488090 16618 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.488138 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:34.488664 17125 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.491688 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:34.495227 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.495466 17125 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:34.496506 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.497087 17832 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.497450 17802 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.497455 17832 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.497983 17832 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.498049 17802 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:34.498979 17802 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.503604 16536 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.508103 17841 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.522979 16368 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 4, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.538221 16536 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:34.540696 17832 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.543078 17860 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:34.544528 17832 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.546198 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:34.547361 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.547902 16618 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.555981 16618 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.561556 16461 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.567296 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:34.568343 17685 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.568924 17685 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:34.569738 17685 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.570582 17841 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.567445 17125 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:34.577546 17806 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:34.603914 16618 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.607842 17802 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.622440 16365 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.651276 17685 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.652019 17685 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.654942 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.655570 16536 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.656724 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:34.656809 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.657472 16618 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.657495 17832 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.659677 17832 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.660027 17832 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.661432 17685 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.663781 16462 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.665525 17745 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.666908 17745 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:34.667383 17745 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.668875 17832 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.670104 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.670892 16536 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:34.671613 17832 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.672991 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.673087 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.673609 16536 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.674165 17742 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.673691 16618 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.674629 17742 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.677804 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.678481 16544 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:34.678509 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.679275 16461 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:34.679849 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.680606 17867 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.676715 17742 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.680987 17867 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.681871 17867 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.685374 16610 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.692456 17802 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.696691 16544 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.697925 16462 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.698391 17835 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.700156 17802 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.703723 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.708416 16618 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.710072 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.704416 17125 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:34.712816 16583 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:34.712024 17862 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.703212 17745 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.715740 17835 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.720683 16618 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.717154 17860 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:34.720527 17835 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:34.728466 16618 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.728942 17860 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:34.731312 17846 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.730636 17835 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.731913 17860 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.720386 17862 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.731894 17125 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:34.737169 17806 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.738708 17862 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.740168 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.740254 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.740904 16542 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:34.742143 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.743347 17862 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.743781 17862 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.744166 17862 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.745942 16536 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.751416 17862 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.767213 17823 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.751662 17867 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.756502 17835 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.767824 17823 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.772035 16462 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:34.771955 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:34.772955 16463 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.773919 17823 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.774433 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.775014 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:34.775856 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.776314 16616 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:34.777758 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.778353 16614 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:34.778498 17823 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:34.778952 17823 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.779294 17823 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.780982 17867 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.784065 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.784335 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.784799 16542 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:34.784878 16544 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.798776 16544 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:34.800246 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.802532 17745 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.821090 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.821712 16616 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.804018 17835 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.818354 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:34.832916 16544 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:34.809988 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.833299 17122 raft_consensus.cc:2368] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:34.839314 16462 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:34.840333 16536 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.813599 17685 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:34.815099 17862 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.847821 17745 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:34.850047 17745 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.852953 16583 leader_election.cc:400] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:34.853372 16583 leader_election.cc:403] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:34.855446 16463 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:34.856840 17832 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:34.858911 17802 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:34.859727 17867 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:34.860224 17867 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.862212 17867 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.862555 17685 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:34.869684 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.870167 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.870428 16614 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:34.870908 16544 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.865926 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.873529 16542 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:34.848446 17860 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.874317 17860 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.876307 17860 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.878444 17764 raft_consensus.cc:993] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:34.878726 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.879922 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.880628 17122 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:34.882804 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.883679 17836 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.884079 17836 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:34.884446 17836 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.864640 17685 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.892060 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.892345 16536 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:34.892812 16543 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.893996 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.895025 17823 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.895016 17685 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.896006 17685 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:34.896368 17685 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.898581 16616 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:34.899077 17835 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:34.902220 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.902740 17811 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:34.903388 17811 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.904291 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:34.902390 17823 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.905190 17823 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:34.906237 17811 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.906909 17832 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.907375 17832 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.907799 17832 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.908367 17811 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:34.909132 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.909736 16616 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.908934 17811 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.913219 17860 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.913924 17860 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.914784 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.916160 17835 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.916884 17835 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.921375 17785 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.921859 17785 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:34.923622 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48283.1us
I20260709 13:06:34.929841 17764 raft_consensus.cc:1081] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:34.929903 17867 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.932552 17867 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.935554 17685 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:34.936108 17785 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.937112 17867 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.937724 17802 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.937124 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.938195 17802 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.938704 16542 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:34.939925 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.941303 17742 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.941771 17742 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.942224 17742 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.942256 17806 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.943087 17806 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.944473 17685 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.942094 17836 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.945806 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.946390 16618 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:34.942137 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.947589 16544 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:34.948378 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:34.946875 17836 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.948601 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.949177 16610 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:34.950053 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:34.950453 17685 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.949448 17806 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.953083 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.953326 17811 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.950838 17818 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:34.953907 17818 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.954052 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:34.954331 17818 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:34.954831 16536 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:34.957088 17823 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:34.948539 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.960656 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:34.961356 16537 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:34.949585 17764 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.962617 17764 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.964831 17764 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:34.965523 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55706.9us
I20260709 13:06:34.965799 17823 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.967530 17806 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.968211 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:34.968079 17806 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.968950 17917 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:34.969450 17917 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.970288 17806 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.971467 17917 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.971832 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.972438 16610 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:34.973516 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.974041 17917 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:34.974330 17806 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:34.967482 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.974735 17806 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.974530 17917 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.975118 17806 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.971432 17835 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:34.976598 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.975209 17122 raft_consensus.cc:2368] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:34.977418 16462 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:34.979183 17835 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.979403 17918 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.979929 17918 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.980352 16583 leader_election.cc:400] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:34.980808 16583 leader_election.cc:403] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:34.981383 17834 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:34.982012 17918 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:34.983247 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.984052 17122 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:34.985705 17722 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:34.986366 17722 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.989259 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:34.991081 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.991441 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.992098 17120 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:34.992439 17745 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.992950 17745 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:34.976526 17917 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:34.995553 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:34.996254 16614 raft_consensus.cc:2368] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:34.995939 17835 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:34.997200 17093 leader_election.cc:400] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:34.997478 17093 leader_election.cc:403] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:34.997844 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.998159 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.998446 16461 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:34.998396 17806 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:34.999142 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:34.999369 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:34.998468 17722 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.000005 16469 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:35.000624 17722 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.000974 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.000519 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.001303 17722 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.001818 16610 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 2: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:35.001741 16537 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.002334 17847 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.003429 17722 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.004000 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.004796 16614 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:35.005153 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:34.999778 17122 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:34.940126 17802 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.006389 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.006884 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.007249 16543 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.007283 17745 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.007608 17918 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.008020 17918 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:35.008392 17918 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.008842 17867 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.009335 17867 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.009667 17867 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.009989 17818 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.012900 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.008560 17123 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:34.951496 17860 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.015134 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.006283 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.025995 16509 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.026724 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.026989 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:35.027369 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.028689 17123 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.029556 17125 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.031883 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.000450 17806 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.037972 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.041137 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.041522 17125 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:35.042032 17123 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:35.044516 16542 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.045856 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:35.047156 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.049656 17930 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.050796 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.051376 16539 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.052233 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.053020 16540 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:35.010371 17832 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.055761 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.025605 17722 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.054692 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.025446 17802 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.953094 17685 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.056598 17125 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.061159 17123 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:35.034304 17922 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.031360 17917 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.065231 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 140093us
I20260709 13:06:35.050195 17930 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.046136 17919 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.034909 17860 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.034299 17862 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.044384 17811 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.075485 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.075642 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.076102 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.065580 16616 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:35.044235 17785 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.059165 17806 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.074259 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.085258 16470 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:35.090880 17924 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:35.072131 16614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:35.093256 16614 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:35.093726 16614 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.091686 17924 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:35.066934 17685 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.064299 17722 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:35.070075 17922 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.065176 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:35.109946 17924 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.074501 17860 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.074618 17862 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.071969 17930 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.071296 17818 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.082213 17785 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.167934 16466 raft_consensus.cc:2368] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3.
I20260709 13:06:35.070247 17802 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.195482 16539 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:35.150942 17722 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.199167 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.075846 17917 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.171332 17922 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.185024 16610 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.081969 17742 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.233338 16618 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:35.234304 17742 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.184265 17862 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.184430 17860 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.216118 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.077195 17919 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.250475 16543 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.222270 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.261829 16536 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.262814 17802 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.226181 17125 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:35.229102 17928 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.228760 16368 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.230152 17832 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.244179 16614 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.244339 17685 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.219873 17835 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.192750 17785 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.251066 17123 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:35.275970 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 232809us
I20260709 13:06:35.281054 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.281663 16539 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:35.286610 17938 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.288826 17123 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.290794 16614 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.295907 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.298055 17835 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.298522 17835 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.298955 17835 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.303454 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.304015 16538 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.304270 16538 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:35.304924 16538 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.305747 16538 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.319434 17811 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:35.320796 17811 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:35.326763 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46611.8us
I20260709 13:06:35.329506 17832 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.330109 17832 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.335867 17925 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.335947 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.336647 16541 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.336534 17925 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.338644 17925 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.338665 17832 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.343912 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.344436 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.344604 16539 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.344040 16541 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.264190 17834 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4.
I20260709 13:06:35.348433 17685 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.349604 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.313835 17923 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.287376 17938 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.379238 17942 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.374511 17806 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.271294 17802 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:06:35.269285 17867 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.398350 17685 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.420869 17685 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.377261 17742 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.268970 17918 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.381474 17847 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:35.401623 16538 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:35.404681 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 55236.3us
I20260709 13:06:35.378636 17745 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:35.409122 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.436303 17123 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.436970 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.390956 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.379669 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.413523 17834 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:35.427621 17685 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.428726 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.450815 16470 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:35.431432 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 239494us
I20260709 13:06:35.432312 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.453824 16614 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:35.456300 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.458725 17943 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.459262 17943 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.460016 17120 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:35.460129 17943 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.445943 17123 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.467749 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.468537 16468 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:35.429653 17932 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.432531 17742 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.469903 17764 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.571276 17919 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.571648 17764 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:35.573382 17915 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:35.477718 17932 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.489442 17121 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:35.573896 17932 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.478580 17841 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.565651 16543 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.566294 17917 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.416738 17942 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.406466 17923 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.570102 17867 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.570581 17918 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.469326 17939 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.494376 17928 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:35.449980 17745 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.469090 17834 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.486670 17940 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.585325 16542 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:35.573544 17862 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.584357 17938 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.578281 17806 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:35.578190 17836 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.598176 17685 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.584506 17956 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.600737 16470 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:35.606477 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 165295us
I20260709 13:06:35.577919 17919 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.608736 17939 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.573644 17764 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.599825 17742 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.448040 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.612725 17685 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.618857 17919 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:35.619555 17941 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.394s	user 0.003s	sys 0.000s
I20260709 13:06:35.617491 17956 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.607184 17940 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.629908 17922 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.631217 17940 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.633443 17835 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:35.634888 16614 raft_consensus.cc:2368] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3.
I20260709 13:06:35.636850 17835 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.584744 17841 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.615581 17836 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.638047 17834 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.640030 17745 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.644901 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.646397 16461 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.647701 17932 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.648873 17942 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.626382 17939 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.641026 17928 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.655192 16536 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:35.641944 17862 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.639848 17785 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.657155 17685 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.627282 16470 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:35.599817 17722 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.659137 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.644636 17836 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.670790 16469 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.669446 16466 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:35.671751 16537 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:35.673075 17722 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.664441 17937 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.669137 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.673156 17841 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.677263 16585 leader_election.cc:400] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3.
I20260709 13:06:35.677680 16585 leader_election.cc:403] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.678923 17745 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.687274 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.684876 17836 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.676476 16610 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:35.697706 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.700698 16619 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:35.702212 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.703181 16470 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.704262 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:35.706266 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 229915us
I20260709 13:06:35.706923 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.707226 17125 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:35.696869 17932 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.712411 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.699782 17835 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.705865 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.713124 16470 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:35.699375 17722 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.691946 17942 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:35.706799 17841 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.706984 17836 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:35.678967 17937 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.719456 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.714242 17934 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.711782 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:35.715081 17930 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:06:35.714463 17835 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.753623 17835 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.733418 17836 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.757985 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.758749 17127 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.720387 17722 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.729200 17860 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.760702 17722 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.760746 17860 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.736064 17960 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.761552 17960 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:35.761972 17960 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.762521 17956 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.762530 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.763350 17120 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.763278 17956 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.732646 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.739945 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.765743 17125 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:35.747328 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.736407 17919 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.733738 17785 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.749186 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.749835 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.750878 17922 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.750819 17930 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.752332 17942 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.753069 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.767197 17122 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.721303 16466 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.782996 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.782859 17960 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.784134 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.768039 17119 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.785135 17127 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.718834 17862 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.786686 17960 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.787253 17966 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.786904 17862 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.788115 17123 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:35.789172 17862 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.789367 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.789976 16462 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:35.774578 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.775190 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.732003 17934 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.792678 17934 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.776528 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.793359 16468 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:35.773808 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.794194 16470 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:35.778012 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.795020 16611 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:35.778476 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.795835 17121 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.772799 17860 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:35.779234 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:35.779696 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.798635 16464 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.799815 17934 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.804634 16583 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.805125 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.805794 16536 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:35.784725 16465 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:35.805787 16544 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:35.808631 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.810271 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.810935 16544 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.776655 17836 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.781888 17937 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.783874 17942 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:35.813860 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.805795 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.818199 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.835035 16539 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.836238 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.806821 17811 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.822069 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.838764 16545 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.822639 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.839926 16541 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.841573 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.822778 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.841842 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.844327 16544 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.806384 17933 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.831781 16538 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:35.833006 16464 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:35.823977 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.845754 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.741708 16461 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.821941 17836 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.775979 16463 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.732106 17841 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.807590 17966 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:35.856559 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.846866 16541 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.857223 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.857733 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.858211 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.858829 17933 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.765733 17835 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.859988 17802 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.865895 17930 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.847052 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.838351 17811 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:35.846017 17745 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3.
I20260709 13:06:35.868152 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.869349 17127 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:35.880959 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.868814 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.849398 17806 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:35.850051 17764 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.883792 17764 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.883368 17966 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.884238 17764 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.885345 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:35.885946 17119 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.850616 17860 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:35.872745 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.888249 16464 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.880626 17935 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.879110 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.862114 17836 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.860932 17947 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.880450 16539 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:35.893167 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.880627 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.881564 16468 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.866330 17818 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:06:35.871490 17120 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:35.892490 17806 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.873180 17121 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:35.894699 17806 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.889035 17860 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:35.866529 17932 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.896646 17860 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.889235 17936 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.897064 17932 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.897940 17932 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.900169 17947 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.880911 17802 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.876631 16470 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:35.906453 16468 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.890275 16538 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:35.883317 16466 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.891083 16615 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:35.881819 17811 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.901829 16434 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.884245 17934 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.877789 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:35.886797 17956 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.900588 17947 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.909472 17835 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.912990 17957 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.896682 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.917542 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:35.918893 16585 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.920352 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.901106 17742 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.914909 17834 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:06:35.926869 17835 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.926810 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.927125 17957 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:35.922756 17818 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:35.927901 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.928678 17933 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:35.891736 17935 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:35.944233 16584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.016s	sys 0.023s
W20260709 13:06:35.944566 16584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.016s	sys 0.023s
I20260709 13:06:35.914444 17722 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.923751 17785 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:35.929906 17924 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:35.924399 17956 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.936439 17942 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:35.973716 17942 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.974156 17942 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.929404 17742 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.957702 17122 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.978296 17742 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.979295 17764 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.979844 17947 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.937116 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.936664 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.938234 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.982016 16536 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.982621 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:35.983206 16542 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.983947 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.984392 16615 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:35.985725 17764 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.986703 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:35.913522 17936 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:35.939509 16544 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:35.988619 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.989492 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.989393 16367 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.990753 16544 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:35.944432 17935 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.945302 17119 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:35.946323 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.994794 16537 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.995512 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:35.996189 16467 raft_consensus.cc:2368] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3.
I20260709 13:06:35.996307 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:35.949200 17841 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.996893 16610 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.997071 17818 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:35.997462 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:35.998068 17818 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.998782 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.999068 17940 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:35.999481 17940 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.999835 17940 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:35.949934 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:36.001132 16539 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:36.003851 16539 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:35.939138 17835 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.004436 17960 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:35.958706 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:36.006067 16538 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:35.958806 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:36.007001 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48279.7us
I20260709 13:06:36.007622 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:36.008052 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.953819 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:36.008607 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.008839 17952 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.009146 16467 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.009277 17952 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.009706 17952 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.010556 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:36.010972 17722 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:36.011158 16461 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:36.011852 17722 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.012949 17946 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.013329 17946 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:36.013669 17946 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:35.940796 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:35.968041 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.971199 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:35.973148 17956 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.015007 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.015625 16618 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.016323 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.960744 17923 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:36.017402 16611 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.017518 17862 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:36.018636 16611 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:35.963958 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:36.019325 17127 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:36.020449 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:35.961764 17957 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:36.022212 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:35.970170 17785 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.023031 17785 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.987980 17936 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.025080 17959 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.025583 17959 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:36.025651 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 106309us
I20260709 13:06:36.026428 17959 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:35.952239 17860 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:35.990180 16617 raft_consensus.cc:2368] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:35.993046 16543 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.029524 17860 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:35.914179 17802 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.005290 17835 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.948329 17836 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.031705 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:36.032342 16616 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:36.024034 17944 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:36.033051 17944 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:36.033449 17944 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:36.033793 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.034919 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.035310 16464 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.009147 16540 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:36.036309 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.007081 16538 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:36.038146 16545 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.038414 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:35.976460 17942 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.040292 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:36.040869 16470 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:36.042773 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.043371 16470 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.041065 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.041378 16618 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:36.044123 16611 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.035323 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:35.976861 17811 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.060901 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.063097 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:36.061524 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:36.068354 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.074755 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.076756 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.084394 16436 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.090772 17685 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.031133 17952 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.092635 16613 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:36.039290 17924 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:36.097957 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.098649 16619 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.061678 17960 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:36.100122 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:36.099248 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:36.101362 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:36.104735 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:36.111119 16511 leader_election.cc:400] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3.
I20260709 13:06:36.111439 16511 leader_election.cc:403] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.112918 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:36.089186 17953 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.119096 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.123294 16467 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:36.100167 17930 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:36.092028 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.128902 16436 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.139701 16436 leader_election.cc:403] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.105590 17960 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.101233 16610 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:36.138146 16540 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:36.108553 17938 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.034802 17946 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.168138 17946 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.112386 17931 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.169625 16468 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.117569 17836 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.113775 17933 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:36.168989 17931 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.175984 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54664.9us
I20260709 13:06:36.177248 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.119397 17953 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.127393 17923 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3.
I20260709 13:06:36.185680 16614 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:36.186874 16611 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:36.105046 17945 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:06:36.195772 17121 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:36.192055 16470 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:36.129078 17860 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:36.190639 16464 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:36.126169 17966 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
W20260709 13:06:36.202857 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126216us
I20260709 13:06:36.173666 17960 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:36.208870 16540 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:36.211074 16611 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.175055 17930 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:36.187610 17919 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:06:36.137944 17948 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:36.191242 16468 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:36.195359 17931 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.199903 17953 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:36.219146 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 93831.7us
I20260709 13:06:36.180166 16463 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.221808 17943 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.217176 17965 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.237390 17093 leader_election.cc:400] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.234879 17947 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:36.256160 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:36.257145 17862 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.257727 17862 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:36.258776 17862 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.260083 17947 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.262944 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.263516 16614 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:36.251610 17977 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:36.252444 17952 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.254956 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:36.268077 17123 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.265203 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.269384 16611 raft_consensus.cc:2368] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.270795 17093 leader_election.cc:400] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.271171 17093 leader_election.cc:403] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.260565 17947 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.293004 16610 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:36.295044 17964 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:36.248386 17930 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.207598 17924 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.234539 17860 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:06:36.302803 17127 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.303561 16614 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:36.307266 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:36.307826 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:36.317292 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:36.347877 17802 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.351217 17802 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.353315 16537 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:36.354506 16542 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.316277 17931 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.364684 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:36.306669 17947 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.320815 17811 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:36.323792 16463 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:36.343611 17123 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:36.316408 17935 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.391352 16511 leader_election.cc:400] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3.
I20260709 13:06:36.335103 17965 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:36.384522 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:36.386324 17834 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.386611 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:36.387563 17119 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.334236 17956 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.388149 17946 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.372071 17945 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:36.392479 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:36.399024 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.409613 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.410825 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.411473 16539 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:36.384181 17992 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:36.406172 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.415215 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:36.409880 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.415975 16545 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.416002 16539 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.434017 16541 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.441761 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:36.406351 17965 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:36.448693 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:36.457170 16464 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.463464 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.464699 16470 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:36.433514 17834 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:36.441376 17931 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.446698 17846 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:36.451974 17836 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.470727 16470 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:36.416131 17742 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.481760 16616 raft_consensus.cc:2368] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
I20260709 13:06:36.449095 17802 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.463378 17933 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.444491 17959 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.449952 17984 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:36.408413 17945 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.497035 17933 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:36.512503 17935 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.478417 17846 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.450237 17960 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:36.520947 17933 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.483404 17835 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.485168 17785 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.477568 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:36.528795 16536 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
I20260709 13:06:36.537180 16536 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:36.546854 16545 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:36.553144 17123 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.553442 16614 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.580175 16618 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:36.524989 17846 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.585124 17956 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:36.586087 17988 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.363s	user 0.002s	sys 0.000s
I20260709 13:06:36.488255 17940 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.589636 17685 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:36.591287 16465 raft_consensus.cc:2368] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.546634 17965 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.598778 17940 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.599442 16615 raft_consensus.cc:2368] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
W20260709 13:06:36.604947 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52772.8us
W20260709 13:06:36.602702 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123782us
W20260709 13:06:36.602301 17944 consensus_meta.cc:287] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.001s
I20260709 13:06:36.617831 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.618692 16470 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.600847 17945 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:36.603322 17802 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:06:36.618773 17722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.007s
W20260709 13:06:36.674814 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.022s
W20260709 13:06:36.675273 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.017s	sys 0.022s
I20260709 13:06:36.679538 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.681540 16538 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.607569 17942 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:36.649230 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:36.689643 16545 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:36.620589 17742 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.596616 17834 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.718374 17802 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.619148 17937 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:06:36.685436 16539 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:36.647188 17836 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:36.650470 17785 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:36.655035 17722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.008s
I20260709 13:06:36.624866 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.683414 16536 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.731078 17685 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:36.716436 17957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.024s	sys 0.044s
I20260709 13:06:36.716207 17835 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.653820 17959 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:36.698835 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.621404 17944 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:36.755481 17957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.024s	sys 0.045s
I20260709 13:06:36.732354 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:36.771665 17722 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.771780 16465 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:36.772243 17722 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:36.772552 17685 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:36.751142 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.772337 17996 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:36.777815 17980 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.562s	user 0.000s	sys 0.003s
I20260709 13:06:36.772897 17960 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.784310 16463 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:36.783856 17959 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.785373 17944 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:36.755981 17836 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.791656 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:36.791574 17722 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.796130 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.797076 16542 raft_consensus.cc:2368] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
W20260709 13:06:36.799027 17953 consensus_meta.cc:287] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 13:06:36.800786 17953 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:36.801396 17846 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.802909 16537 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.803192 17953 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:36.804277 17120 raft_consensus.cc:2368] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.804538 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:36.805233 16433 leader_election.cc:400] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:36.805503 16542 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:36.812659 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.813802 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.815343 17093 leader_election.cc:400] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.815642 17093 leader_election.cc:403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.805546 16433 leader_election.cc:403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:36.853922 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48821.5us
I20260709 13:06:36.855175 16436 leader_election.cc:400] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
I20260709 13:06:36.858839 16436 leader_election.cc:400] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
I20260709 13:06:36.859786 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:36.853909 16616 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.861713 16616 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:36.857185 16617 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.864385 17785 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:36.864910 17785 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:36.866623 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.866900 17785 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:36.867393 16612 raft_consensus.cc:2368] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
I20260709 13:06:36.868065 17953 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3.
I20260709 13:06:36.869951 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:36.872879 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.875131 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:36.878444 17685 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.879318 17685 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.885084 16542 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:36.886942 17685 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.889537 16436 leader_election.cc:400] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4.
I20260709 13:06:36.905992 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:36.911230 17121 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:36.882393 17953 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:36.899853 17926 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:06:36.933900 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:36.942342 16619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.020s	sys 0.028s
W20260709 13:06:36.942705 16619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.020s	sys 0.028s
I20260709 13:06:36.957890 16542 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:36.962200 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:36.929663 17785 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:36.968153 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1116) took 1122 ms. Trace:
W20260709 13:06:36.968405 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 347614us
I20260709 13:06:36.985757 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:36.938450 17930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.000s	sys 0.027s
I20260709 13:06:36.939765 17860 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:36.973008 16541 rpcz_store.cc:276] 0709 13:06:35.825039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.880707 (+ 55668us) service_pool.cc:224] Handling call
0709 13:06:36.947041 (+1066334us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002918d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:36.947174 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269533952}
I20260709 13:06:37.008980 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:36.940759 17764 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:37.013388 16611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.022s	sys 0.014s
W20260709 13:06:37.012212 16613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.019s	sys 0.018s
W20260709 13:06:37.013829 16611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.015s
I20260709 13:06:36.931265 17935 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:06:37.014111 16613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.020s	sys 0.018s
I20260709 13:06:36.939862 17986 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.019186 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:36.993083 17930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.000s	sys 0.027s
W20260709 13:06:36.988932 17745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.003s	sys 0.035s
I20260709 13:06:37.034479 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:37.035600 17862 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.016s
W20260709 13:06:37.036052 17862 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.005s	sys 0.016s
I20260709 13:06:37.012696 17970 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.967152 17926 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:06:37.011148 17860 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:36.967885 17932 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:06:36.989197 17945 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:06:37.106741 17091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.018s	sys 0.066s
W20260709 13:06:37.022506 17092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.016s	sys 0.030s
W20260709 13:06:37.038365 16467 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.029s	sys 0.015s
W20260709 13:06:37.161442 16467 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.032s	sys 0.015s
W20260709 13:06:37.096351 16543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.021s	sys 0.025s
W20260709 13:06:37.144821 17091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.018s	sys 0.066s
I20260709 13:06:37.000191 17785 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:37.184262 17818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.012s	sys 0.044s
W20260709 13:06:37.160936 17092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.018s	sys 0.030s
I20260709 13:06:37.211153 16463 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
W20260709 13:06:37.185168 16543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.021s	sys 0.025s
I20260709 13:06:37.211229 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 128) took 1185 ms. Trace:
I20260709 13:06:37.144263 16466 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:37.215260 17999 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:06:37.214038 17846 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:37.199710 17835 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:37.190210 17745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.035s
W20260709 13:06:37.184064 17965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.029s
I20260709 13:06:37.029572 17986 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:37.211292 17818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.012s	sys 0.046s
I20260709 13:06:37.214599 17944 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
W20260709 13:06:37.257074 17965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.007s	sys 0.030s
I20260709 13:06:37.218027 17835 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.216573 16461 rpcz_store.cc:276] 0709 13:06:36.007959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.012760 (+  4801us) service_pool.cc:224] Handling call
0709 13:06:36.386325 (+373565us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:36.386471 (+   146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.530988 (+144517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.531040 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:36.531101 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.531157 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.061712 (+530555us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002a6cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:37.122431 (+ 60719us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.193098 (+ 70667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329033344}
I20260709 13:06:37.260069 16509 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:37.214412 17860 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.264742 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:37.294507 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:37.196288 17970 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.303368 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 169) took 1005 ms. Trace:
W20260709 13:06:37.280911 17119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.009s	sys 0.012s
I20260709 13:06:37.303853 16610 rpcz_store.cc:276] 0709 13:06:36.297911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.298142 (+   231us) service_pool.cc:224] Handling call
0709 13:06:36.298538 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.298918 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.298948 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.334444 (+ 35496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.919437 (+584993us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.931092 (+ 11655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.938916 (+  7824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.303114 (+364198us) raft_consensus.cc:1685] finished
0709 13:06:37.303135 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.303294 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":494718,"threads_started":1,"wal-append.queue_time_us":884393}
I20260709 13:06:37.312383 17722 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:37.314648 18025 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:06:37.316087 18024 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:37.318158 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1534) took 1412 ms. Trace:
I20260709 13:06:37.319024 17120 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:37.324731 17722 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:37.345970 17785 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:37.323642 17119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.009s	sys 0.013s
I20260709 13:06:37.605894 17965 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.325284 17930 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:37.367789 17970 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:37.607120 17965 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.369601 17835 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:37.440335 17818 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.614557 17818 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.602851 17722 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:06:37.619614 17123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.012s	sys 0.009s
W20260709 13:06:37.620146 17123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.013s	sys 0.009s
I20260709 13:06:37.620154 17835 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:37.621904 17933 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.022s	sys 0.039s
W20260709 13:06:37.622404 17933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.023s	sys 0.039s
W20260709 13:06:37.622665 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.623474 17802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.022s	sys 0.060s
W20260709 13:06:37.623939 17802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.022s	sys 0.060s
W20260709 13:06:37.625042 16616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.047s	sys 0.056s
W20260709 13:06:37.625514 16616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.047s	sys 0.056s
I20260709 13:06:37.625775 17936 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:37.626576 17122 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.008s	sys 0.052s
W20260709 13:06:37.627125 17122 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.008s	sys 0.052s
I20260709 13:06:37.626909 17936 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.628671 17996 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:37.629703 17996 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.630606 16618 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:37.630787 17929 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.631812 17929 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.526332 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:37.600699 16542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.041s	sys 0.016s
I20260709 13:06:37.601337 17990 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:37.601512 16614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.013s	sys 0.009s
W20260709 13:06:37.602157 16468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.008s
I20260709 13:06:37.606101 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 284) took 1092 ms. Trace:
I20260709 13:06:37.357651 17986 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:37.643664 16468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.008s
W20260709 13:06:37.620071 17834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.012s	sys 0.038s
W20260709 13:06:37.641916 16542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.041s	sys 0.017s
I20260709 13:06:37.672989 17818 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:37.653754 17996 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:37.673976 17924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.015s	sys 0.043s
I20260709 13:06:37.596359 16543 rpcz_store.cc:276] 0709 13:06:35.905744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.030863 (+125119us) service_pool.cc:224] Handling call
0709 13:06:36.031153 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.091083 (+ 59930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.099240 (+  8157us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.209168 (+109928us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.213708 (+1004540us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.213758 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.213834 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.317859 (+104025us) raft_consensus.cc:1685] finished
0709 13:06:37.317887 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.318088 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43019,"raft.queue_time_us":51507,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":21601,"thread_start_us":976591,"threads_started":1,"wal-append.queue_time_us":978958}
I20260709 13:06:37.674633 17722 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:37.653606 16614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.014s	sys 0.009s
I20260709 13:06:37.659050 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:37.638324 17980 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.011s	sys 0.011s
W20260709 13:06:37.689628 17834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.012s	sys 0.038s
W20260709 13:06:37.720507 17924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.015s	sys 0.044s
W20260709 13:06:37.726589 17980 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.012s	sys 0.011s
W20260709 13:06:37.642180 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 238312us
W20260709 13:06:37.756799 16545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.026s	sys 0.022s
W20260709 13:06:37.729507 17959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.007s	sys 0.021s
W20260709 13:06:37.768967 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.058s	sys 0.060s
W20260709 13:06:37.780151 16539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.035s	sys 0.036s
W20260709 13:06:37.764017 17836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.017s	sys 0.047s
W20260709 13:06:37.796221 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.059s	sys 0.060s
W20260709 13:06:37.796657 16545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.028s	sys 0.022s
W20260709 13:06:37.796029 17959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.015s	sys 0.021s
I20260709 13:06:37.778304 17936 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:37.802758 16539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.035s	sys 0.036s
W20260709 13:06:37.800254 17836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.018s	sys 0.047s
W20260709 13:06:37.802307 16615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.008s	sys 0.007s
I20260709 13:06:37.807632 17818 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:37.862567 16615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.010s	sys 0.015s
I20260709 13:06:37.867336 17818 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.869962 18001 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.870380 17818 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:37.871160 17818 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.872004 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:37.874253 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:37.875319 16543 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:37.876827 16470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.004s	sys 0.019s
W20260709 13:06:37.877345 16470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.004s	sys 0.019s
I20260709 13:06:37.880527 16538 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.882073 17962 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.882478 17802 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:37.883114 17962 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:37.883368 17802 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.884935 17933 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:37.885875 17933 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.886994 17834 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:37.887952 17922 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:37.887844 17834 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:37.638621 17119 rpcz_store.cc:276] 0709 13:06:36.513692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.518255 (+  4563us) service_pool.cc:224] Handling call
0709 13:06:36.550704 (+ 32449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.551189 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.551222 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.551730 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.605207 (+1053477us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:37.605343 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.605557 (+   214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.605634 (+    77us) raft_consensus.cc:1685] finished
0709 13:06:37.605648 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.605883 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1090,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3039,"spinlock_wait_cycles":124032,"thread_start_us":1052636,"threads_started":1,"wal-append.queue_time_us":706308}
W20260709 13:06:37.962874 16463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1316) took 1351 ms (client timeout 1596 ms). Trace:
I20260709 13:06:37.963316 17986 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:37.894178 16467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.013s	sys 0.048s
W20260709 13:06:37.892846 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 95355.3us
I20260709 13:06:37.970489 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1134) took 1004 ms. Trace:
I20260709 13:06:37.889575 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:37.884943 17938 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.010s	sys 0.019s
I20260709 13:06:37.888542 17933 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:37.888223 17965 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.010363 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:37.871940 17818 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:37.963481 16463 rpcz_store.cc:269] 0709 13:06:36.606388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.609892 (+  3504us) service_pool.cc:224] Handling call
0709 13:06:37.898607 (+1288715us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b54003561d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:37.898846 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69991296}
I20260709 13:06:38.018486 16469 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:38.033166 16464 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.033033 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:38.033983 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1135) took 1067 ms. Trace:
I20260709 13:06:38.035634 17685 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.037287 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 362) took 1736 ms. Trace:
W20260709 13:06:38.037655 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 148389us
I20260709 13:06:38.037889 17936 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.010459 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:37.888890 17785 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.001910 16542 rpcz_store.cc:276] 0709 13:06:36.966130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.969348 (+  3218us) service_pool.cc:224] Handling call
0709 13:06:36.969642 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.993516 (+ 23874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.993560 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.994011 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.805759 (+811748us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:37.855880 (+ 50121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.860216 (+  4336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.950166 (+ 89950us) raft_consensus.cc:1685] finished
0709 13:06:37.950190 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.970408 (+ 20218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23422,"raft.queue_time_us":25805,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":10643,"thread_start_us":650495,"threads_started":1,"wal-append.queue_time_us":842470}
I20260709 13:06:37.962945 17962 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:37.894078 17996 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:06:38.029461 17938 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.010s	sys 0.029s
W20260709 13:06:38.013826 16612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.023s	sys 0.077s
I20260709 13:06:38.053212 17922 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.082607 17785 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.084993 17924 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.085419 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1371) took 1141 ms. Trace:
I20260709 13:06:38.086024 17924 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:38.085934 16614 rpcz_store.cc:276] 0709 13:06:36.944300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.944441 (+   141us) service_pool.cc:224] Handling call
0709 13:06:36.944842 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.945074 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:37.811566 (+866492us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.050757 (+239191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.084911 (+ 34154us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:38.085012 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.085129 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.085327 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":933940,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":137,"thread_start_us":910145,"threads_started":2}
I20260709 13:06:38.085924 16466 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:37.871176 18001 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.089318 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:38.090509 18009 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.842s	user 0.004s	sys 0.000s
I20260709 13:06:38.090921 18001 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.093262 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:38.095323 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1233) took 1485 ms. Trace:
I20260709 13:06:38.096388 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:38.097445 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.102605 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.102859 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.103778 17922 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.105196 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 365) took 1511 ms. Trace:
I20260709 13:06:38.105316 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1241) took 1126 ms. Trace:
W20260709 13:06:38.105580 18015 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:06:38.111974 17685 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.113776 17995 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.953s	user 0.001s	sys 0.008s
I20260709 13:06:38.113793 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 364) took 1521 ms. Trace:
I20260709 13:06:38.114766 17685 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.115579 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 170) took 2077 ms. Trace:
I20260709 13:06:38.114497 17127 rpcz_store.cc:276] 0709 13:06:36.591797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.592003 (+   206us) service_pool.cc:224] Handling call
0709 13:06:36.592335 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.592542 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.592569 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.593004 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.977609 (+384605us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.977661 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.981671 (+  4010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.113275 (+1131604us) raft_consensus.cc:1685] finished
0709 13:06:38.113321 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.113586 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":384295,"threads_started":1,"wal-append.queue_time_us":1091405}
I20260709 13:06:38.110364 17123 rpcz_store.cc:276] 0709 13:06:36.593904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.594046 (+   142us) service_pool.cc:224] Handling call
0709 13:06:36.594415 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.594850 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.594888 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.595919 (+  1031us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.621237 (+1025318us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:37.621355 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.621489 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.104908 (+483419us) raft_consensus.cc:1685] finished
0709 13:06:38.104941 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.105112 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"thread_start_us":1024531,"threads_started":1,"wal-append.queue_time_us":1506981}
I20260709 13:06:38.043569 17933 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.117321 16469 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:38.115952 16544 rpcz_store.cc:276] 0709 13:06:36.038011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.044954 (+  6943us) service_pool.cc:224] Handling call
0709 13:06:36.045242 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.073129 (+ 27887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.073173 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.109919 (+ 36746us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b18002f2c00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a
0709 13:06:36.115845 (+  5926us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:06:36.161723 (+ 45878us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.647623 (+485900us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.647678 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.647770 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.112709 (+1464939us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:38.115183 (+  2474us) raft_consensus.cc:1685] finished
0709 13:06:38.115205 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.115413 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32069,"raft.queue_time_us":27644,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14779,"spinlock_wait_cycles":177396096,"thread_start_us":440276,"threads_started":1,"wal-append.queue_time_us":796288}
I20260709 13:06:38.117962 17933 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.094934 16617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.016s	sys 0.013s
I20260709 13:06:38.041620 16541 rpcz_store.cc:276] 0709 13:06:36.966427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.021315 (+ 54888us) service_pool.cc:224] Handling call
0709 13:06:37.021663 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.267675 (+246012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:37.267723 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:37.267781 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.267827 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.033452 (+765625us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54002053d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:38.033518 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.033781 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565198208}
I20260709 13:06:38.119972 16544 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.085125 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1476) took 1724 ms. Trace:
W20260709 13:06:38.121666 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 861526us
W20260709 13:06:38.123116 18027 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.881s	user 0.001s	sys 0.001s
I20260709 13:06:38.108532 16462 rpcz_store.cc:276] 0709 13:06:36.610411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.612553 (+  2142us) service_pool.cc:224] Handling call
0709 13:06:38.032506 (+1419953us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:38.095245 (+ 62739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6641920}
I20260709 13:06:38.148085 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1136) took 1173 ms. Trace:
I20260709 13:06:38.147805 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1545) took 1375 ms. Trace:
I20260709 13:06:38.177210 16542 rpcz_store.cc:276] 0709 13:06:37.049288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.090593 (+1041305us) service_pool.cc:224] Handling call
0709 13:06:38.091072 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.127716 (+ 36644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.127747 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.139736 (+ 11989us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.139798 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.139873 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.140004 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:38.029951 17986 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.138202 16611 rpcz_store.cc:276] 0709 13:06:36.360505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.362701 (+  2196us) service_pool.cc:224] Handling call
0709 13:06:36.363041 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.382883 (+ 19842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.382910 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.389962 (+  7052us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.014482 (+624520us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.014523 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.014595 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.039248 (+1024653us) raft_consensus.cc:1685] finished
0709 13:06:38.043024 (+  3776us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.084901 (+ 41877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19462,"raft.queue_time_us":22748,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":596645,"threads_started":1,"wal-append.queue_time_us":1380799}
I20260709 13:06:38.111629 16470 rpcz_store.cc:276] 0709 13:06:36.978813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.981701 (+  2888us) service_pool.cc:224] Handling call
0709 13:06:36.982100 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.982505 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.982558 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.983062 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.878053 (+894991us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:37.878203 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.878337 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.094618 (+216281us) raft_consensus.cc:1685] finished
0709 13:06:38.094637 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.105239 (+ 10602us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2712,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":894398,"threads_started":1,"wal-append.queue_time_us":1108953}
W20260709 13:06:38.146198 16612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.024s	sys 0.087s
W20260709 13:06:38.189855 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 82663.1us
I20260709 13:06:38.197490 17685 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:38.176131 16539 rpcz_store.cc:276] 0709 13:06:36.772348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.772913 (+   565us) service_pool.cc:224] Handling call
0709 13:06:36.773218 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.773526 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.773553 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.773940 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.008536 (+1234596us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:38.008664 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.008800 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.134902 (+126102us) raft_consensus.cc:1685] finished
0709 13:06:38.134929 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.147727 (+ 12798us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1041,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":136,"thread_start_us":1073993,"threads_started":1,"wal-append.queue_time_us":1347602}
I20260709 13:06:38.157344 17924 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:38.221268 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50231.8us
I20260709 13:06:38.244380 17685 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.248387 17127 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.250252 17123 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:38.250362 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1547) took 1461 ms. Trace:
I20260709 13:06:38.253023 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.262486 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:38.270048 18050 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.270926 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1485) took 1374 ms. Trace:
W20260709 13:06:38.272672 18029 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.105s	user 0.001s	sys 0.001s
I20260709 13:06:38.274302 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1546) took 1494 ms. Trace:
W20260709 13:06:38.274575 18018 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:06:38.212994 17785 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.274654 16545 rpcz_store.cc:276] 0709 13:06:36.780100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.780254 (+   154us) service_pool.cc:224] Handling call
0709 13:06:36.780644 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.781138 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.781177 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.782130 (+   953us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.879903 (+1097773us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:37.880008 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.880156 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.274060 (+393904us) raft_consensus.cc:1685] finished
0709 13:06:38.274084 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.274245 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":1023655,"threads_started":1,"wal-append.queue_time_us":1323739}
I20260709 13:06:38.282192 18054 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.283159 18054 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.283990 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1553) took 1008 ms. Trace:
I20260709 13:06:38.284385 16538 rpcz_store.cc:276] 0709 13:06:37.275068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.282806 (+1007738us) service_pool.cc:224] Handling call
0709 13:06:38.283320 (+   514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.283653 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.283677 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.283735 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.283767 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.283818 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.283927 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9088}
I20260709 13:06:38.283695 17959 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.239367 17802 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:38.303066 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 187109us
I20260709 13:06:38.238844 17922 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:38.327829 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45233.6us
I20260709 13:06:38.215698 17996 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.362422 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1144) took 1087 ms. Trace:
I20260709 13:06:38.362924 16539 rpcz_store.cc:276] 0709 13:06:37.274615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.266427 (+991812us) service_pool.cc:224] Handling call
0709 13:06:38.342633 (+ 76206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.353447 (+ 10814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.353472 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.362132 (+  8660us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:38.362181 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.362245 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.362363 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:38.271473 16612 rpcz_store.cc:276] 0709 13:06:36.896985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.897507 (+   522us) service_pool.cc:224] Handling call
0709 13:06:36.902158 (+  4651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.938081 (+ 35923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.938654 (+   573us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.025295 (+ 86641us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.262085 (+1236790us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.270448 (+  8363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.270589 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.270648 (+    59us) raft_consensus.cc:1685] finished
0709 13:06:38.270663 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.270854 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13569,"raft.queue_time_us":29058,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":2853,"thread_start_us":1153089,"threads_started":1,"wal-append.queue_time_us":1088893}
I20260709 13:06:38.366458 17936 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.367122 17996 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.368283 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1222) took 2118 ms. Trace:
I20260709 13:06:38.369156 17933 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.250995 16536 rpcz_store.cc:276] 0709 13:06:36.789243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.790340 (+  1097us) service_pool.cc:224] Handling call
0709 13:06:36.792897 (+  2557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.793335 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.793377 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.793950 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.112248 (+318298us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.112311 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.112414 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.122080 (+1009666us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:38.249856 (+127776us) raft_consensus.cc:1685] finished
0709 13:06:38.249880 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.250182 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":32937728,"thread_start_us":317833,"threads_started":1,"wal-append.queue_time_us":427555}
I20260709 13:06:38.370507 18016 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.372438 18054 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.368741 16467 rpcz_store.cc:276] 0709 13:06:36.249536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.249727 (+   191us) service_pool.cc:224] Handling call
0709 13:06:36.250040 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.250258 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:37.187124 (+936866us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.367707 (+1180583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.367814 (+   107us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:38.367919 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.368016 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.368213 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1548076,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":7666,"raft.queue_time_us":91272,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"thread_start_us":2009050,"threads_started":3}
I20260709 13:06:38.270973 18050 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.373535 17818 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:38.408701 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.408495 16543 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.532s	user 0.000s	sys 0.020s
I20260709 13:06:38.044077 17122 rpcz_store.cc:276] 0709 13:06:36.300690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.305392 (+  4702us) service_pool.cc:224] Handling call
0709 13:06:36.522681 (+217289us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:36.522961 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.523256 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:37.627958 (+1104702us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.010647 (+382689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.025178 (+ 14531us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:38.036875 (+ 11697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.037005 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.037204 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1485940,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":53,"raft.queue_time_us":61045,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":58294,"spinlock_wait_cycles":26035072,"thread_start_us":1339492,"threads_started":2}
I20260709 13:06:38.412113 17685 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:38.437638 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45474.2us
W20260709 13:06:38.411863 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 53551.1us
I20260709 13:06:38.410848 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 176) took 1069 ms. Trace:
W20260709 13:06:38.410292 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 186571us
I20260709 13:06:38.472811 16543 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:38.411652 17962 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:38.435366 17990 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.006s
I20260709 13:06:38.481871 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1140) took 1205 ms. Trace:
I20260709 13:06:38.481521 17986 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.374467 17834 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.353556 17785 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.469727 17933 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:38.493750 18052 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.493745 17933 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.476917 16617 rpcz_store.cc:276] 0709 13:06:37.341071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.348183 (+  7112us) service_pool.cc:224] Handling call
0709 13:06:37.348423 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.348610 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:38.222031 (+873421us) log.cc:844] Serialized 14 byte log entry
0709 13:06:38.330424 (+108393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.343611 (+ 13187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:38.364355 (+ 20744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.391386 (+ 27031us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.410784 (+ 19398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":856,"prepare.queue_time_us":530632,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":44999,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":17758,"thread_start_us":795170,"threads_started":1}
I20260709 13:06:38.490302 16543 rpcz_store.cc:276] 0709 13:06:37.273675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.873746 (+600071us) service_pool.cc:224] Handling call
0709 13:06:38.479303 (+605557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:38.487790 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1477) took 1676 ms. Trace:
I20260709 13:06:38.370530 17931 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.494596 18052 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.491408 17924 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.497689 17835 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.495812 16615 rpcz_store.cc:276] 0709 13:06:36.810942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.820875 (+  9933us) service_pool.cc:224] Handling call
0709 13:06:36.821262 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.821690 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.821729 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.863145 (+ 41416us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.170777 (+1307632us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:38.221432 (+ 50655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.229347 (+  7915us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.487523 (+258176us) raft_consensus.cc:1685] finished
0709 13:06:38.487542 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.487733 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":530,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3071,"thread_start_us":989514,"threads_started":1,"wal-append.queue_time_us":1596306}
I20260709 13:06:38.499279 17957 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.499133 17936 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.500006 17785 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.486492 18045 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.503726 18059 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.373813 17938 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.436388 17922 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.522284 18059 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.513684 17722 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.744s	user 0.017s	sys 0.004s
I20260709 13:06:38.509115 17929 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.522054 17957 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.496148 17990 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.528570 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.529242 16543 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:38.526288 17935 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.526376 18064 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.533931 17935 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.534993 17785 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.535445 18059 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.536077 17935 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.536274 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.513602 16585 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:38.527105 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.522993 17835 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.541567 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 149902us
W20260709 13:06:38.537258 18034 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:38.533203 17986 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.556919 17946 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.557794 17946 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.558810 17835 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:38.561285 16467 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.561208 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:38.563095 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:38.546291 18064 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.556818 17745 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:38.532141 17962 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.531594 17938 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.533224 17936 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.578011 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.560395 17946 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.530480 17931 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.538653 17924 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:38.546507 17993 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.564721 18052 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.581213 17835 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:38.584895 18064 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:38.538703 18045 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.598064 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:38.598886 17119 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:38.597023 17962 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.606346 17993 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.610826 17936 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:38.590404 17835 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.590430 17986 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:38.658480 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44043.6us
I20260709 13:06:38.651039 17802 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.654444 17931 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.593878 16536 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:38.705651 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:38.706717 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47569.7us
I20260709 13:06:38.707847 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:38.701674 17835 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.681963 17957 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.687968 17935 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:38.708727 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.709496 17722 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.716632 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:06:38.722055 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 109733us
I20260709 13:06:38.715963 17990 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.724412 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.716069 17785 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.729420 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1555) took 1115 ms. Trace:
I20260709 13:06:38.729859 16538 rpcz_store.cc:276] 0709 13:06:37.614333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.285448 (+671115us) service_pool.cc:224] Handling call
0709 13:06:38.285909 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.369263 (+ 83354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.369308 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.369942 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.599537 (+229595us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18001432c0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:06:38.645987 (+ 46450us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:38.646049 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.646163 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.729120 (+ 82957us) raft_consensus.cc:1685] finished
0709 13:06:38.729137 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.729338 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29286,"raft.queue_time_us":29231,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":4709632,"thread_start_us":32594,"threads_started":1,"wal-append.queue_time_us":355219}
I20260709 13:06:38.732095 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.734553 17986 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.734875 17930 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:38.735460 17930 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:38.735622 16434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.797s (SENT) [suppressed 3 similar messages]
I20260709 13:06:38.740226 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:38.744391 17953 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:38.745193 17953 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.745784 18071 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.746358 18071 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.747519 17953 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.748286 17922 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.749068 17722 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.751528 17924 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.756021 17785 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.759506 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.725637 17990 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.759601 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.739763 17962 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:38.804262 17962 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:38.804731 17962 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.806782 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.807749 17835 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.809582 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1540) took 2131 ms (client timeout 2177 ms). Trace:
W20260709 13:06:38.795644 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 73797.4us
W20260709 13:06:38.796413 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53158.4us
I20260709 13:06:38.760102 17986 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:38.736668 17930 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.817744 17945 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.797166 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.818461 17945 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.819386 18062 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.802795 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:38.802276 17935 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:38.820298 16466 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:38.820147 18062 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:38.810184 16537 rpcz_store.cc:269] 0709 13:06:36.678427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.698605 (+ 20178us) service_pool.cc:224] Handling call
0709 13:06:38.809117 (+2110512us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54003e8d54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:38.809363 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59873024}
I20260709 13:06:38.748642 18071 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.801786 17990 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:38.718178 17802 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:38.821453 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 107064us
W20260709 13:06:38.918671 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 177331us
I20260709 13:06:38.957326 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.917855 17930 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:38.822388 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:38.822708 16465 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:38.846360 17962 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:38.823196 17945 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.924701 18078 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:38.878379 18077 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:06:38.800892 17957 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.922609 17785 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:38.969302 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:39.020087 17745 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.022159 17944 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.022693 17745 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.022836 17944 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:06:39.023785 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64188.4us
I20260709 13:06:38.972743 16538 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:38.979360 17722 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.009202 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.010454 16543 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:38.968864 18062 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:39.013302 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.919231 17935 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:39.016006 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.919469 17986 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:39.010447 18071 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.032565 18071 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.033085 17986 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.035488 18071 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:38.965220 17835 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:39.022855 17834 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:38.834658 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.016594 17836 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.026628 16544 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:39.029285 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:39.013543 18016 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.044014 18016 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.040323 17935 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.054260 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1240) took 2075 ms. Trace:
I20260709 13:06:39.054955 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.056547 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.061740 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.062067 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.062783 16537 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:39.063216 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.050794 17836 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.064821 18016 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.042732 17944 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:39.059015 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:39.058419 16468 rpcz_store.cc:276] 0709 13:06:36.978384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.978954 (+   570us) service_pool.cc:224] Handling call
0709 13:06:36.979647 (+   693us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:36.980283 (+   636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.980329 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:36.991943 (+ 11614us) log.cc:844] Serialized 532 byte log entry
0709 13:06:37.865960 (+874017us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:37.866996 (+  1036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.867177 (+   181us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.370099 (+502922us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b48000030d8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:06:39.051491 (+681392us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b240009fb78. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444efb0 00007ffa370c5488 00007ffa370c5be8 00007ffa3709d398 00007ffa3709876a 00007ffa37097bb6
0709 13:06:39.054014 (+  2523us) raft_consensus.cc:1685] finished
0709 13:06:39.054035 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.054198 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3294,"raft.run_cpu_time_us":5321,"raft.run_wall_time_us":1380481,"spinlock_wait_cycles":34019968,"thread_start_us":646273,"threads_started":1,"wal-append.queue_time_us":1413078}
I20260709 13:06:39.057109 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.044727 17745 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:39.068010 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 57693.2us
I20260709 13:06:39.064585 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.066787 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.047619 17985 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:39.078445 17985 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.080899 17935 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.083230 17935 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.073222 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.057176 18074 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.089157 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.093886 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.090091 16470 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:39.068212 17835 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:39.095916 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66301.6us
I20260709 13:06:39.046631 18078 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.073926 18071 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.098730 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:39.101599 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 72435.2us
I20260709 13:06:39.090623 17836 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.084827 16462 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:39.097378 17944 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.110090 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:39.113345 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.103042 18071 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.116350 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.117046 17120 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:06:39.117705 18006 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.870s	user 0.004s	sys 0.000s
I20260709 13:06:39.118260 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:39.119602 17998 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.920s	user 0.000s	sys 0.016s
I20260709 13:06:39.119721 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.106565 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.121440 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 175) took 2712 ms. Trace:
I20260709 13:06:39.121934 16540 rpcz_store.cc:276] 0709 13:06:36.409031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.409158 (+   127us) service_pool.cc:224] Handling call
0709 13:06:36.409408 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.409699 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.409725 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.417602 (+  7877us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.926079 (+508477us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:36.926128 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.926233 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.099781 (+2173548us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:39.120847 (+ 21066us) raft_consensus.cc:1685] finished
0709 13:06:39.120877 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.121220 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125,"raft.queue_time_us":4674,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8375,"spinlock_wait_cycles":47553408,"thread_start_us":462852,"threads_started":1,"wal-append.queue_time_us":800964}
I20260709 13:06:39.108148 17818 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.131054 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.110131 17835 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:39.111370 17944 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.139789 17944 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.140933 17962 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.141870 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.142334 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.142923 16614 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:39.143072 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.143965 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.139055 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.144734 16614 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:39.124235 18071 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.159888 16613 raft_consensus.cc:2410] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:39.160593 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.133111 17818 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.100345 18074 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.162384 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.137763 17785 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.168052 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.143090 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.169387 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:39.171391 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.169621 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.177214 16610 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:39.177426 17990 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.179643 17835 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.177793 17933 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.170002 17818 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.169566 17785 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.194073 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.192800 16611 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:39.182857 16461 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:39.197358 18078 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.197683 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.199069 18074 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.185487 18052 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.194809 16618 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:39.169400 17836 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:39.206029 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:39.206267 18045 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.188490 17785 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.195482 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.219790 17957 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:39.220881 17957 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:39.220961 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.222059 17957 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.213424 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.206918 17935 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.236737 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1554) took 1961 ms. Trace:
I20260709 13:06:39.237273 16545 rpcz_store.cc:276] 0709 13:06:37.275306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.282764 (+1007458us) service_pool.cc:224] Handling call
0709 13:06:38.283320 (+   556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.546680 (+263360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.546712 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:38.546770 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:38.546802 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.236469 (+689667us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400319a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:39.236527 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.236672 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596463232}
I20260709 13:06:39.238085 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.238780 16613 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:39.239682 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.240221 16613 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:39.241496 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.242156 16614 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:39.242897 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:39.243089 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.243801 16614 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:39.244081 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:39.245925 18064 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.246277 18064 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.246737 18064 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.248323 17802 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.250033 18099 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.250715 18099 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.231503 17935 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.251682 17935 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.253149 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:39.255765 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:39.253031 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.208423 18094 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.259588 18094 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.258098 18052 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.262382 18052 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:39.262871 18052 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.265770 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.267045 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.267442 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.268095 16615 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:39.268805 17944 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.258818 17990 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:39.271119 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 65210.9us
W20260709 13:06:39.279094 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 111119us
I20260709 13:06:39.314749 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:39.319384 16613 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
W20260709 13:06:39.320935 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 65264.9us
I20260709 13:06:39.320966 16611 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:39.257586 18001 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.324186 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:39.299642 17933 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.300992 18045 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.293318 18094 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.331449 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:39.335669 16436 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:39.336119 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.328402 17933 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.329276 18045 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:39.321834 18071 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.333020 16461 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:39.338871 18094 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:06:39.331203 18100 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.344055 17944 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.351260 17950 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.354839 18045 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.351673 18099 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.353358 17933 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.355580 17945 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:39.351307 18098 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:39.381171 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 81135.1us
I20260709 13:06:39.371430 17127 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:06:39.386289 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50265us
I20260709 13:06:39.371019 17950 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.388394 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:39.392463 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56894.5us
I20260709 13:06:39.383831 18098 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.383642 18099 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.398742 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:39.398319 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:39.391376 17944 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.392298 17950 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.403234 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:39.402421 18098 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.402098 18099 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.406903 17944 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.424739 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:39.421187 18111 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.428622 18111 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.429004 18111 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:39.429116 18071 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.424058 18099 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.432512 18050 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.435000 17818 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.453398 16545 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:39.464777 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.427043 17944 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.478595 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 75440.8us
I20260709 13:06:39.479951 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:06:39.465888 18102 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:39.501261 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:39.439957 18094 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.478886 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:39.505239 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 55585.4us
I20260709 13:06:39.501592 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:39.508296 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.533073 16539 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:39.509804 18094 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.523588 18050 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:39.542830 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62989.5us
I20260709 13:06:39.539103 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.536099 18094 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.550732 18120 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:39.553293 18105 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:06:39.558658 18115 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:39.559031 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.559314 18115 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.559834 18115 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.569770 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:39.541879 18050 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.574847 18050 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:39.556906 18120 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.575619 18120 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:39.583243 18101 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:06:39.585800 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.587190 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:39.588373 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:39.592584 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:39.593298 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.598645 18078 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:39.601125 18078 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:39.600992 18052 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.601730 18078 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:39.604435 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.608989 18002 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 2.361s	user 0.001s	sys 0.006s
I20260709 13:06:39.563033 18110 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:39.566550 18064 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.618587 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1473) took 3484 ms. Trace:
I20260709 13:06:39.620688 18110 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:39.621865 16619 rpcz_store.cc:276] 0709 13:06:36.128853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.129830 (+   977us) service_pool.cc:224] Handling call
0709 13:06:36.182627 (+ 52797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.357131 (+174504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.357162 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.357554 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.943107 (+585553us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:36.943163 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.943263 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:39.608309 (+2665046us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:39.610589 (+  2280us) raft_consensus.cc:1685] finished
0709 13:06:39.610615 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:39.613229 (+  2614us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5379,"raft.queue_time_us":15928,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":10383,"spinlock_wait_cycles":24447360,"thread_start_us":759265,"threads_started":2,"wal-append.queue_time_us":890211}
I20260709 13:06:39.629170 17996 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.629868 17996 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.630398 17802 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.630754 17990 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.630918 17802 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.632145 17996 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.631759 17990 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.633095 17802 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.634167 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.634507 17990 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.634984 16470 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:39.636219 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:39.641127 18103 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.270s	user 0.002s	sys 0.000s
I20260709 13:06:39.644166 17993 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.645797 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:39.645952 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.646948 16616 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:39.649322 17836 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:39.624883 18110 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:39.654022 18110 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.655635 18110 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:39.659346 18106 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 13:06:39.625524 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.648386 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.588388 17785 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.669008 16539 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:39.663144 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:39.606801 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:39.623332 18086 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.580s	user 0.002s	sys 0.000s
I20260709 13:06:39.672199 16469 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:39.613246 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.689170 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.689750 17944 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.693928 16367 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 168) took 4307 ms. Trace:
I20260709 13:06:39.694017 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.695911 18068 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.696135 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.696491 17985 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.697551 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.698216 16540 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:39.699394 16365 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:39.685329 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.712944 17985 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.713372 17985 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:39.713719 17985 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:39.716439 18100 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:39.717120 16542 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:39.720079 18085 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.700s	user 0.000s	sys 0.001s
I20260709 13:06:39.717906 16368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 255) took 4649 ms. Trace:
I20260709 13:06:39.627601 18111 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:39.718151 17785 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.720377 18052 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.668507 17996 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.719281 18064 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:39.750913 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44653.3us
I20260709 13:06:39.756901 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:39.759485 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:39.760232 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.763065 16539 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:39.771533 17685 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.786636 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.786435 17685 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.671530 18098 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.760988 17996 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.822432 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.823148 16540 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:39.826238 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:39.811259 17931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.015s	sys 0.028s
I20260709 13:06:39.790537 17785 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.832998 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.834872 17685 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:39.838828 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 134181us
I20260709 13:06:39.818871 17996 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.843688 16509 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:39.845544 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:39.832522 17931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.015s	sys 0.028s
W20260709 13:06:39.850065 18125 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:06:39.852880 17802 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:39.853076 16462 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:39.853307 17802 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:39.853710 17802 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.856163 17933 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.856554 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:39.857107 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.857383 17990 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.863328 16538 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:39.863583 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:39.864187 16469 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:39.864296 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.864528 18098 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.865062 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:39.865495 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:39.865743 16469 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:39.866079 16538 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:39.694586 16367 rpcz_store.cc:276] 0709 13:06:35.386671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.386816 (+   145us) service_pool.cc:224] Handling call
0709 13:06:39.693618 (+4306802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:36.138806 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:36.244529 (+105723us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:36.248683 (+  4154us) write_op.cc:435] Acquired schema lock
0709 13:06:36.261558 (+ 12875us) tablet.cc:662] Decoding operations
0709 13:06:36.369744 (+108186us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.372390 (+  2646us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.374415 (+  2025us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:36.393617 (+ 19202us) tablet.cc:701] Row locks acquired
0709 13:06:36.398978 (+  5361us) write_op.cc:260] PREPARE: finished
0709 13:06:36.415534 (+ 16556us) write_op.cc:270] Start()
0709 13:06:36.432727 (+ 17193us) write_op.cc:276] Timestamp: P: 1783602396408696 usec, L: 0
0709 13:06:36.442007 (+  9280us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.486765 (+ 44758us) log.cc:844] Serialized 536 byte log entry
0709 13:06:38.353564 (+1866799us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.494783 (+141219us) write_op.cc:301] APPLY: starting
0709 13:06:38.494909 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.495048 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.520827 (+ 25779us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:38.535678 (+ 14851us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:38.535827 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:38.535872 (+    45us) write_op.cc:312] APPLY: finished
0709 13:06:38.536065 (+   193us) log.cc:844] Serialized 23 byte log entry
0709 13:06:38.536259 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.536346 (+    87us) write_op.cc:454] Released schema lock
0709 13:06:38.536384 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.536795 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.536837 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":221819,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":102666,"apply.run_cpu_time_us":2159,"apply.run_wall_time_us":41922,"num_ops":1,"prepare.queue_time_us":127262,"prepare.run_cpu_time_us":3986,"prepare.run_wall_time_us":357032,"replication_time_us":1824665,"thread_start_us":80386,"threads_started":1}]]}
I20260709 13:06:39.857769 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.867970 17119 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:39.749811 16368 rpcz_store.cc:276] 0709 13:06:35.068030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.068167 (+   137us) service_pool.cc:224] Handling call
0709 13:06:39.717717 (+4649550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:35.376348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:35.415892 (+ 39544us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:35.419694 (+  3802us) write_op.cc:435] Acquired schema lock
0709 13:06:35.426686 (+  6992us) tablet.cc:662] Decoding operations
0709 13:06:35.898591 (+471905us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b5c0020050c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d6ef331 00007ffa3d6ef221 00007ffa3d6e9f6c 00007ffa3ae45370 00007ffa3af47e74 00007ffa3af330a6 00007ffa3af32d58 00007ffa3af379f1 00007ffa3af379a9 00007ffa3af37939 00007ffa3af37901
0709 13:06:35.898976 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:35.899042 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:35.899069 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:35.899259 (+   190us) tablet.cc:701] Row locks acquired
0709 13:06:35.899277 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:35.899423 (+   146us) write_op.cc:270] Start()
0709 13:06:35.899609 (+   186us) write_op.cc:276] Timestamp: P: 1783602395899382 usec, L: 0
0709 13:06:35.899636 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:35.900229 (+   593us) log.cc:844] Serialized 541 byte log entry
0709 13:06:36.777073 (+876844us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:38.010245 (+1233172us) op_driver.cc:464] REPLICATION: finished
0709 13:06:38.470396 (+460151us) write_op.cc:301] APPLY: starting
0709 13:06:38.470547 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:38.470729 (+   182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:38.470758 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:38.471149 (+   391us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:38.471446 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:38.471542 (+    96us) write_op.cc:312] APPLY: finished
0709 13:06:38.488263 (+ 16721us) log.cc:844] Serialized 23 byte log entry
0709 13:06:38.488499 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.488609 (+   110us) write_op.cc:454] Released schema lock
0709 13:06:38.488668 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.494341 (+  5673us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.494373 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":445237,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":459745,"apply.run_cpu_time_us":2800,"apply.run_wall_time_us":23929,"num_ops":1,"prepare.queue_time_us":103938,"prepare.run_cpu_time_us":25699,"prepare.run_wall_time_us":723251,"raft.queue_time_us":1595420,"raft.run_cpu_time_us":38207,"raft.run_wall_time_us":451687,"replication_time_us":2110356,"spinlock_wait_cycles":19819136,"thread_start_us":1428425,"threads_started":4,"wal-append.queue_time_us":274258,"wal-append.run_cpu_time_us":34072,"wal-append.run_wall_time_us":3398406}]]}
I20260709 13:06:39.872929 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.873123 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.876968 17127 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:39.877605 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.878055 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:39.860456 17935 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.608s	user 0.003s	sys 0.006s
I20260709 13:06:39.872586 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.866930 18078 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.879074 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:39.880992 16509 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:39.883956 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 145) took 1126 ms. Trace:
I20260709 13:06:39.884235 16610 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:39.844388 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.824226 17950 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.889636 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.891631 16469 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.854889 18045 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:39.894961 16545 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.895274 18115 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.870725 18094 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.891803 16538 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:39.862771 17745 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:39.902575 18094 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.881147 18099 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:39.880827 17785 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.903815 17119 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:39.910602 18115 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:39.911181 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:39.913662 17125 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:39.915551 17785 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.899667 17985 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.915741 17802 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.885334 17935 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.899044 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:39.904070 17957 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:39.916167 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.280552 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.981765 16539 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
W20260709 13:06:40.003957 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.131625 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.982941 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.246882 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.282730 16538 raft_consensus.cc:606] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.283116 16538 raft_consensus.cc:614] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:39.927125 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.284287 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:39.915561 17118 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:40.282981 16540 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:40.285595 18121 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.128134 17946 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.286600 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.286278 18121 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.287060 17946 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:39.892735 17990 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:39.893052 17924 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.307010 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:39.989022 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.280089 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.064648 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:39.989778 18133 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:40.291597 17946 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:40.291719 16536 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.160509 17933 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.349828 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1331) took 1310 ms. Trace:
I20260709 13:06:39.990211 17785 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.303s
I20260709 13:06:40.292608 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.292855 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.012007 18071 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:40.295071 18127 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.455s	user 0.001s	sys 0.001s
I20260709 13:06:40.295827 17935 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.301605 18078 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:40.302467 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 57239.7us
W20260709 13:06:40.302824 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.277547 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.305495 18099 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.306384 17802 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:39.904032 17950 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.280761 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.006026 16461 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:40.307376 17924 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.174414 18111 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:40.307498 17990 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:39.990029 18126 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:40.312829 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 183) took 1220 ms. Trace:
I20260709 13:06:40.313021 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.368101 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.313555 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.314389 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.315764 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.368085 16617 rpcz_store.cc:276] 0709 13:06:39.093725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.098246 (+  4521us) service_pool.cc:224] Handling call
0709 13:06:39.105393 (+  7147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.185238 (+ 79845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.185268 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.188514 (+  3246us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:39.188557 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.312616 (+1124059us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b54003e7454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:40.312659 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.312763 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176442112}
I20260709 13:06:40.316706 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:40.318320 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.318897 18120 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.742s	user 0.002s	sys 0.007s
I20260709 13:06:40.319339 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:40.324903 17945 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:39.989475 18045 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.327661 17985 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.328518 18121 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:39.990556 17938 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.332376 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.334530 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.367125 17924 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.338722 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.341710 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.431499 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.011824 18052 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.433642 18052 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.434923 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:40.435673 16461 raft_consensus.cc:2368] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:40.435722 18052 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.343179 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.343988 18074 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:40.346220 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.346642 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:40.346765 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:40.441154 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94583.8us
I20260709 13:06:39.889076 16465 rpcz_store.cc:276] 0709 13:06:38.757746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.795433 (+ 37687us) service_pool.cc:224] Handling call
0709 13:06:38.820999 (+ 25566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.014959 (+193960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.877792 (+862833us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b54002a85d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:39.883896 (+  6104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757376}
I20260709 13:06:40.347836 17818 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.347999 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.443046 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:39.908715 17745 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.352751 16539 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.360636 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.350297 16466 rpcz_store.cc:276] 0709 13:06:39.039502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.040269 (+   767us) service_pool.cc:224] Handling call
0709 13:06:39.045376 (+  5107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.082094 (+ 36718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.082139 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.082206 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:39.082241 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.349594 (+1267353us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:40.349642 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.349768 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83954432}
I20260709 13:06:40.370595 17945 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:40.447592 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.447896 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.448287 16618 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:40.364367 16619 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:40.313580 16613 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:40.370822 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.361722 18071 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.353011 17996 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.338418 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.453347 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.368114 17990 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.436604 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:40.437350 17123 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:40.441784 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:40.437099 18074 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:40.457863 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.458406 16616 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.440258 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:40.350050 17841 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.444545 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:40.445291 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 84738.1us
I20260709 13:06:40.446377 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.459542 16540 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.356704 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.454094 16613 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:40.454556 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83824.6us
I20260709 13:06:40.455129 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.426541 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:40.456521 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 118187us
I20260709 13:06:40.371783 18120 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.463459 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.463595 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:40.463769 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.461858 16509 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.461967 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.464458 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:40.454811 16463 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.427271 18126 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.462553 17932 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.462598 17118 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.465309 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.466106 16468 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:40.466224 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.450865 18045 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.470428 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.471012 17124 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:40.471762 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.471951 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.465672 17841 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.472675 17124 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:40.461692 18052 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.472625 17119 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:40.449463 17120 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:40.499825 16464 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:40.499830 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.460868 18140 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.465620 17802 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.467767 17818 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.467831 18099 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:40.467778 18064 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.472832 18111 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.467996 17932 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:40.463068 17993 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:06:40.511015 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 154370us
I20260709 13:06:40.522586 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.473136 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.511628 18045 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:40.521400 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.526885 16539 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:40.465910 17986 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:40.505455 18140 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:40.534930 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.513473 17818 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:40.535607 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.529193 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:40.537015 18134 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.538242 18120 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.539322 18126 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.550258 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.524168 17932 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.473341 17945 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.514657 17835 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.555588 16543 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:06:40.559451 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 67797.4us
I20260709 13:06:40.529253 18111 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:40.525053 18099 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:40.541126 17836 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:40.557276 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.548593 18134 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:40.546546 17818 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.544694 18140 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:40.564432 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 43885.2us
I20260709 13:06:40.535821 18131 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:06:40.579768 18099 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.577131 18047 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:40.582386 18047 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.584046 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.585414 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.585955 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.586799 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.587165 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.588186 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.588352 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.554862 18078 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.572003 16543 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:06:40.556751 18077 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.548177 18138 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.578363 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.568361 17944 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.579859 18052 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:40.589057 17122 raft_consensus.cc:2368] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:40.590206 17745 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:40.574016 18134 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.519076 18074 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.572808 17945 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:40.557523 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 207430us
I20260709 13:06:40.633662 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:40.562707 17841 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.565176 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1268) took 1053 ms. Trace:
I20260709 13:06:40.639503 17944 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.639623 17722 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:06:40.639736 18142 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:40.640110 17944 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.640224 17722 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.641077 18074 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.641295 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1267) took 1160 ms. Trace:
I20260709 13:06:40.584695 18047 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.642454 18047 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:40.610440 18078 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:40.642822 18047 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:40.643043 18078 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.643260 18047 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.644322 17841 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.641714 16469 rpcz_store.cc:276] 0709 13:06:39.481138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.901270 (+420132us) service_pool.cc:224] Handling call
0709 13:06:39.901657 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.919241 (+ 17584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.919281 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.980863 (+ 61582us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.441793 (+460930us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.441820 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.441865 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.641078 (+199213us) raft_consensus.cc:1685] finished
0709 13:06:40.641098 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.641235 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8902,"raft.queue_time_us":61029,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":1075,"thread_start_us":160529,"threads_started":1,"wal-append.queue_time_us":536147}
I20260709 13:06:40.645511 17836 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.645649 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:40.646016 17836 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.646519 17118 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:40.647064 16511 leader_election.cc:400] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:40.647399 16511 leader_election.cc:403] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.647461 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.648102 17962 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.648540 17962 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.564884 18045 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.645008 17841 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.654454 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.655099 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1270) took 1113 ms. Trace:
I20260709 13:06:40.655272 18046 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.656113 17986 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:40.654525 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.657562 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1271) took 1097 ms. Trace:
I20260709 13:06:40.649287 17965 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.658267 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.659529 17962 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.649715 18120 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.659648 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.655498 16461 rpcz_store.cc:276] 0709 13:06:39.542180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.542273 (+1000093us) service_pool.cc:224] Handling call
0709 13:06:40.577149 (+ 34876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.609592 (+ 32443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.609654 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.617605 (+  7951us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:40.623895 (+  6290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.633163 (+  9268us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.655039 (+ 21876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.660303 18120 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.660965 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:40.661769 18141 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:06:40.662245 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:40.662448 18120 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.663952 17802 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.664354 17802 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:40.665302 17923 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:40.665164 17802 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.666410 17802 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.666579 18045 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.667032 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1354) took 1403 ms. Trace:
I20260709 13:06:40.616940 18138 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.637993 17745 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:40.668188 18138 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.663956 17722 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.655761 18046 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.669727 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.671155 18046 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:40.673200 18071 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:40.673002 18111 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.674366 16544 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:40.667387 16464 rpcz_store.cc:276] 0709 13:06:39.263602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.641510 (+377908us) service_pool.cc:224] Handling call
0709 13:06:39.641922 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.500362 (+858440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.666724 (+166362us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:40.666915 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1972463488}
I20260709 13:06:40.648741 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:40.687726 17944 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:40.702450 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.665711 17923 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:40.650091 17996 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.655936 17841 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.660503 17122 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
W20260709 13:06:40.751399 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.755676 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78683.8us
W20260709 13:06:40.756721 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.758186 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1332) took 1717 ms. Trace:
I20260709 13:06:40.766798 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1154) took 1073 ms. Trace:
I20260709 13:06:40.767572 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.769161 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.759295 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1275) took 1173 ms. Trace:
I20260709 13:06:40.763105 16616 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:40.658013 16462 rpcz_store.cc:276] 0709 13:06:39.560508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.568023 (+  7515us) service_pool.cc:224] Handling call
0709 13:06:40.657341 (+1089318us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002a94d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:40.657498 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347477760}
I20260709 13:06:40.767185 16545 rpcz_store.cc:276] 0709 13:06:39.693269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.695276 (+  2007us) service_pool.cc:224] Handling call
0709 13:06:39.695616 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.895341 (+199725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.766591 (+871250us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540031a954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:40.766740 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458006912}
I20260709 13:06:40.772372 16618 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:40.772936 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:40.772033 16470 rpcz_store.cc:276] 0709 13:06:39.585666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.678540 (+1092874us) service_pool.cc:224] Handling call
0709 13:06:40.758874 (+ 80334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.759033 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.759056 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.759091 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.759116 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.759162 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.759247 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:40.639242 16466 rpcz_store.cc:276] 0709 13:06:39.511695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.494979 (+983284us) service_pool.cc:224] Handling call
0709 13:06:40.519953 (+ 24974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.535419 (+ 15466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.541074 (+  5655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.545743 (+  4669us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:40.548267 (+  2524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.554702 (+  6435us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.561235 (+  6533us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:40.762374 16434 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.797s (SENT)
I20260709 13:06:40.785320 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.788482 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.712910 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.790376 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.791002 16613 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.791136 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:40.790503 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.792721 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.771165 18150 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.796566 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.796866 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1359) took 1025 ms. Trace:
W20260709 13:06:40.802599 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 150812us
I20260709 13:06:40.804188 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.776396 18046 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.802450 16470 rpcz_store.cc:276] 0709 13:06:39.771770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.774983 (+1003213us) service_pool.cc:224] Handling call
0709 13:06:40.791495 (+ 16512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.792483 (+   988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.792523 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.792589 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.796588 (+  3999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.796672 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.796819 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":621,"raft.queue_time_us":2172}
W20260709 13:06:40.817230 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 54910.2us
I20260709 13:06:40.780125 18094 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:40.779706 18077 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:40.798447 17962 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.828227 16434 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.831157 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:40.832254 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:40.834517 18062 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:40.796361 17950 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:40.839664 17836 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:40.839872 17860 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.842996 17836 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:40.843753 17836 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:40.844027 17836 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:40.834828 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:40.794030 18067 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:40.834916 18062 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:40.766486 16463 rpcz_store.cc:276] 0709 13:06:39.040922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.041082 (+   160us) service_pool.cc:224] Handling call
0709 13:06:39.689948 (+648866us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:40.440824 (+750876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.476212 (+ 35388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.757978 (+281766us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001077d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:40.758126 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729501312}
I20260709 13:06:40.787258 18047 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.846235 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.846335 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.851523 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.853607 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:06:40.855016 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62348.7us
I20260709 13:06:40.855609 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:40.802688 17120 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:40.829644 17993 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:40.856611 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 61387.8us
I20260709 13:06:40.803134 16464 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:40.900869 18047 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.850600 18094 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:40.982002 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 129157us
W20260709 13:06:40.978947 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 123376us
I20260709 13:06:40.895565 18134 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.850819 18062 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.887584 17745 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.893640 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:40.912526 16461 raft_consensus.cc:2410] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:40.913580 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:40.848244 17950 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:40.908690 17990 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.853475 18126 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:40.810781 18150 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.895817 17924 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.853340 17935 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.848706 17923 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.901531 18140 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:40.893159 17944 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.999977 17944 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:40.898066 17932 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.000537 17990 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.002117 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1261) took 1530 ms. Trace:
I20260709 13:06:41.002348 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 382) took 1184 ms. Trace:
I20260709 13:06:41.002761 17127 rpcz_store.cc:276] 0709 13:06:39.817591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.817803 (+   212us) service_pool.cc:224] Handling call
0709 13:06:41.002162 (+1184359us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.002270 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99639552}
I20260709 13:06:41.003283 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.004062 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.000415 17944 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:40.854350 18077 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:40.798691 17722 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:06:40.828697 17957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42888 (request call id 7) took 8824 ms. Trace:
I20260709 13:06:40.980265 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:40.991981 18158 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:40.980839 18059 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.844756 17836 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:40.987484 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 141222us
I20260709 13:06:40.988018 18151 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.032622 16583 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:40.991365 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1589) took 1112 ms. Trace:
I20260709 13:06:40.975773 17962 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:40.976930 17802 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.993186 16615 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:40.976575 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:40.999550 18140 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:40.944703 16613 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:41.002523 16468 rpcz_store.cc:276] 0709 13:06:39.471648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.721274 (+249626us) service_pool.cc:224] Handling call
0709 13:06:39.721594 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.472216 (+750622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.001907 (+529691us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400357fd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:41.002062 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711708544}
I20260709 13:06:40.989436 17950 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.015960 16541 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:41.003999 17119 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:40.983450 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.042472 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:41.035633 16540 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.571s	user 0.016s	sys 0.002s
I20260709 13:06:41.035563 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.038241 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.028587 18077 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.033970 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.025153 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.043115 16540 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:41.053102 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.031247 18158 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.061295 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.033525 16545 rpcz_store.cc:276] 0709 13:06:39.878835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.774138 (+895303us) service_pool.cc:224] Handling call
0709 13:06:40.790773 (+ 16635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.790993 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:40.829380 (+ 38387us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.987322 (+157942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.987366 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:40.987403 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.987459 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.991314 (+  3855us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35624,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3660,"raft.queue_time_us":149,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":2657,"spinlock_wait_cycles":9858688,"thread_start_us":156982,"threads_started":1,"wal-append.queue_time_us":158526}
I20260709 13:06:41.045851 17935 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.048297 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.049537 18150 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.050233 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.054778 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:41.063127 18040 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.041102 17802 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.065999 17944 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.066993 18062 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.071755 17818 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.072304 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1273) took 1487 ms. Trace:
I20260709 13:06:41.073987 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.074573 18163 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.058527 17836 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.083209 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.092232 18077 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.133078 16540 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:41.084174 18138 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.133549 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.034874 18059 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.053756 17962 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.061990 18158 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:41.086660 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 52774.8us
I20260709 13:06:41.088815 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.143219 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.090235 16468 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:41.093279 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:41.117280 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 133900us
I20260709 13:06:41.145449 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.146906 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:41.118409 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55764.8us
W20260709 13:06:41.119158 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.030660 18094 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:41.123206 16469 rpcz_store.cc:276] 0709 13:06:39.584878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.646718 (+1061840us) service_pool.cc:224] Handling call
0709 13:06:40.647009 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.647311 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.647338 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.647791 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.831965 (+184174us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:40.832000 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.832072 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.072110 (+240038us) raft_consensus.cc:1685] finished
0709 13:06:41.072128 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.072250 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4834,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":7005,"thread_start_us":158170,"threads_started":1,"wal-append.queue_time_us":338603}
I20260709 13:06:41.149277 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.150568 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.151535 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.132503 17924 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.134603 16543 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.134137 17802 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.093199 17938 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:41.136170 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.024448 17957 rpcz_store.cc:276] 0709 13:06:31.976500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.976703 (+   203us) service_pool.cc:224] Handling call
0709 13:06:32.141129 (+164426us) log.cc:844] Serialized 506 byte log entry
0709 13:06:32.552398 (+411269us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18000bf0e0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa37456b0b 00007ffa374dbb63 00007ffa37503752 00007ffa3c4c3d29
0709 13:06:32.878226 (+325828us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b1800013980. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37539d01 00007ffa37476691 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199
0709 13:06:33.236314 (+358088us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b4c0007ab80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa357c9a20 00007ffa357daa29 00007ffa357db13f 00007ffa3579f2ab 00007ffa357ccf3c 00007ffa357cd3fe 00007ffa35a5a50b 00007ffa37459381 00007ffa3745726b 00007ffa3745dd53 00007ffa3745dcd9
0709 13:06:40.789212 (+7552898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238032,"raft.queue_time_us":254860,"raft.run_cpu_time_us":16154,"raft.run_wall_time_us":766676,"spinlock_wait_cycles":39254400,"thread_start_us":123262,"threads_started":1,"wal-append.queue_time_us":183049,"wal-append.run_cpu_time_us":1877,"wal-append.run_wall_time_us":1016906}
I20260709 13:06:41.134137 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1157) took 1421 ms. Trace:
I20260709 13:06:41.166368 16536 rpcz_store.cc:276] 0709 13:06:39.713163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.735992 (+ 22829us) service_pool.cc:224] Handling call
0709 13:06:40.291580 (+555588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.326188 (+ 34608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.133919 (+807731us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540031a450. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.134074 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151079296}
I20260709 13:06:41.167816 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.135157 18150 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:06:41.169593 18150 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.169916 18150 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:41.170724 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.171459 17120 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:41.172010 17818 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.155846 18062 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.173563 18134 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.174178 17802 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:41.174366 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.174700 17802 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.176046 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.159785 18163 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:06:41.177269 18078 consensus_meta.cc:287] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.005s
I20260709 13:06:41.140437 16538 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:41.152451 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.153393 16467 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.144057 16545 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:41.155886 17127 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:41.162253 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.183073 16619 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.165719 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.140206 17944 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.178664 16614 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:41.185513 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.163290 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.184289 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.156255 17990 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.168507 16536 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.186340 16538 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:41.177196 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:41.159621 18164 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.164594 18067 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.182121 17127 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:41.203173 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.204025 16468 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.190362 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.189445 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.178557 17122 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.159861 18077 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:41.157173 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.204694 16545 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:41.185638 17924 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.177456 18163 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:41.213574 18153 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.316s	user 0.018s	sys 0.000s
I20260709 13:06:41.214782 18163 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.206998 18046 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.215440 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.216373 16542 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:41.206152 16469 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:41.217152 16469 pending_rounds.cc:85] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 2
I20260709 13:06:41.176669 17802 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.189550 18045 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.159945 17962 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.219801 16468 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.222892 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.220559 17993 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:06:41.226790 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.226958 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.221972 16469 pending_rounds.cc:107] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:41.231338 16538 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:41.187062 18078 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.235854 18078 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.231436 16469 raft_consensus.cc:2889] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.170753 18150 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.228380 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.210543 18138 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.237452 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.230400 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.244120 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.244444 16545 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:41.244737 16538 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:41.219175 16465 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.238914 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:41.210835 18077 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.247879 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.249220 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:41.249672 17965 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.249946 17950 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:41.250553 17950 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:41.250706 18131 raft_consensus.cc:1064] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:41.250859 18077 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.251439 17950 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.253388 18121 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.254110 18121 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.254624 18121 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.255452 17962 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.256043 16461 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:41.256376 16461 pending_rounds.cc:85] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 2
I20260709 13:06:41.256599 16461 pending_rounds.cc:107] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:41.256889 16461 raft_consensus.cc:2889] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.258190 16461 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.259289 16461 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.261046 18150 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.208757 18164 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.250104 17965 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.253482 17835 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:41.233671 18045 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:41.240829 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:41.265581 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:41.267393 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.273646 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.246938 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.254144 18067 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:41.264760 17965 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.243223 17745 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:06:41.254124 18059 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:41.333387 16469 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.265020 17835 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:41.271756 18077 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.273033 17957 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:41.285954 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:41.351485 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.292984 17119 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.354452 16619 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.354687 16469 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.357117 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.358551 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.359640 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.349746 18077 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.262005 18131 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.361176 18077 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.363704 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.364354 16545 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:41.350227 17957 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.350829 18045 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.368396 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:41.368518 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.371649 16616 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:41.372797 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:41.376979 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 129913us
I20260709 13:06:41.379391 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.380580 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.381021 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:41.381976 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.384562 18164 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:41.384876 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.385516 18140 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.385882 16619 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.389595 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.385365 16610 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:41.393227 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.391670 18067 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.404263 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.373219 17957 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.405961 16545 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.410434 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.411212 18045 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.393327 17745 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:41.415352 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.420104 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:41.425869 18149 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.569s	user 0.000s	sys 0.007s
I20260709 13:06:41.427838 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1164) took 1712 ms. Trace:
I20260709 13:06:41.421027 17745 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.429921 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.430958 17745 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.431362 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.421854 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.432446 16545 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:41.434841 16466 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.435532 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1361) took 1663 ms. Trace:
I20260709 13:06:41.435338 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.435922 16466 rpcz_store.cc:276] 0709 13:06:39.772349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.795944 (+1023595us) service_pool.cc:224] Handling call
0709 13:06:41.434519 (+638575us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:41.434667 (+   148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.435276 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.435478 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10688256}
I20260709 13:06:41.437561 16618 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:41.436919 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.438608 17835 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.439141 16465 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:41.424235 18175 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:06:41.439822 17835 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.441556 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1365) took 1461 ms. Trace:
I20260709 13:06:41.439904 16469 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.428313 16539 rpcz_store.cc:276] 0709 13:06:39.715050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.534175 (+819125us) service_pool.cc:224] Handling call
0709 13:06:40.536607 (+  2432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.547148 (+ 10541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.547190 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.547595 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.625451 (+ 77856us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:40.679302 (+ 53851us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.761796 (+ 82494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.761863 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.425316 (+663453us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:41.427490 (+  2174us) raft_consensus.cc:1685] finished
0709 13:06:41.427611 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.427770 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1240,"prepare.queue_time_us":61013,"prepare.run_cpu_time_us":5911,"prepare.run_wall_time_us":73269,"raft.queue_time_us":9842,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":18510,"spinlock_wait_cycles":293732608,"thread_start_us":77546,"threads_started":1,"wal-append.queue_time_us":250664}
I20260709 13:06:41.441921 16470 rpcz_store.cc:276] 0709 13:06:39.980431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.840600 (+860169us) service_pool.cc:224] Handling call
0709 13:06:41.440917 (+600317us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:41.441098 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.441269 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.441297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.441337 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.441366 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.441417 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.441506 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11126016}
I20260709 13:06:41.439654 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e831b8c574943b8b259e490e4d208"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:41.443653 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:41.443958 16545 raft_consensus.cc:606] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.422768 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:41.445467 17127 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:41.422641 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.447968 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.454600 16544 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:41.432567 18172 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:41.468144 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 187) took 1305 ms. Trace:
I20260709 13:06:41.469705 16545 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.475919 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 178) took 1589 ms. Trace:
I20260709 13:06:41.470638 18121 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.471868 16541 rpcz_store.cc:276] 0709 13:06:40.149497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.315489 (+165992us) service_pool.cc:224] Handling call
0709 13:06:41.454204 (+1138715us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54000c0654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.454349 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1482647296}
I20260709 13:06:41.469918 18126 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.644047 18126 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:41.644345 16541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d214c667f1547569798ec88932945a2"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:41.644953 16541 raft_consensus.cc:606] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.645241 18121 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.644902 18126 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.646232 18126 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.646381 16541 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.647018 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 179) took 1752 ms. Trace:
I20260709 13:06:41.647311 16541 rpcz_store.cc:276] 0709 13:06:39.894447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.645946 (+1751499us) service_pool.cc:224] Handling call
0709 13:06:41.646221 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.646826 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.646973 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.647709 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.439679 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1281) took 1009 ms. Trace:
I20260709 13:06:41.648401 16541 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:41.557713 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 148570us
I20260709 13:06:41.649047 17124 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.649561 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.650308 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 180) took 1749 ms. Trace:
I20260709 13:06:41.650722 16541 rpcz_store.cc:276] 0709 13:06:39.900549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.648014 (+1747465us) service_pool.cc:224] Handling call
0709 13:06:41.648264 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.650083 (+  1819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.650246 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.622934 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.652119 18158 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:41.653028 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.653518 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.653827 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.627559 17957 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.631394 16613 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:41.655177 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:41.476435 16545 rpcz_store.cc:276] 0709 13:06:39.886307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.469271 (+1582964us) service_pool.cc:224] Handling call
0709 13:06:41.469551 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.475610 (+  6059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.475850 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.634166 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:41.658447 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.633863 16466 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:41.477370 16470 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.641099 16536 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:41.648587 16465 rpcz_store.cc:276] 0709 13:06:40.430305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.466474 (+ 36169us) service_pool.cc:224] Handling call
0709 13:06:41.157022 (+690548us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:41.439609 (+282587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4729600}
I20260709 13:06:41.642153 18077 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:41.472802 18148 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.013s	sys 0.008s
I20260709 13:06:41.652547 16541 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:41.668071 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 181) took 1761 ms. Trace:
I20260709 13:06:41.668426 16541 rpcz_store.cc:276] 0709 13:06:39.906524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.652010 (+1745486us) service_pool.cc:224] Handling call
0709 13:06:41.652273 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.667842 (+ 15569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.668021 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.664582 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.665361 16539 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.657001 17957 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.671393 16545 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.633462 17122 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:41.668891 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1590) took 1383 ms. Trace:
I20260709 13:06:41.672122 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 189) took 1421 ms. Trace:
I20260709 13:06:41.672834 18158 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.673552 16545 rpcz_store.cc:276] 0709 13:06:40.251136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.665048 (+1413912us) service_pool.cc:224] Handling call
0709 13:06:41.671146 (+  6098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.671848 (+   702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.672074 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.670058 18148 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.016s	sys 0.008s
I20260709 13:06:41.665205 17933 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:41.665725 18180 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.677853 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1597) took 1344 ms. Trace:
I20260709 13:06:41.666646 18131 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.682129 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:41.682626 16545 raft_consensus.cc:606] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:41.682921 16545 raft_consensus.cc:614] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.681592 16541 rpcz_store.cc:276] 0709 13:06:40.333767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.669172 (+1335405us) service_pool.cc:224] Handling call
0709 13:06:41.677268 (+  8096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.677469 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.677505 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.677559 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:41.677602 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.677679 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.677793 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.686280 16614 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.680775 18121 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:41.689913 16541 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.670467 18181 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:41.682337 18131 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.684208 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.691963 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1165) took 1343 ms. Trace:
I20260709 13:06:41.692689 16541 rpcz_store.cc:276] 0709 13:06:40.348558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.684276 (+1335718us) service_pool.cc:224] Handling call
0709 13:06:41.689107 (+  4831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.691685 (+  2578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.691879 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.692790 18121 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.694283 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1167) took 1345 ms. Trace:
I20260709 13:06:41.694650 16541 rpcz_store.cc:276] 0709 13:06:40.349113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.693552 (+1344439us) service_pool.cc:224] Handling call
0709 13:06:41.693826 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.693993 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.694019 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.694070 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:41.694100 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.694150 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.694238 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.708928 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:41.719909 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.709511 17123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 385) took 1860 ms (client timeout 1524 ms). Trace:
I20260709 13:06:41.712363 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 374) took 1199 ms. Trace:
W20260709 13:06:41.720636 17123 rpcz_store.cc:269] 0709 13:06:39.849579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.851239 (+  1660us) service_pool.cc:224] Handling call
0709 13:06:39.916013 (+ 64774us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:41.709337 (+1793324us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400661554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.709452 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376961664}
W20260709 13:06:41.844022 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.711279 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1420) took 1059 ms. Trace:
I20260709 13:06:41.707650 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1274) took 2122 ms. Trace:
I20260709 13:06:41.845293 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.845412 16467 rpcz_store.cc:276] 0709 13:06:39.585332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.673257 (+1087925us) service_pool.cc:224] Handling call
0709 13:06:40.673546 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.184981 (+511435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.707419 (+522438us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54003af054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:41.707584 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1103032704}
I20260709 13:06:41.727947 16542 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.827394 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1166) took 1478 ms. Trace:
I20260709 13:06:41.821436 16540 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.848361 16545 rpcz_store.cc:276] 0709 13:06:40.348865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.691199 (+1342334us) service_pool.cc:224] Handling call
0709 13:06:41.826887 (+135688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.827063 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.827104 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.827142 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.827169 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.827218 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.827338 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.849859 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1170) took 1497 ms. Trace:
I20260709 13:06:41.850351 16540 rpcz_store.cc:276] 0709 13:06:40.352636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.820517 (+1467881us) service_pool.cc:224] Handling call
0709 13:06:41.820953 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.849622 (+ 28669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.849809 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.845026 16615 rpcz_store.cc:276] 0709 13:06:40.651890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.652026 (+   136us) service_pool.cc:224] Handling call
0709 13:06:40.658304 (+  6278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.037736 (+379432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.711067 (+673331us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b540001f4d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:41.711225 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769758464}
W20260709 13:06:41.852852 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.721335 17124 rpcz_store.cc:276] 0709 13:06:40.512749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.367814 (+855065us) service_pool.cc:224] Handling call
0709 13:06:41.389187 (+ 21373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.649406 (+260219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.712114 (+ 62708us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b540047bb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:41.712302 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597249920}
I20260709 13:06:41.854084 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1169) took 1502 ms. Trace:
I20260709 13:06:41.727931 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:41.851122 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1168) took 1501 ms. Trace:
I20260709 13:06:41.855154 16542 rpcz_store.cc:276] 0709 13:06:40.352389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.727492 (+1375103us) service_pool.cc:224] Handling call
0709 13:06:41.727803 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.853847 (+126044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.854029 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.855595 16541 rpcz_store.cc:276] 0709 13:06:40.351799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.695559 (+1343760us) service_pool.cc:224] Handling call
0709 13:06:41.850516 (+154957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.850738 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.850775 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.850828 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.850869 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.850938 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.851056 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.861951 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.857803 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 129972us
I20260709 13:06:41.691282 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.703514 17923 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:41.706296 16612 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:41.835690 18154 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.042s	user 0.005s	sys 0.009s
I20260709 13:06:41.866182 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:41.698709 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 373) took 1199 ms. Trace:
I20260709 13:06:41.867113 16540 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:41.692235 18131 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.872696 18077 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:41.872699 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1172) took 1518 ms. Trace:
I20260709 13:06:41.873497 16540 rpcz_store.cc:276] 0709 13:06:40.354536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.851343 (+1496807us) service_pool.cc:224] Handling call
0709 13:06:41.866848 (+ 15505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.872428 (+  5580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.872645 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.701949 18181 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.868492 16542 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:41.868872 16545 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:41.815274 17932 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:41.875988 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1173) took 1521 ms. Trace:
I20260709 13:06:41.702266 17962 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.169s
I20260709 13:06:41.814630 18045 raft_consensus.cc:993] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:41.863579 17933 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:41.875066 17118 rpcz_store.cc:276] 0709 13:06:40.501824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.360477 (+858653us) service_pool.cc:224] Handling call
0709 13:06:41.363559 (+  3082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.642219 (+278660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.642257 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.642912 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.666433 (+ 23521us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.671303 (+  4870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.674343 (+  3040us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.698500 (+ 24157us) raft_consensus.cc:1685] finished
0709 13:06:41.698522 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.698655 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85644,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":249977,"threads_started":2,"wal-append.queue_time_us":21709}
I20260709 13:06:41.880760 18040 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:41.881246 18040 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:41.881979 17118 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.882064 18040 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:41.673273 16536 rpcz_store.cc:276] 0709 13:06:40.285266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.668047 (+1382781us) service_pool.cc:224] Handling call
0709 13:06:41.668343 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.668518 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.668543 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.668583 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.668620 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.668686 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.668821 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.727121 17121 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:41.883358 18040 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:41.884316 16536 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:41.884589 17121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 384) took 2038 ms (client timeout 1979 ms). Trace:
I20260709 13:06:41.884997 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1163) took 2170 ms. Trace:
I20260709 13:06:41.885707 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 177) took 2006 ms. Trace:
I20260709 13:06:41.886119 16539 rpcz_store.cc:276] 0709 13:06:39.879071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.465772 (+1586701us) service_pool.cc:224] Handling call
0709 13:06:41.665204 (+199432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.669875 (+  4671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.885540 (+215665us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540007a150. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.885658 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457739520}
I20260709 13:06:41.885138 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1175) took 1097 ms. Trace:
I20260709 13:06:41.887691 16536 rpcz_store.cc:276] 0709 13:06:40.787697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.883812 (+1096115us) service_pool.cc:224] Handling call
0709 13:06:41.884138 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.884847 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.885085 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.889056 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1585) took 2114 ms. Trace:
I20260709 13:06:41.885524 16537 rpcz_store.cc:276] 0709 13:06:39.714804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.473658 (+758854us) service_pool.cc:224] Handling call
0709 13:06:40.527747 (+ 54089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.550299 (+ 22552us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:40.554650 (+  4351us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.589301 (+ 34651us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.729939 (+140638us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:40.733579 (+  3640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.740194 (+  6615us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.834984 (+1094790us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:41.884677 (+ 49693us) raft_consensus.cc:1685] finished
0709 13:06:41.884697 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.884941 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113091456,"thread_start_us":101873,"threads_started":1,"wal-append.queue_time_us":170288}
I20260709 13:06:41.889587 16543 rpcz_store.cc:276] 0709 13:06:39.774317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.611197 (+836880us) service_pool.cc:224] Handling call
0709 13:06:40.629260 (+ 18063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.155443 (+526183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.888845 (+733402us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b5400319a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:41.889003 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161729792}
I20260709 13:06:41.890630 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1602) took 1050 ms. Trace:
I20260709 13:06:41.891203 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1603) took 1051 ms. Trace:
I20260709 13:06:41.891592 16543 rpcz_store.cc:276] 0709 13:06:40.840275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.890500 (+1050225us) service_pool.cc:224] Handling call
0709 13:06:41.890781 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.890933 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.890957 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.890992 (+    35us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.891017 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.891071 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.891156 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.892565 17950 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:41.892889 18180 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.893309 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:41.894106 16619 raft_consensus.cc:2393] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:41.893872 18064 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:41.887676 16539 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:41.699973 17119 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:41.896917 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1176) took 1103 ms. Trace:
I20260709 13:06:41.869634 17124 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:41.875905 16538 raft_consensus.cc:606] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:41.899621 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 390) took 1314 ms. Trace:
I20260709 13:06:41.899847 16538 raft_consensus.cc:614] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:41.900044 17124 rpcz_store.cc:276] 0709 13:06:40.585247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.869206 (+1283959us) service_pool.cc:224] Handling call
0709 13:06:41.869467 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.899269 (+ 29802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.899565 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.900692 18182 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.901295 17124 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.878387 16542 rpcz_store.cc:276] 0709 13:06:40.354743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.856439 (+1501696us) service_pool.cc:224] Handling call
0709 13:06:41.868240 (+ 11801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.875757 (+  7517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.875940 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.698522 17965 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:41.864019 17802 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:06:41.909196 18138 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:06:41.885056 17121 rpcz_store.cc:269] 0709 13:06:39.845915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.847330 (+  1415us) service_pool.cc:224] Handling call
0709 13:06:40.669461 (+822131us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:41.884385 (+1214924us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54006e0ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:41.884520 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450036352}
I20260709 13:06:41.915151 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.912849 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.898139 17127 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:41.898535 18155 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 1.005s	user 0.005s	sys 0.010s
I20260709 13:06:41.866207 16509 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:41.901454 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1277) took 2315 ms. Trace:
I20260709 13:06:41.902320 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 394) took 1320 ms. Trace:
W20260709 13:06:41.902478 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 779339us
I20260709 13:06:41.902931 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1363) took 2026 ms. Trace:
I20260709 13:06:41.903239 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 308) took 1143 ms. Trace:
I20260709 13:06:41.898015 16539 rpcz_store.cc:276] 0709 13:06:40.793917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.887039 (+1093122us) service_pool.cc:224] Handling call
0709 13:06:41.887350 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.896666 (+  9316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.896867 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:41.904088 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.925487 17124 rpcz_store.cc:276] 0709 13:06:40.760318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.900839 (+1140521us) service_pool.cc:224] Handling call
0709 13:06:41.901131 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.902342 (+  1211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.903164 (+   822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.876714 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1171) took 1522 ms. Trace:
W20260709 13:06:41.904286 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 815591us
I20260709 13:06:41.905961 17938 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:41.875546 18181 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:41.906474 17818 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:41.913391 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1286) took 1281 ms. Trace:
I20260709 13:06:41.951226 16436 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.950706 16468 rpcz_store.cc:276] 0709 13:06:40.631758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.251479 (+619721us) service_pool.cc:224] Handling call
0709 13:06:41.251779 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.251944 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:41.270833 (+ 18889us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.913085 (+642252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.913134 (+    49us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.913174 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.913234 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.913339 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625074,"prepare.queue_time_us":97243,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":41,"raft.queue_time_us":625551,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":35370,"threads_started":2,"wal-append.queue_time_us":82045}
I20260709 13:06:41.952929 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.951228 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:41.953678 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 73358.3us
I20260709 13:06:41.954305 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.955772 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.957674 17126 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:41.882843 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 391) took 1297 ms. Trace:
I20260709 13:06:41.898604 18045 raft_consensus.cc:1081] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:06:41.919299 16464 rpcz_store.cc:276] 0709 13:06:39.586308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.715588 (+1129280us) service_pool.cc:224] Handling call
0709 13:06:40.779781 (+ 64193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.789610 (+  9829us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:41.023133 (+233523us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.117969 (+ 94836us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.728328 (+610359us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b18003ba160. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:41.901015 (+172687us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18003ba160. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:06:41.901167 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.901211 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:41.901246 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.901304 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.901404 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4459,"prepare.queue_time_us":27975,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":789405,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":3155,"spinlock_wait_cycles":19918976,"thread_start_us":62718,"threads_started":1,"wal-append.queue_time_us":104037}
I20260709 13:06:41.921692 17123 rpcz_store.cc:276] 0709 13:06:40.581703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.789451 (+1207748us) service_pool.cc:224] Handling call
0709 13:06:41.789855 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.801538 (+ 11683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.801570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.814816 (+ 13246us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.866170 (+ 51354us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:41.866208 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.866283 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.902139 (+ 35856us) raft_consensus.cc:1685] finished
0709 13:06:41.902156 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.902268 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1406,"raft.queue_time_us":1724,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":17044,"thread_start_us":50923,"threads_started":1,"wal-append.queue_time_us":82185}
I20260709 13:06:41.927547 16545 rpcz_store.cc:276] 0709 13:06:40.354306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.850083 (+1495777us) service_pool.cc:224] Handling call
0709 13:06:41.868612 (+ 18529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.875815 (+  7203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.876649 (+   834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.927538 16543 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:41.891129 16537 rpcz_store.cc:276] 0709 13:06:40.839831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.890047 (+1050216us) service_pool.cc:224] Handling call
0709 13:06:41.890292 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.890410 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.890429 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.890460 (+    31us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.890479 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.890516 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.890591 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.929581 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.968056 16470 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:06:41.943614 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 77493.7us
I20260709 13:06:41.968973 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.969496 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.945282 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.949777 17124 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.972213 16509 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.959580 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.957342 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.913383 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:41.961643 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.958808 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.973809 16509 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:41.973989 16469 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:41.918262 17933 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:41.964257 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.966570 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.957715 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:41.978760 16538 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:41.980962 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.961898 17932 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:41.983709 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 86754.5us
I20260709 13:06:41.984395 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.985508 16464 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:41.987802 18190 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.990173 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 195) took 1211 ms. Trace:
I20260709 13:06:41.990556 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:41.990794 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:41.990597 16540 rpcz_store.cc:276] 0709 13:06:40.778670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.874301 (+1095631us) service_pool.cc:224] Handling call
0709 13:06:41.874600 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.874786 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:41.982230 (+107444us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.989767 (+  7537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.989810 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.989970 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.990027 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.990125 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4237,"prepare.queue_time_us":107100,"prepare.run_cpu_time_us":21,"prepare.run_wall_time_us":22,"thread_start_us":84579,"threads_started":2}
I20260709 13:06:41.992488 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:41.994606 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.976115 17802 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:41.957326 18183 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:42.004248 17124 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:41.975054 18062 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.002070 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:41.981349 18140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.053s
I20260709 13:06:42.003340 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.042510 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:42.011140 17123 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:41.975288 17985 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:42.038532 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:41.980867 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.000720 17122 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:41.976893 17944 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.001195 16465 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:42.038626 16434 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:42.044257 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:41.982767 18138 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.034437 17802 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:41.976840 18077 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:06:42.002226 18094 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.041576 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.067855 16540 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:41.998991 18198 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.964520 17118 rpcz_store.cc:276] 0709 13:06:40.585503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.881406 (+1295903us) service_pool.cc:224] Handling call
0709 13:06:41.881792 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.882574 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.882768 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.048383 18068 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.057844 17124 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.047485 18045 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:42.045320 18140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.017s	sys 0.053s
I20260709 13:06:42.061766 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:42.015468 16509 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:42.094079 16469 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.094215 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 78851.7us
I20260709 13:06:42.095172 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:42.095664 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 57260.2us
I20260709 13:06:41.989400 18158 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:42.041576 18180 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:42.007699 17932 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.045068 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 397) took 1060 ms. Trace:
I20260709 13:06:42.061637 17944 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.081070 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.096604 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:42.081422 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:42.068634 17802 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.086674 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 309) took 1326 ms. Trace:
W20260709 13:06:42.080374 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 85834.7us
I20260709 13:06:42.068431 18062 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.058516 17938 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.088856 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.089978 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.088744 17124 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:42.076411 17818 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:42.098534 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 193011us
I20260709 13:06:42.099519 18180 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.077824 18094 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.107544 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.118250 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.121767 16540 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:42.121734 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:42.122951 16436 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:42.094261 17950 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.097102 18193 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.124809 18193 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:42.125043 18059 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.125432 18059 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:42.125800 18059 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.125733 18193 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.127183 18193 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:42.112265 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 145755us
I20260709 13:06:42.131935 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:41.924528 16462 rpcz_store.cc:276] 0709 13:06:39.876487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.796522 (+920035us) service_pool.cc:224] Handling call
0709 13:06:40.893883 (+ 97361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.894151 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:41.041417 (+147266us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.902429 (+861012us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.902481 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:41.902529 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.902762 (+   233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.902879 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":783626,"prepare.queue_time_us":180996,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":34,"raft.queue_time_us":787858,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":59,"thread_start_us":192638,"threads_started":2,"wal-append.queue_time_us":85230}
I20260709 13:06:42.098201 17944 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:42.133587 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.136020 18059 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.098613 18199 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.138127 18059 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.042006 18181 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.138741 18059 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.118332 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:42.140095 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 110929us
I20260709 13:06:42.140821 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:42.106098 18183 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.099622 17965 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.105333 18192 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.106171 18045 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:42.147413 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.158061 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.163504 16545 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:42.156560 18183 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:42.169117 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.169795 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.152894 17124 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.120193 18062 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:42.153179 18200 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:42.204566 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:42.173074 16540 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:06:42.197839 17124 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.198283 18059 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:42.106417 17122 rpcz_store.cc:276] 0709 13:06:40.760563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.909615 (+1149052us) service_pool.cc:224] Handling call
0709 13:06:41.963911 (+ 54296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.063944 (+100033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.086588 (+ 22644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.146057 18077 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.118235 18205 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.155659 17985 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:06:42.094619 17933 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.164625 17835 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.141640 18126 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.097990 17119 rpcz_store.cc:276] 0709 13:06:40.981629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.918535 (+936906us) service_pool.cc:224] Handling call
0709 13:06:41.961431 (+ 42896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.975306 (+ 13875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.980170 (+  4864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.983464 (+  3294us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.001453 (+ 17989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.008403 (+  6950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.042353 (+ 33950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:42.199836 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 304) took 1729 ms. Trace:
W20260709 13:06:42.213289 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 95034.8us
I20260709 13:06:42.168170 18150 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.216531 18207 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.171568 17935 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:42.209385 18201 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:06:42.202276 17965 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.142210 18047 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.209309 16465 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:42.222508 18199 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.236995 18203 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.263377 18126 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.320302 17965 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.249661 17935 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:42.253692 18212 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.313360 18059 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:42.331104 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 93463.7us
I20260709 13:06:42.326538 18131 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.312335 18214 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:06:42.241117 18045 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.250101 18077 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:42.252030 18207 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.357939 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 193) took 1580 ms. Trace:
I20260709 13:06:42.238813 18183 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:42.360524 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 249899us
I20260709 13:06:42.335811 18040 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.236265 17120 rpcz_store.cc:276] 0709 13:06:40.470653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.172250 (+701597us) service_pool.cc:224] Handling call
0709 13:06:41.897246 (+724996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.898276 (+  1030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.898308 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:41.898349 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.898387 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.898450 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.199540 (+301090us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54006e0ad0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:42.199728 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662115584}
W20260709 13:06:42.379060 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126862us
W20260709 13:06:42.356456 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 260266us
I20260709 13:06:42.371687 17124 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:42.359030 17935 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.264645 18062 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.373777 16541 rpcz_store.cc:276] 0709 13:06:40.777915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.856614 (+1078699us) service_pool.cc:224] Handling call
0709 13:06:41.870130 (+ 13516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.870329 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:42.046724 (+176395us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.357031 (+310307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.357093 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:42.357681 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.357758 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.357887 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":111391,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":437478,"threads_started":2}
I20260709 13:06:42.380972 17124 pending_rounds.cc:85] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 4
I20260709 13:06:42.385010 17124 pending_rounds.cc:107] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:42.361342 18212 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:42.385476 17124 raft_consensus.cc:2889] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.361506 17944 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.386166 18196 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:42.390307 17944 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.390580 17950 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:42.391290 18212 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.392072 18196 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.392470 18196 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:42.393244 18040 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.393479 18196 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.392388 17932 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.360643 17965 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.406477 18183 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.394783 18214 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:42.409029 18126 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:06:42.417074 18215 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:42.438228 18126 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.438604 18126 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:42.439421 18126 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.423138 16469 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:42.407470 17841 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.445451 17841 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.446388 17841 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.447433 17841 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.409884 18180 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:42.448904 16583 consensus_peers.cc:597] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 14ab75d98ba64a9caa062cd19a0594fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:42.434290 17965 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:42.449892 17802 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.450946 18207 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:42.452191 17802 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:42.435832 18150 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.448441 18077 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.454704 18094 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.457538 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1178) took 1630 ms. Trace:
I20260709 13:06:42.461822 17993 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.412415 18199 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.459348 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 376) took 1930 ms. Trace:
I20260709 13:06:42.457973 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 303) took 1987 ms. Trace:
I20260709 13:06:42.440577 18126 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.464695 17127 rpcz_store.cc:276] 0709 13:06:40.528991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.446214 (+917223us) service_pool.cc:224] Handling call
0709 13:06:41.897972 (+451758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.918721 (+ 20749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.459132 (+540411us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540060f750. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:42.459290 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038088960}
I20260709 13:06:42.468916 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:42.470731 18223 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:42.470979 17950 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.430701 18045 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.466395 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:42.465080 18219 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:06:42.441776 18196 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.467090 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:42.476608 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.442909 16462 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:42.486114 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.488644 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.489403 16539 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:42.491044 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.491673 16539 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.465426 17126 rpcz_store.cc:276] 0709 13:06:40.470388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.548747 (+ 78359us) service_pool.cc:224] Handling call
0709 13:06:41.709486 (+1160739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.958301 (+248815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.456923 (+498622us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400661554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:42.457770 (+   847us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400661550. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:42.457911 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184270976}
I20260709 13:06:42.462285 17993 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.431098 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.461849 18131 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:42.504904 16543 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:42.505100 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:42.506059 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.507458 16538 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.513561 16545 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.515504 16541 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:42.521987 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 90964.1us
I20260709 13:06:42.522779 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.527908 16539 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:42.460330 16536 rpcz_store.cc:276] 0709 13:06:40.826977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.888691 (+1061714us) service_pool.cc:224] Handling call
0709 13:06:41.889018 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.889211 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:42.052943 (+163732us) log.cc:844] Serialized 14 byte log entry
0709 13:06:42.419124 (+366181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:42.425245 (+  6121us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:42.441998 (+ 16753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.456521 (+ 14523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.457150 (+   629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15405,"prepare.queue_time_us":92943,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":190471,"spinlock_wait_cycles":12538624,"thread_start_us":437841,"threads_started":3,"wal-append.queue_time_us":191576}
I20260709 13:06:42.514324 18201 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.514832 18228 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.514147 17957 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:42.534745 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.534374 17802 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.545922 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:42.546761 17125 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:42.548760 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:42.549124 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:42.549479 17124 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:42.528702 17932 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:42.555583 17957 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.555970 17957 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:42.556097 18230 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.513809 17993 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.554399 16461 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.555371 18210 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:42.561841 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1588) took 2683 ms. Trace:
I20260709 13:06:42.562172 16544 rpcz_store.cc:276] 0709 13:06:39.878521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.676606 (+798085us) service_pool.cc:224] Handling call
0709 13:06:41.454436 (+777830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.466814 (+ 12378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.561664 (+1094850us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000c0650. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:42.561784 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676873472}
I20260709 13:06:42.563539 18121 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:42.538389 18201 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.543215 18228 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.540720 17933 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.582506 17962 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.608548 17962 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:06:42.609357 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.609468 17962 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.610589 17962 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.610757 18167 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.611304 18167 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.613008 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:42.613312 16612 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:42.613664 18167 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:42.614162 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:42.614706 16612 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:42.614822 17932 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:42.615324 17932 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.556847 17957 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.616752 16536 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:42.617456 17957 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.617498 17932 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.618058 16536 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:42.618435 18155 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:06:42.597863 18212 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:42.615780 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:42.620378 18212 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.621100 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:42.597708 18064 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:06:42.622395 18212 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.623041 16614 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.624179 16614 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.624209 16615 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:42.584910 18150 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.625065 18150 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.585044 18182 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.584944 18131 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:06:42.630105 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 95476.5us
I20260709 13:06:42.556092 17802 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.536360 18222 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:06:42.630817 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.537993 18224 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.632059 18224 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.632129 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.632515 18224 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.590402 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.632990 18207 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.633610 18207 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.633656 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.634315 18207 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:42.634804 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.587976 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.635902 16543 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.636417 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:42.636538 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.635605 18207 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:42.637003 18207 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.600028 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:42.599270 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:42.606717 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.638569 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:42.639328 16613 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:42.602437 16509 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:42.606966 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.640285 16469 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:42.640317 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.607805 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.608031 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:42.646011 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:42.647101 16468 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:42.648332 16616 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:42.628695 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.556828 18230 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:42.637099 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.607481 16464 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.642114 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:42.642612 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:42.601846 18201 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.653342 16613 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:42.661082 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:42.661629 18205 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:42.662343 18205 consensus_queue.cc:1243] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:42.662626 16463 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:42.663822 16463 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.665014 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.666209 18227 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.666491 17962 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.667048 17962 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.630055 17935 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.655102 17938 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:42.670732 17938 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.671051 17938 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:42.661099 18210 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:42.673481 18230 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:42.647575 18131 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.678138 16543 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:42.681216 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:42.604701 18228 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.630384 18182 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:42.685642 16469 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:42.652482 18222 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.655882 17841 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.687863 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.682132 18183 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.703081 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:42.630575 17933 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.637812 18207 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.704829 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.695734 18138 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.705489 18059 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:42.705542 18064 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.676379 17932 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:06:42.710163 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.708997 18121 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:42.699980 17841 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.714614 18064 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:42.721271 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.737588 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:42.724119 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.704615 18222 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.707713 18210 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.731227 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.699549 18227 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:06:42.710310 17962 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:42.708081 18183 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.718276 18196 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:42.736176 16466 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:42.741030 18158 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.736713 17841 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.740506 18064 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.716789 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.736049 17935 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.735476 18207 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:42.734549 18214 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:06:42.748580 18126 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:42.763952 16611 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:42.766531 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:42.784515 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:42.774181 18067 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.776975 17933 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:42.781623 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 155) took 1943 ms. Trace:
I20260709 13:06:42.783061 16543 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:42.786475 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:42.822852 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:42.788200 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.831511 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.832253 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.819523 18067 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:42.753875 18158 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.868544 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:42.870599 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:42.863915 16461 rpcz_store.cc:276] 0709 13:06:40.838662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.273337 (+434675us) service_pool.cc:224] Handling call
0709 13:06:41.350334 (+ 76997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.557529 (+1207195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.781316 (+223787us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540030b1d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:42.781548 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742221184}
I20260709 13:06:42.790246 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:42.875032 16536 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:42.881595 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:42.882431 16537 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.782366 17962 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:06:42.885656 18167 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:42.886364 18167 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.897622 18148 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:42.898216 18148 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:42.898648 18148 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:42.909127 16365 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 276) took 7618 ms. Trace:
I20260709 13:06:42.796273 18242 ts_tablet_manager.cc:933] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:42.921017 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50498.8us
I20260709 13:06:42.922341 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:42.911471 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:42.829584 18059 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.930492 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:42.933516 16464 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:42.863660 18213 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:42.863513 18214 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:42.862869 18215 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:42.923139 18181 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:42.932802 18074 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:42.791008 18126 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.969764 18202 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.970395 16536 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:42.936111 18211 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.938658 17745 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:42.924856 18190 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:42.943218 18059 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:42.994957 18216 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:42.995457 18201 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.994102 17841 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.993502 18068 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:42.960424 18074 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:42.993297 18237 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:43.010572 16617 raft_consensus.cc:2410] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:42.963987 17938 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.961210 18224 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:42.997648 18064 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:42.953238 18215 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.025111 18126 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.026578 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.012593 18216 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:43.008719 17745 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:42.909688 16365 rpcz_store.cc:276] 0709 13:06:35.290333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.290462 (+   129us) service_pool.cc:224] Handling call
0709 13:06:42.909040 (+7618578us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:40.329371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:40.330031 (+   660us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:40.330081 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:40.330100 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:40.330467 (+   367us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:40.330598 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:40.330628 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:40.330934 (+   306us) tablet.cc:701] Row locks acquired
0709 13:06:40.330980 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:06:40.331121 (+   141us) write_op.cc:270] Start()
0709 13:06:40.348474 (+ 17353us) write_op.cc:276] Timestamp: P: 1783602400331068 usec, L: 0
0709 13:06:40.348502 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:06:40.350078 (+  1576us) log.cc:844] Serialized 541 byte log entry
0709 13:06:41.894970 (+1544892us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:42.218063 (+323093us) op_driver.cc:464] REPLICATION: finished
0709 13:06:42.513137 (+295074us) write_op.cc:301] APPLY: starting
0709 13:06:42.513217 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:42.513308 (+    91us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:42.513328 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:42.513578 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:42.513736 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:42.513776 (+    40us) write_op.cc:312] APPLY: finished
0709 13:06:42.538035 (+ 24259us) log.cc:844] Serialized 23 byte log entry
0709 13:06:42.542388 (+  4353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.542477 (+    89us) write_op.cc:454] Released schema lock
0709 13:06:42.543799 (+  1322us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.573419 (+ 29620us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.573465 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":753136,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":259605,"apply.run_cpu_time_us":1965,"apply.run_wall_time_us":45109,"num_ops":1,"prepare.queue_time_us":503199,"prepare.run_cpu_time_us":21866,"prepare.run_wall_time_us":473250,"raft.queue_time_us":153197,"raft.run_cpu_time_us":63783,"raft.run_wall_time_us":251144,"replication_time_us":1853093,"spinlock_wait_cycles":41300224,"thread_start_us":835219,"threads_started":4,"wal-append.queue_time_us":481684}]]}
I20260709 13:06:43.013960 18068 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:43.020648 18074 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.029608 18190 consensus_queue.cc:1243] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:42.974004 18067 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.031946 18167 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.034154 17938 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:43.046177 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260709 13:06:43.012247 18211 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.054250 18067 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.055477 18167 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.056537 18167 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.056625 18224 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.056947 18167 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:43.057760 18167 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.058863 18167 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.054253 18059 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.061108 16537 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:43.063311 17841 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.064414 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.065143 16544 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:43.046427 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.067484 17120 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:43.068264 18216 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.048812 16536 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.069449 18131 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.070500 18131 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.071766 18131 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:43.063329 18201 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.078671 18126 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.079260 18126 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.081276 18126 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.082011 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.083608 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.083683 18148 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.084507 16466 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.059368 18215 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:43.085328 18241 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:43.075870 18152 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.075101 18068 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.087350 18158 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.109068 16464 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:43.097838 18064 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.110224 18198 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:43.110695 18198 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:43.113042 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.113399 18237 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.113929 18237 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.111609 18198 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.115253 17933 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:43.117734 17923 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.118256 17923 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:43.119560 18148 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.119375 17923 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.121565 18211 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.129134 18179 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.116385 18237 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.105036 18152 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:43.055022 18242 tablet_copy_client.cc:323] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:06:43.138957 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:43.150199 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.141785 18211 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:43.248410 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 186439us
I20260709 13:06:43.148319 18201 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.146174 18215 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:43.181653 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.242327 18059 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.231950 18040 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.092139 17745 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.248659 17923 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.251986 17126 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:43.245504 18179 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:06:43.260262 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.257272 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1301) took 1266 ms. Trace:
I20260709 13:06:43.258201 18158 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.260735 17120 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.254132 18201 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.275754 16462 rpcz_store.cc:276] 0709 13:06:41.987858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.132917 (+145059us) service_pool.cc:224] Handling call
0709 13:06:42.133263 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.495085 (+361822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.248805 (+753720us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400355cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:43.253931 (+  5126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644963584}
I20260709 13:06:43.285120 18201 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.261503 18040 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.287770 18040 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.288846 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.289772 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.270290 18224 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.290503 16541 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:43.295352 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 156523us
I20260709 13:06:43.261870 17957 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:43.301292 18152 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.314873 18152 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.255780 18059 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.274952 17121 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:43.296007 18254 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:43.257706 18215 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.297003 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:43.256668 18211 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:43.278682 17818 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.305224 18208 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.324103 16538 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.324448 16464 raft_consensus.cc:2410] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:43.324599 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.324826 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 66132.3us
W20260709 13:06:43.327052 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.321110 16536 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:43.323665 18148 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.304728 18131 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:43.329262 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.317831 18224 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.334753 18059 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.325206 18208 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:43.337729 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:43.338960 18074 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.339452 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.341182 18259 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:43.342676 18259 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.343405 18262 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.343695 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.344928 16538 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:43.343896 18261 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.345675 18198 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.347079 18218 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.347647 18218 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.348753 17993 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.349512 18218 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.331562 18151 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:43.351514 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.351702 18208 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.352233 16466 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:43.352932 18208 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.353478 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:43.354387 18218 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.354826 18218 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.355250 18218 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.357800 18211 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.358304 18211 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.358424 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.358752 18211 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.359019 16538 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:43.343626 18150 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.361253 18126 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.361490 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.361891 18126 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.364087 18126 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.364295 18224 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.365088 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.365649 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.368340 16616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605e831b8c574943b8b259e490e4d208"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:06:43.366248 16467 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:43.368948 18211 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.366111 18215 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.368959 16616 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:43.370230 16616 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.370118 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:43.370777 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.371346 17126 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:43.373404 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.374462 16617 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.324489 17818 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.376621 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:43.381727 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.377205 16467 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.377521 18138 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.377822 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:43.385815 18138 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.386253 18138 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.379096 18074 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.379863 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.297906 18179 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.380389 18216 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.372195 18254 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:06:43.384341 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.384445 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:43.378013 18224 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:43.391825 18182 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.389386 18167 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.393371 16616 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.394184 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.372589 17957 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:43.395046 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.434806 16617 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:43.435047 16616 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.398077 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.398180 17841 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.399135 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.399158 18138 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.399578 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.403555 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.403790 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.404181 18211 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:43.405162 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.405902 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.406890 18219 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.440851 17841 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.440938 18219 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.442658 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:43.443058 17841 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.443596 17841 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.444618 18212 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:43.410899 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.445190 18212 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.445561 18212 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.446857 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.447501 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:43.448351 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:43.413827 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:43.380481 18228 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:06:43.415714 18151 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:43.456369 16541 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 3. Ops: []
I20260709 13:06:43.428369 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.429133 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.431977 16619 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.430425 18224 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.433203 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.433631 18167 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.430472 18059 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:06:43.397356 18183 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.436185 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.444489 18260 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.449152 16467 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:43.463485 16538 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:43.464471 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.389503 18261 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:43.449775 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.454260 18228 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.465137 17923 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.478911 17923 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.479158 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.479442 17923 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.479804 16469 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:43.450549 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.481092 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.481742 17121 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:43.447122 16470 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:43.483081 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.483893 18067 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.484264 18040 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.457240 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.485037 16615 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:43.484813 18040 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:43.458842 16539 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:43.455677 17957 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.486340 17957 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.486711 17957 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.486858 18040 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.488178 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.390090 18148 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:43.424911 17950 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:06:43.426798 18190 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:43.445190 18094 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:06:43.480728 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.468725 17932 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.468741 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:43.469302 18211 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.494745 18261 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.495048 18211 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:43.462518 17993 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.495905 18254 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.496356 18254 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:43.496735 18254 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.484380 18067 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.469386 18205 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:43.469712 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.472275 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.462451 18151 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.473783 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.472517 17938 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:06:43.464149 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.506225 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:43.437439 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
W20260709 13:06:43.507858 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.489485 18148 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.466822 16538 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:43.498682 16469 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.496703 16542 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:43.500388 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.449469 18126 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.501482 16544 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.509836 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.511840 17818 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.512143 18151 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:43.512720 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:43.538431 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 119171us
I20260709 13:06:43.514312 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.540923 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.517014 18059 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.543713 17938 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.543992 18201 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:43.545341 18201 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:43.546185 16544 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:43.546655 18068 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.547187 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:43.548408 16467 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:43.548549 17090 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.519966 18067 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.520069 18224 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.522639 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:43.547116 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:43.554160 17125 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.523015 17127 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.523648 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.523756 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.524483 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:43.526680 18211 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.528223 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.529182 18138 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.500979 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:43.564568 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64031.2us
I20260709 13:06:43.455346 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.463263 18167 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.430477 18257 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:06:43.510061 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.534475 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.531611 17923 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.501068 17932 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:43.551788 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.561683 18215 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.555353 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:43.563727 16509 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.538707 16466 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:43.453187 18219 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.568310 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:43.571600 16469 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:43.572566 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.587087 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.590041 16467 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.595686 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.596515 16466 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.597776 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.598572 16466 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.599361 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.600324 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.600862 17119 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:43.601313 18094 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:43.602687 16466 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:43.603004 18190 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.604676 17923 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.605353 16463 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.606364 17121 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:43.606640 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.570883 18067 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.607373 18067 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.607781 18067 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.608034 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.611199 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.567369 18224 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.562939 18126 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:43.609386 18183 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.573866 18121 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.562011 18158 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:06:43.629341 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56872.3us
I20260709 13:06:43.610437 17993 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.593400 18215 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.630748 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:43.628278 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.610915 18181 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.643417 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.616060 18224 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:43.620824 18190 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:43.623597 18211 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.644074 16467 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.561518 18202 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:06:43.617429 17745 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.645875 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:43.617370 17923 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:06:43.640045 18215 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:43.662278 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.647164 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.631621 18262 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.634516 17841 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:43.616881 18198 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:43.651564 18148 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:43.658047 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:43.641073 18138 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.669430 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.675335 16616 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.647213 17818 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:43.676484 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.681833 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126587us
I20260709 13:06:43.676800 17125 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:43.650372 18224 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.644274 18181 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:43.683053 16509 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.682474 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:43.649595 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:43.639065 18218 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.687530 16617 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:43.669989 18208 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:43.644062 18040 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:43.661548 18222 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.695230 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:43.697121 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.699658 16611 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:43.671527 17841 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.702307 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.705253 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.705760 16611 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.683219 17818 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.708525 16585 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.709503 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:43.710047 18126 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.688301 18074 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:43.673520 18158 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:06:43.713685 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.715281 17993 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.718791 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 14ab75d98ba64a9caa062cd19a0594fb from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:06:43.725279 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:43.704517 18219 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.766383 16540 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.727720 16543 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.690937 18151 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:43.728282 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.730397 16615 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:43.711802 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.661373 18190 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.699613 18138 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:43.713052 18201 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:43.705224 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.707459 17841 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:43.739540 16585 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:43.689284 18198 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.752841 17802 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.690527 17957 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.779458 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.738124 17121 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:43.782265 18067 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.731570 17818 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.708541 18222 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:43.784662 18268 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:43.785980 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 129800us
I20260709 13:06:43.738127 17125 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:43.789629 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:43.684484 17932 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.725135 18202 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:43.796470 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 57431.7us
W20260709 13:06:43.808787 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.783129 18182 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.800453 17802 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.733820 18126 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.794611 17993 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:43.785108 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 14ab75d98ba64a9caa062cd19a0594fb from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-14ab75d98ba64a9caa062cd19a0594fb
I20260709 13:06:43.731419 18131 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.800069 18138 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:43.871419 16616 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.786412 18201 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:43.768180 18208 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:43.737941 18074 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:43.879340 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 72512us
I20260709 13:06:43.805711 16540 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:43.800781 17745 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:43.801982 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:43.897881 17802 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:43.898185 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.876158 18260 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.802069 18198 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.785624 18181 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.929057 17802 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.936041 17802 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:43.885044 18201 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:43.942111 16619 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:06:43.943784 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58789.8us
I20260709 13:06:43.946357 16538 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:43.937299 18269 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:06:43.945348 18210 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.953365 18210 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.955808 18210 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.956033 18258 raft_consensus.cc:3055] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:43.956457 18258 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:43.958676 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:43.958892 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:43.959883 18126 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.961407 18228 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:43.934644 18281 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.939244 18280 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.902778 18278 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:06:44.019079 18222 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:43.960664 17938 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.019778 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.019585 18210 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.022380 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.038942 16468 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:43.975083 18218 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.023370 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:44.022629 18277 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:06:43.940105 17993 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.037493 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.029639 18074 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.051254 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:44.034889 18280 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:43.967440 18254 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.054828 17125 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:44.057317 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 111070us
I20260709 13:06:44.060081 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.040112 18067 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.062420 16468 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:44.042095 18210 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.037334 18274 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:44.051873 17957 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.068077 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.059257 17993 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:44.063486 18216 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.002s
I20260709 13:06:44.053480 16610 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:44.023990 18138 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.073750 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.077962 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:44.031087 18281 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.084095 16467 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.085455 17122 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:44.085929 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.069523 18190 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.070577 17938 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.089282 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:44.097086 18272 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:06:44.097285 18216 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.097416 17938 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.097821 18216 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:44.098546 17938 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.098749 18216 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.094236 18292 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.102432 18198 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.096405 18222 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.103963 18152 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.788s	user 0.003s	sys 0.008s
I20260709 13:06:44.053093 18258 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:44.096576 16537 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:44.109138 18067 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:44.116336 18067 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.118991 18067 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.090518 18228 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:06:44.113930 18275 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:06:44.114331 18254 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.114531 18210 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.121970 18210 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.122418 17993 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:44.122560 18210 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.123000 17993 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:44.121472 18261 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.626s	user 0.003s	sys 0.007s
I20260709 13:06:44.125308 18261 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:44.128721 18287 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:06:44.129994 18296 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.132326 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.133014 16616 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:44.133684 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.135622 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.136651 16618 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:44.135108 18292 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:44.137753 16619 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.137902 18292 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.138281 18292 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.139052 16613 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.108943 18282 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
W20260709 13:06:44.208010 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.131083 18222 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:44.203842 18167 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.004s
W20260709 13:06:44.219597 18212 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.000s
I20260709 13:06:44.219843 18167 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.220059 18212 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.221455 18282 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.221828 18282 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.212955 17993 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.199118 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.228758 16610 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:44.229059 18280 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.201247 18198 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.229805 18198 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.231530 18198 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.217468 18299 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.218773 17818 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.206619 18210 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.227705 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:44.236325 17123 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.240278 18299 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.242921 17118 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.243954 17123 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:44.249701 17119 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:06:44.225564 18068 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.001s
I20260709 13:06:44.226387 18167 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.232239 18292 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.260574 18261 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.257205 18254 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:44.244885 18262 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:06:44.261248 18292 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.264124 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:44.260465 18276 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:44.264279 18224 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.569s	user 0.016s	sys 0.000s
I20260709 13:06:44.213428 17841 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:44.270440 18211 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.007s
I20260709 13:06:44.269668 18262 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.273388 18276 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.267048 18254 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:44.293887 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1400) took 1005 ms. Trace:
I20260709 13:06:44.258045 18282 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.294284 16464 rpcz_store.cc:276] 0709 13:06:43.288429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.288587 (+   158us) service_pool.cc:224] Handling call
0709 13:06:44.293632 (+1005045us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400356bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.293822 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79857536}
I20260709 13:06:44.273942 18224 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.295033 16470 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:44.306025 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.306506 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.306818 16619 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:44.308168 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.308230 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.308998 16616 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:44.309093 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 222) took 1557 ms. Trace:
I20260709 13:06:44.311424 18074 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.311700 18282 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.310307 16613 rpcz_store.cc:276] 0709 13:06:42.751789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.751909 (+   120us) service_pool.cc:224] Handling call
0709 13:06:43.393817 (+641908us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:43.394052 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.139657 (+745605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.308873 (+169216us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54000d70d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:44.309040 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715179648}
I20260709 13:06:44.312080 18074 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:44.310519 18298 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:44.314801 18074 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.305785 18261 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.296909 18281 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.309316 18216 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.320992 18261 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.322938 18150 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:44.323186 18261 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.323534 18150 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:44.324404 17841 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.316890 18222 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.307698 18262 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:44.329928 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.332427 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.328817 16538 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.339413 16538 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:44.326647 18215 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:06:44.341986 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.326957 18254 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.350093 16538 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:44.352015 18152 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.351336 18040 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.339340 18212 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:44.357774 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.348491 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.353298 18040 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.352559 18152 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.353891 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.364003 18152 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.364817 18040 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.365319 16615 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.365543 18224 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.325414 18276 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.372044 18276 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.325899 18201 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:44.373565 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.346541 18215 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.368552 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.375881 17127 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:44.324712 18150 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.374938 16469 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:06:44.377308 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.370359 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.378818 18262 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.379158 18215 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.379426 18262 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.379823 18262 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.380435 18201 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.374270 16465 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.390004 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:44.392180 18150 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.395598 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.396974 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.398089 18267 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.394546 18205 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:44.400632 18182 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.401155 18182 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.401369 18205 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.404979 16465 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:44.404796 18196 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:44.405683 18210 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.406077 18210 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:44.406987 18210 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.393623 18237 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.394762 18045 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.408149 18237 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.401603 18182 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.408439 17818 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.408562 18045 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.411728 18179 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.412087 18045 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.408283 18210 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.410882 18267 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.403963 18205 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:44.416993 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.414594 18224 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:44.416749 17923 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:06:43.962330 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.423489 16368 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.426210 18224 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.427211 16465 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:44.427497 16368 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 5, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 5 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.428437 18224 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.432221 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1205) took 1028 ms. Trace:
I20260709 13:06:44.432623 16545 rpcz_store.cc:276] 0709 13:06:43.403410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.425496 (+ 22086us) service_pool.cc:224] Handling call
0709 13:06:44.432054 (+1006558us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54003e8854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.432164 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425650944}
I20260709 13:06:44.435750 16368 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.435273 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:44.438838 16368 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 3, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.441640 16368 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.443090 16368 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.444605 16368 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 3 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.423767 18267 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.448032 16368 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 3, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.453935 17935 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:44.454536 17935 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.455641 17935 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:44.456892 18307 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:06:44.459872 16434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.910s (SENT) [suppressed 22 similar messages]
I20260709 13:06:44.441461 18237 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.441807 18224 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:44.461670 18224 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.462052 18224 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.475441 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:44.478744 16368 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.480334 16368 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65), VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66), VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67), NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } } pending_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:44.483882 18260 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:44.471153 18205 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.484493 18260 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.489223 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1200) took 1087 ms. Trace:
W20260709 13:06:44.489506 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.489667 16544 rpcz_store.cc:276] 0709 13:06:43.402036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.405655 (+  3619us) service_pool.cc:224] Handling call
0709 13:06:44.489038 (+1083383us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54002909d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.489162 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144860928}
I20260709 13:06:44.491030 16542 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.492327 17124 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
W20260709 13:06:44.493896 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.502590 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.485450 18237 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.505615 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.507493 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.509260 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.509868 16613 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.511320 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.512073 16619 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:44.512882 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.513441 16619 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.491777 18262 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.514663 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.515794 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.516233 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.514231 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.517908 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.518973 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.560065 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.560397 16611 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:44.516335 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.564680 16468 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.495340 17935 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.519695 16464 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:44.562762 16615 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.504583 18205 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.506444 16462 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:44.568233 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.570501 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.571841 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1198) took 1170 ms. Trace:
I20260709 13:06:44.582139 16541 rpcz_store.cc:276] 0709 13:06:43.401440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.404238 (+  2798us) service_pool.cc:224] Handling call
0709 13:06:43.404526 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.456892 (+ 52366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.571612 (+1114720us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54002053d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:44.571783 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111896320}
I20260709 13:06:44.573560 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.576648 16613 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:44.573266 16616 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
W20260709 13:06:44.566869 18304 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:44.564143 18237 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:44.584208 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.585786 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:44.587670 17127 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.589428 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:44.591485 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.584015 17923 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:44.597160 16364 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 269) took 8591 ms. Trace:
I20260709 13:06:44.601058 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.601578 16464 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.602674 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:44.586831 18262 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.597774 16364 rpcz_store.cc:276] 0709 13:06:35.850338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.861663 (+ 11325us) service_pool.cc:224] Handling call
0709 13:06:44.437671 (+8576008us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257977,"reported_tablets":4}
I20260709 13:06:44.594084 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.590783 18150 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.604676 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:44.611343 16617 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:44.581328 18182 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.593779 18040 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:44.599815 18279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.009s	sys 0.024s
I20260709 13:06:44.602816 18216 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:44.616215 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.620155 17127 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:44.617319 16464 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:06:44.620462 18279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.014s	sys 0.024s
I20260709 13:06:44.611264 17923 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.623075 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.608580 18297 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:44.625581 16462 raft_consensus.cc:2376] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5. Re-sending same reply.
I20260709 13:06:44.627149 17121 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:44.615134 18138 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.628159 18138 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.628636 18138 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.630825 17841 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:44.631520 17841 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:44.633648 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.634905 17993 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:44.635600 17993 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:44.638877 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.621201 18216 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.641009 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.641067 18216 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.642026 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.642719 16463 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.644275 18167 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.638341 17993 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.638741 18179 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.645190 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:44.645717 18251 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.646286 18251 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:44.633422 18237 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.647090 18251 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.648082 18251 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.652336 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.650928 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:44.658533 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:44.657099 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:44.656983 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:44.662158 18094 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:44.662637 18094 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.670471 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:44.613682 18150 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.693001 18150 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.654707 18198 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.693730 18198 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.645596 18179 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.697515 17841 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.698573 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.699535 16617 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:44.649171 17923 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:44.701561 17923 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.702242 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.675652 17933 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.706101 16540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:44.706671 16540 raft_consensus.cc:606] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.706967 16540 raft_consensus.cc:614] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.710399 16468 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:44.682577 17122 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.686966 18258 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:44.591787 18074 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:44.712977 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.726097 16617 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.726584 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.727243 16538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:44.728014 16538 raft_consensus.cc:606] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:44.728407 16538 raft_consensus.cc:614] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.672540 18040 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.734932 18179 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.737669 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1453) took 1338 ms. Trace:
I20260709 13:06:44.738063 16618 rpcz_store.cc:276] 0709 13:06:43.398790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.398910 (+   120us) service_pool.cc:224] Handling call
0709 13:06:44.737470 (+1338560us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b540025c454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.737590 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611005696}
I20260709 13:06:44.715590 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.742117 16465 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:44.668572 17993 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:44.743178 17993 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:44.743615 17993 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.744166 17802 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.746312 17123 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:44.716689 18045 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.750356 18045 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.750765 18040 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:44.654884 18167 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:44.732236 18270 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.002s	user 0.001s	sys 0.003s
I20260709 13:06:44.732970 17841 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:44.717646 18299 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.760077 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:44.752526 18216 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.627075 18297 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.754480 18201 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:44.684427 18182 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.780886 18152 raft_consensus.cc:2764] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:44.773617 18040 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.787243 17993 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:44.763348 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.755604 18274 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:44.765576 16617 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:44.766285 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1315) took 1315 ms. Trace:
I20260709 13:06:44.792703 16470 rpcz_store.cc:276] 0709 13:06:43.451104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.483855 (+ 32751us) service_pool.cc:224] Handling call
0709 13:06:44.294909 (+811054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.306984 (+ 12075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.766051 (+459067us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400356bd0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.766207 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864703360}
I20260709 13:06:44.767436 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 209) took 1162 ms. Trace:
I20260709 13:06:44.776548 17802 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:44.761230 16616 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.794127 16542 rpcz_store.cc:276] 0709 13:06:43.604885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.605044 (+   159us) service_pool.cc:224] Handling call
0709 13:06:44.490858 (+885814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.497532 (+  6674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.767213 (+269681us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54002909d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:44.767368 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036494208}
I20260709 13:06:44.779618 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:44.775945 17933 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.761404 16463 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:44.760962 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.794961 17802 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.777453 18045 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:44.797904 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:44.766116 18138 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.775313 18260 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.804652 16616 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:44.806440 17802 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.778218 18224 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.795825 17935 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:44.808138 18182 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:44.812806 17993 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.808255 18267 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.814687 18216 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.815804 18040 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:44.819612 18167 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.835345 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.798379 17841 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:44.801450 18261 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:44.826735 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1209) took 1320 ms. Trace:
I20260709 13:06:44.836050 16544 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:44.840569 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.825304 17935 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:44.851631 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1202) took 1449 ms. Trace:
I20260709 13:06:44.859071 16543 rpcz_store.cc:276] 0709 13:06:43.402591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.406339 (+  3748us) service_pool.cc:224] Handling call
0709 13:06:43.406629 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.767205 (+360576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.851432 (+1084227us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400205dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:44.851579 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737988864}
I20260709 13:06:44.860422 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.801247 17933 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.845345 16539 rpcz_store.cc:276] 0709 13:06:43.506343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.507129 (+   786us) service_pool.cc:224] Handling call
0709 13:06:43.507582 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.507930 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.507954 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.518262 (+ 10308us) log.cc:844] Serialized 506 byte log entry
0709 13:06:43.574498 (+ 56236us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:43.574552 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.574642 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.731605 (+1156963us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:44.821735 (+ 90130us) raft_consensus.cc:1685] finished
0709 13:06:44.821763 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.826650 (+  4887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5338368,"thread_start_us":55844,"threads_started":1,"wal-append.queue_time_us":143399}
I20260709 13:06:44.853953 16468 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:06:44.882025 16468 pending_rounds.cc:85] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:06:44.882270 16468 pending_rounds.cc:107] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:44.882339 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:44.882542 16468 raft_consensus.cc:2889] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:44.882902 16539 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.858227 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.807184 18045 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.878882 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:44.886179 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.879768 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.881100 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:44.886854 16544 raft_consensus.cc:2368] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5.
I20260709 13:06:44.887130 16543 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:44.887897 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:44.888378 16543 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:44.889053 18260 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.892217 17127 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:44.850834 16462 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:44.895344 18289 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.895866 18289 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.897084 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.897722 16461 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:44.897930 18289 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.898415 18289 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.898808 18289 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:44.899554 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:44.900132 16465 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.830850 18182 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:44.921147 16542 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:44.943019 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:44.903622 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.942448 16545 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:44.946478 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:44.901130 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.908332 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:44.986271 16468 raft_consensus.cc:2368] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:44.971223 16614 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:44.908893 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.987511 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1562) took 1275 ms. Trace:
I20260709 13:06:44.904925 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.902428 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:44.988617 16618 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.845189 17993 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.988729 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.909310 16613 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:44.987918 16614 rpcz_store.cc:276] 0709 13:06:43.716821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.970561 (+1253740us) service_pool.cc:224] Handling call
0709 13:06:44.970872 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.987326 (+ 16454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.987468 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:44.962241 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 200333us
I20260709 13:06:44.922307 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:44.985198 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.984440 16617 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:45.000803 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:44.984225 16542 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:45.003005 17993 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.003916 17933 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.003046 18264 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.900703 18289 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.049026 16542 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:44.912539 18281 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.912312 18211 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:06:44.901542 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.003113 18212 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:44.904666 18045 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.953159 17935 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.910533 17957 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:06:44.947940 18259 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.902596 18138 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.901902 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.007373 18182 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:44.910181 18224 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.903422 18267 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:44.879325 18261 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:44.951382 18158 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:06:45.008790 18297 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:45.009711 16628 tablet_copy_source_session.cc:215] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:45.011518 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.012166 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:45.012885 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:45.013139 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.089679 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.013334 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:45.090556 17123 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:44.987942 16545 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:44.992564 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:44.991431 16614 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:45.018487 16544 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:44.986652 16615 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:45.023017 16543 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:45.030165 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.030514 16436 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.031495 18325 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:45.031989 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.078361 18259 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:45.105219 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.076822 18045 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.105935 17932 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:45.106076 18045 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.035454 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:44.903096 16537 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:45.106856 18259 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:44.908052 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.111337 16612 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.111548 16610 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:45.111938 16610 pending_rounds.cc:85] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 4
I20260709 13:06:45.112182 16610 pending_rounds.cc:107] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:45.112439 16610 raft_consensus.cc:2889] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.113601 18325 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.053110 17125 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:45.055938 16470 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:45.017077 16461 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:44.912587 18151 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.144s
I20260709 13:06:45.058630 18264 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:45.061174 16541 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:45.068539 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.043211 18260 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.085062 16464 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 2: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:45.061465 18281 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.092726 16545 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:45.099131 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.099572 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 69164.7us
I20260709 13:06:45.100435 16628 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:42898 (request call id 225) took 1382 ms. Trace:
I20260709 13:06:45.090210 17935 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.102002 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:45.103442 17118 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:45.108011 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 72643.5us
I20260709 13:06:45.114055 18325 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:45.105255 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:45.131883 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.124796 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:45.121194 16542 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:45.113803 17993 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.134276 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:45.134830 17123 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:45.135429 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:45.135569 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.104589 16465 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:45.136155 16542 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:45.133348 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.126121 16536 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:45.138587 18062 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:45.135023 18325 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.114110 18291 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:45.144728 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.149055 18201 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 13:06:45.171186 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.170495 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.128000 16628 rpcz_store.cc:276] 0709 13:06:43.718218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.718468 (+   250us) service_pool.cc:224] Handling call
0709 13:06:45.009322 (+1290854us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540025d854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375073f7 00007ffa3c49d036 00007ffa3c4a6a3e 00007ffa33d6a27b 00007ffa3c4a69ba 00007ffa3c4a1acc 00007ffa3c49cc7b 00007ffa3c4918d1 00007ffa3b5454b4 00007ffa3b545442
0709 13:06:45.100275 (+ 90953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406894336}
I20260709 13:06:45.140029 18212 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.142364 18260 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:45.187988 16618 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:45.142825 18062 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:45.139991 18264 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.150655 17993 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.145781 16466 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:45.153469 18336 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:45.159840 18281 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.157892 18291 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.190949 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:45.145498 18224 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.145366 18261 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.200945 18299 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.151700 18059 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:45.193027 18062 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:45.201471 18299 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:45.201596 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:45.186913 17818 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.168388 16612 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:45.145844 18290 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:06:45.203965 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.202437 18299 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.208519 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.211539 16538 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:45.211787 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.212529 16618 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:45.217042 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.218037 16618 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 1.
I20260709 13:06:45.214484 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:45.152005 18329 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:45.223259 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.223443 17093 leader_election.cc:400] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:45.223836 17093 leader_election.cc:403] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.225356 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.225660 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.204211 17818 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.226300 16540 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:45.206485 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.233755 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.205677 18281 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:45.226052 18179 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.238292 16540 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:45.229341 18274 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.205631 18291 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.231150 18260 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.230224 17818 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.223747 18212 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:45.241186 18274 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.255172 18212 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.257071 16538 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:45.241071 18179 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.229079 18182 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:45.239015 18045 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.261191 17933 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.256877 18260 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.270038 18094 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.272868 17119 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.273227 18325 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.261871 18261 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.262694 18274 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.276496 18242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ab75d98ba64a9caa062cd19a0594fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:45.263425 18212 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.282753 17933 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.282876 18260 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.264726 18179 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.283201 18151 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:06:45.302814 16542 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:45.291285 18261 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.304910 17933 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.306216 18261 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.315507 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.312801 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:45.316285 17118 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:45.317677 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:45.318111 18062 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.326328 18291 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.320556 18062 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.331921 17126 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:06:45.333271 17124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 406) took 2192 ms (client timeout 1910 ms). Trace:
W20260709 13:06:45.333770 17124 rpcz_store.cc:269] 0709 13:06:43.137404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.137572 (+   168us) service_pool.cc:224] Handling call
0709 13:06:43.413618 (+276046us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:45.329758 (+1916140us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54004b1754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:45.329867 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405168896}
I20260709 13:06:45.342284 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:45.444149 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.448396 16618 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.374331 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:45.343127 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.342716 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.370754 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:45.374661 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.453013 16470 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.455106 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.455837 16616 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:45.457059 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.457598 16616 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:45.461411 18264 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:45.429898 18059 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.463119 18059 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:45.463678 17957 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.465961 17957 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:45.467288 17957 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.464213 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.469411 16617 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.473068 17957 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.473969 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:45.474607 16545 raft_consensus.cc:606] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:45.474946 16545 raft_consensus.cc:614] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.474795 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:45.477723 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.481246 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.482035 16619 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.482846 16618 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:45.487011 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:45.487660 16545 raft_consensus.cc:606] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:45.488199 16545 raft_consensus.cc:614] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:45.328972 17923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.017s	sys 0.009s
I20260709 13:06:45.441856 17090 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.493978 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:45.494884 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 53119.3us
I20260709 13:06:45.495857 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:45.497892 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:45.501608 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.329752 18183 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.509709 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:45.333559 18325 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.377810 18148 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.373593 18198 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.373930 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.517022 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:45.431167 17119 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:45.373602 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.518791 18291 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.519340 16542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:45.522038 16470 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:45.525158 18210 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:45.533542 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:45.541155 16464 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.543614 17123 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:45.532723 18179 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.547257 18182 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.533844 18148 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:45.547835 18182 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:45.548367 18182 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.374392 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:45.505748 17923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.019s	sys 0.009s
I20260709 13:06:45.528507 16466 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:45.531788 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.572402 16615 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.539602 16542 raft_consensus.cc:606] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.573298 16542 raft_consensus.cc:614] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.555866 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.573961 16470 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:45.527621 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.511643 18183 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.579772 18183 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.536742 18167 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:45.580348 18167 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:45.581079 18158 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:45.581413 18167 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.527618 18351 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:45.582978 18167 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.567126 16462 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:45.576202 16541 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:06:45.578999 16617 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:45.588256 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.590055 16470 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:45.535355 16465 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.603650 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.557195 18264 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.381999 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.537381 18201 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:45.623907 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:45.624714 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.609290 16464 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:45.609920 16619 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:06:45.610134 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 57471.7us
I20260709 13:06:45.538596 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 416) took 1064 ms. Trace:
I20260709 13:06:45.611490 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:45.618160 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:45.628154 17123 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:45.548844 18148 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:45.621848 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 239953us
I20260709 13:06:45.626858 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:45.640235 16509 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.609615 18198 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.650377 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.652565 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.670380 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 331) took 2190 ms. Trace:
I20260709 13:06:45.670655 16619 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:45.655115 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:45.670810 17126 rpcz_store.cc:276] 0709 13:06:43.456296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.456448 (+   152us) service_pool.cc:224] Handling call
0709 13:06:45.329884 (+1873436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:45.332324 (+  2440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.645975 (+313651us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54004b1750. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:45.646155 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4307940608}
W20260709 13:06:45.672549 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.531143 18059 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.623008 18201 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:45.632874 17932 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.381150 17818 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.687865 17933 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.721959 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45839.4us
I20260709 13:06:45.678292 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:45.685701 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.685765 17124 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:45.742064 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63809.2us
I20260709 13:06:45.688663 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.742770 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:45.742856 16538 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:45.744331 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.745272 16538 raft_consensus.cc:2368] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:45.710511 16544 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:45.711884 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:45.685916 18323 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:45.714542 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.669592 18224 raft_consensus.cc:2764] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:45.621798 18264 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.623061 18216 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:45.719411 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.688395 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:45.759130 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:45.759320 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70988.8us
I20260709 13:06:45.760667 16582 leader_election.cc:400] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5.
I20260709 13:06:45.760977 16582 leader_election.cc:403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.762148 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.762974 16618 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
I20260709 13:06:45.721715 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.688206 18294 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:45.674739 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.707656 18262 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:45.723311 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 146172us
I20260709 13:06:45.775166 16615 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:45.710731 18148 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.623176 18325 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.687327 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:45.743040 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:45.781286 16540 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:45.747779 16539 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:45.709113 18183 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.654685 17923 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.668614 18151 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:45.718389 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.715627 17932 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:45.769321 18276 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:45.684963 18198 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.774767 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:45.803598 16542 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.757115 17841 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:45.775564 18292 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.782270 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:45.758622 17121 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:06:45.796542 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.633090 17119 rpcz_store.cc:276] 0709 13:06:44.474036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.477115 (+  3079us) service_pool.cc:224] Handling call
0709 13:06:45.201490 (+724375us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:45.538375 (+336885us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54004f1354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:45.538522 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157430400}
I20260709 13:06:45.776193 18179 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:45.773195 18158 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:45.787506 18224 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:45.757411 17933 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.776346 18262 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.814266 16540 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:45.835386 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 74843.5us
I20260709 13:06:45.861256 16540 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:45.861665 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:45.780534 18294 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:45.831548 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 73143.2us
I20260709 13:06:45.796818 17923 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:45.800487 18276 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:45.852030 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.794955 18325 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.805722 18289 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:45.758311 18201 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.862155 16540 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.898408 16540 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.827293 18224 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.858821 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:45.864543 18262 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:45.829001 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.860982 18062 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:45.871569 18276 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:45.861459 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 101432us
I20260709 13:06:45.921023 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:45.914183 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88794.2us
I20260709 13:06:45.915337 16540 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
W20260709 13:06:45.885816 18362 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:45.897022 18364 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.931145 16540 pending_rounds.cc:85] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 5
I20260709 13:06:45.931061 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:45.917946 18201 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:45.935122 18354 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:06:45.905000 18224 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.900573 18381 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5.
I20260709 13:06:45.923508 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:45.914361 18365 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:45.901046 18292 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:45.941735 16540 pending_rounds.cc:107] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:06:45.959558 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.931859 18372 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:45.931592 16462 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:45.923669 18062 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.962050 16540 raft_consensus.cc:2889] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:45.965559 18363 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:06:45.952008 18359 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:06:45.933212 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 71628.7us
I20260709 13:06:45.950310 17841 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:45.951417 18067 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.983716 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:45.983942 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:45.945449 18379 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:45.978406 18355 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:06:45.967401 16461 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:45.966259 18183 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.992183 16615 raft_consensus.cc:2410] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:45.941236 18364 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:45.971745 18198 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.004668 18364 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:45.993228 16611 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.004833 18182 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.005143 17841 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.973661 18381 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:46.007015 18182 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:45.977135 18361 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:06:45.963804 18367 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:46.007829 18367 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:45.968740 17818 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.991925 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:46.009155 17124 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.008741 18367 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.962862 18040 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:46.009999 18367 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.011382 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:45.998880 18067 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.012873 18067 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:46.013773 18212 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.003s
I20260709 13:06:46.014178 18212 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.014513 18276 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.016149 16468 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:46.016232 18212 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.016757 18040 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.017175 17127 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:46.017184 18040 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.017997 18040 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.019170 18276 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:46.019806 18260 consensus_meta.cc:287] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.000s
I20260709 13:06:46.020207 18260 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:45.992255 18370 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:46.021239 18370 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:46.020953 18379 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.021692 18370 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.023339 18379 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.980358 17935 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:46.024082 18260 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.024757 18374 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.025279 18374 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.025470 16542 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:46.026959 18242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53658 (request call id 323) took 3348 ms. Trace:
I20260709 13:06:46.027443 18374 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:45.947005 17923 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.028877 18045 raft_consensus.cc:2764] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:46.029079 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:46.029762 16462 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.027505 18242 rpcz_store.cc:276] 0709 13:06:42.683982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.688430 (+  4448us) service_pool.cc:224] Handling call
0709 13:06:42.931711 (+243281us) ts_tablet_manager.cc:934] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
0709 13:06:45.208310 (+2276599us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:45.771160 (+562850us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.778141 (+  6981us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:46.012457 (+234316us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:46.026413 (+ 13956us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.026815 (+   402us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:46.026875 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19995,"tablet-copy.queue_time_us":53499,"thread_start_us":87299,"threads_started":2}
I20260709 13:06:46.031359 18242 tablet_copy_client.cc:806] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:46.031987 18242 tablet_copy_client.cc:670] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:46.033257 18360 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 13:06:46.002281 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:46.021341 16470 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:45.971315 18264 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:45.918717 18371 consensus_queue.cc:1175] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8e851f11d27b4a83aa395e05c4be6808" responder_term: 5 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.4-4.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:45.976135 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:45.975850 17933 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:45.973579 18294 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.050727 16611 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:45.987897 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.939491 17932 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.061889 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:46.065335 16613 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.062537 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:46.066128 16615 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.009907 18062 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.067539 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:46.073110 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.073314 16611 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.074029 16616 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.075567 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.082784 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:46.085656 18384 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:46.087709 18384 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.088971 18158 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:46.090513 18158 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:46.091173 18158 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:46.093014 18382 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:46.093575 18382 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:46.094735 18382 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.096350 18382 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:46.084424 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:46.113837 16615 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:46.115525 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.040019 18369 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:45.966900 18365 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.125348 16611 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:46.128957 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.129150 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.132865 16613 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:46.124585 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:46.120838 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 188620us
W20260709 13:06:46.125379 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.098084 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.117192 18276 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.151850 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.153147 16611 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:46.127110 16465 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:06:46.156672 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:46.122084 18292 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.170794 16462 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:46.171908 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.172461 18062 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.172936 16610 pending_rounds.cc:85] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 1
I20260709 13:06:46.173357 16610 pending_rounds.cc:107] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:46.173681 16610 raft_consensus.cc:2889] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.129611 18259 raft_consensus.cc:2764] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:06:46.126281 18364 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.127537 18286 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.183730 16433 leader_election.cc:400] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:46.184237 16433 leader_election.cc:403] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.177695 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.178169 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:46.092366 18158 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.153287 18325 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.153635 18205 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.172976 18062 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:46.201030 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:46.165653 16465 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:46.202142 18273 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:46.275641 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 74728.6us
I20260709 13:06:46.202860 18365 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:46.208109 17818 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.209594 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.215296 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.257406 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.299645 16538 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.180214 18369 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:46.264205 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 80642.2us
I20260709 13:06:46.265596 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.179252 17841 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.196913 18264 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:46.277199 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:46.329880 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52744.9us
I20260709 13:06:46.273211 18259 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.286545 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.335925 16615 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:46.286958 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.336760 16616 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:06:46.287698 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 102847us
I20260709 13:06:46.288954 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.199105 18384 raft_consensus.cc:2764] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:46.297617 16544 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.301487 16540 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:46.314476 17818 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.315894 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.256856 18074 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.319392 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:46.319415 16543 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:46.278667 18371 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:46.291787 18383 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.331120 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.284965 16613 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.332685 16538 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:46.196877 18040 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.180646 18292 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.318506 18273 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:46.366870 18040 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.366578 18273 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.292471 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.368872 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:46.369129 16462 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.369590 17120 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:46.320119 18167 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.003s
I20260709 13:06:46.329880 16466 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:06:46.380537 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.279771 18286 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:46.217833 18364 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.361084 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:46.399549 17124 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.361533 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.343506 18219 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.320284 18369 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:46.353345 16545 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:06:46.409300 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47878.7us
I20260709 13:06:46.350966 18264 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:46.424211 17124 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:46.420102 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.426679 18224 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.428743 18224 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.420846 16461 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:46.429194 18397 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:46.429513 18356 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.656s	user 0.002s	sys 0.000s
I20260709 13:06:46.430559 16461 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:46.420264 18242 tablet_copy_client.cc:538] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:46.417049 18383 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.433184 16536 raft_consensus.cc:2368] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:46.436539 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:46.440080 17124 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.389880 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.344206 17841 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.378964 18045 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:46.432703 17120 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:46.458395 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:46.421097 18369 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.460604 17123 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:06:46.451116 18274 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.146s	user 0.011s	sys 0.003s
I20260709 13:06:46.471932 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.433284 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 354) took 1124 ms. Trace:
W20260709 13:06:46.456882 18262 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.003s
I20260709 13:06:46.480350 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.434968 18383 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.379490 18179 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:06:46.478546 17124 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.415743 18279 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:06:46.481531 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:46.487775 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.488515 17933 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.488924 17933 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.399277 18259 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:46.488909 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.489996 18390 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:46.489899 18375 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:46.490629 18386 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.489923 18385 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:06:46.491153 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:46.470009 18216 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.475340 18148 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.481299 18219 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:46.489483 17933 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.458273 18299 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:46.499423 16615 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:46.500716 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:46.484397 18045 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.498955 18040 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:46.530313 18379 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.534680 18379 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:46.537238 18391 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:06:46.537410 18379 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.501551 18216 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.539798 18216 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:46.541947 18368 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:06:46.541841 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.542764 16465 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:46.542995 18224 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.543581 18219 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.445013 18062 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.543701 18224 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.544690 18219 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.546316 18224 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.480098 17122 rpcz_store.cc:276] 0709 13:06:45.309296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.314105 (+  4809us) service_pool.cc:224] Handling call
0709 13:06:45.321433 (+  7328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:45.321900 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.321938 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:45.322613 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 13:06:45.610882 (+288269us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:45.616665 (+  5783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.632148 (+ 15483us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.428868 (+796720us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:46.432902 (+  4034us) raft_consensus.cc:1685] finished
0709 13:06:46.432939 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.433204 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2212,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":252,"spinlock_wait_cycles":30326016,"thread_start_us":255001,"threads_started":1,"wal-append.queue_time_us":365131}
I20260709 13:06:46.492743 18383 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.550745 18383 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.552923 18259 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:46.554335 17841 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.555219 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:46.555652 18370 consensus_meta.cc:287] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.004s
I20260709 13:06:46.556069 18370 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.556252 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.556391 17841 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.557050 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.557004 17841 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:46.559207 17841 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.559548 16466 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260709 13:06:46.563136 17957 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.089s	user 0.010s	sys 0.002s
I20260709 13:06:46.565266 18264 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.567975 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.573618 18364 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.568575 16536 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
I20260709 13:06:46.574595 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.575356 16613 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:46.575353 16538 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:46.576278 18370 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.577334 17818 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.492390 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:46.578421 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 259094us
I20260709 13:06:46.584787 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:46.585049 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:46.585783 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 85173.4us
I20260709 13:06:46.481492 18274 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.607457 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.608084 16538 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.608896 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.609298 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.610066 16543 raft_consensus.cc:2410] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:46.589767 16509 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:46.594300 18242 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:06:46.485663 18262 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.602412 18388 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.602600 17121 raft_consensus.cc:2368] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
W20260709 13:06:46.579959 18367 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.002s
I20260709 13:06:46.630676 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.543486 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1655) took 1297 ms. Trace:
I20260709 13:06:46.637135 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.494525 18390 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.639089 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.639286 16618 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.580492 18389 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:46.629348 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.628989 16538 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:46.643568 16467 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:46.643792 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.530797 18148 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.631827 18383 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:46.602686 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:46.647202 16617 raft_consensus.cc:2368] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:46.633658 18386 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:46.646415 18378 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.615664 17841 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:46.646637 18390 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:46.629998 18279 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.632382 17923 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.684068 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:46.634121 18379 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:46.661612 16543 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:46.631311 18385 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.639182 18040 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:46.649107 18377 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:06:46.662565 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.649046 18389 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:46.639555 18045 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:06:46.616854 18299 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.704231 16616 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:46.662155 17818 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.701000 18179 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.702209 18383 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.728022 16469 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:46.741798 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1448) took 1064 ms. Trace:
I20260709 13:06:46.646935 18388 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.742317 16469 rpcz_store.cc:276] 0709 13:06:45.677110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.677283 (+   173us) service_pool.cc:224] Handling call
0709 13:06:46.683902 (+1006619us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:46.741721 (+ 57819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16824192}
I20260709 13:06:46.760069 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.760344 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:46.760878 16469 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:46.678402 18378 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.500721 18286 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.739547 18062 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.762214 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.705653 18379 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.704821 18040 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.720896 18370 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:46.729408 16612 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:46.769189 16469 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 2: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:46.761237 18219 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:46.738699 16610 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:46.743340 18383 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.702414 17923 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.781116 18386 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.742128 17933 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.786228 16540 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:46.740476 18224 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:46.758342 17841 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.786947 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:46.796126 16469 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.774832 18062 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.800212 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:46.801093 16466 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.802726 16469 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.803622 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.804224 16469 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:46.742552 17818 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.805001 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.806380 17818 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.806327 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:46.811715 18205 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:46.788332 18219 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:46.812465 18205 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.813227 18219 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.816529 18205 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.817601 16466 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:46.820576 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:46.821401 17122 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:46.825562 16465 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:46.828950 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.829764 16543 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:46.830813 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.831456 16543 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:46.835408 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.710325 18279 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:46.781189 18408 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:46.845963 18279 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.857470 18045 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:46.858142 18045 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.860352 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.861726 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.862891 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.863797 17935 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.864120 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.864388 17935 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.866863 17935 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:46.867698 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:46.868345 16616 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:46.871140 16617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1488) took 1150 ms (client timeout 1520 ms). Trace:
W20260709 13:06:46.871714 16617 rpcz_store.cc:269] 0709 13:06:45.721224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.721481 (+   257us) service_pool.cc:224] Handling call
0709 13:06:46.870854 (+1149373us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540001f9d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:46.871056 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030811520}
W20260709 13:06:46.878072 18403 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.412s	user 0.002s	sys 0.000s
I20260709 13:06:46.882246 18059 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.888109 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 358) took 1105 ms. Trace:
I20260709 13:06:46.893827 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:46.895167 16545 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:46.832399 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.760352 18179 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.800576 18062 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.888708 17126 rpcz_store.cc:276] 0709 13:06:45.782366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.782488 (+   122us) service_pool.cc:224] Handling call
0709 13:06:45.782821 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.783153 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:45.794132 (+ 10979us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.369138 (+575006us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b1800339e80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:46.853812 (+484674us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b1800339e80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a
0709 13:06:46.854118 (+   306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.854676 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.854855 (+   179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.854900 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.854980 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.887782 (+ 32802us) raft_consensus.cc:1685] finished
0709 13:06:46.887813 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.888019 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29777,"prepare.queue_time_us":10825,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":28951,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":13716,"spinlock_wait_cycles":91553792,"thread_start_us":38405,"threads_started":1,"wal-append.queue_time_us":206662}
I20260709 13:06:46.933014 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1366) took 1061 ms. Trace:
I20260709 13:06:46.788568 18386 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:46.939862 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 47027.8us
I20260709 13:06:46.942422 18386 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.779798 18370 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.904007 18382 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.946019 18418 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:46.946630 18382 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:46.903592 18367 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.014267 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.931958 18325 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.785681 18389 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.946799 18418 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:47.071209 18411 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:06:47.074335 18388 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.074079 17841 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.940160 16461 rpcz_store.cc:276] 0709 13:06:45.870090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.432182 (+562092us) service_pool.cc:224] Handling call
0709 13:06:46.432484 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.469740 (+ 37256us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:46.474790 (+  5050us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.494396 (+ 19606us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.703848 (+209452us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:46.728735 (+ 24887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.739369 (+ 10634us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.903200 (+163831us) raft_consensus.cc:1685] finished
0709 13:06:46.903230 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.931042 (+ 27812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30945,"raft.queue_time_us":25198,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9748,"thread_start_us":152872,"threads_started":1,"wal-append.queue_time_us":267277}
I20260709 13:06:47.080430 18325 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.998917 18367 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.005565 18260 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.952426 18379 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.002909 18267 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.003621 18274 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.007048 18040 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:46.994333 17957 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.087744 18289 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.106065 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:46.636493 16537 rpcz_store.cc:276] 0709 13:06:45.245803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.440926 (+195123us) service_pool.cc:224] Handling call
0709 13:06:45.517706 (+ 76780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.609842 (+ 92136us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:45.675120 (+ 65278us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.070575 (+395455us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.075116 (+  4541us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.075253 (+   137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.075285 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.075358 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.543290 (+467932us) raft_consensus.cc:1685] finished
0709 13:06:46.543315 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.543433 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72104,"prepare.queue_time_us":24880,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":10052,"raft.queue_time_us":159191,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":10822,"thread_start_us":322291,"threads_started":2,"wal-append.queue_time_us":622522}
W20260709 13:06:47.107677 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 147399us
I20260709 13:06:47.110368 17126 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:47.114185 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:47.100418 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1646) took 1914 ms. Trace:
I20260709 13:06:47.005352 18148 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:47.139421 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.105469 18378 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.130787 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:47.142191 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.122488 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:47.126788 16543 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:47.145990 16539 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.135181 16541 rpcz_store.cc:276] 0709 13:06:45.186431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.187373 (+   942us) service_pool.cc:224] Handling call
0709 13:06:45.195280 (+  7907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.585078 (+389798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.031086 (+1446008us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54003e9754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.100323 (+ 69237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875452800}
W20260709 13:06:47.151706 18410 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:06:47.155403 18383 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.157401 18367 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.163082 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:47.167999 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:47.125727 18299 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.118077 18264 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:47.171247 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:47.172696 18421 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:47.173086 18418 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.120529 18388 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:06:47.130458 18289 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:47.176950 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:47.126766 18267 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.121191 18260 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.158298 18259 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:47.172995 18369 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.001s
W20260709 13:06:47.180848 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.157958 16461 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:47.181794 18222 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:47.133291 17957 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.176064 18281 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.147383 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:47.174333 18407 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:47.161537 18424 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.256608 18222 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.182665 18382 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:47.260449 16468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1429) took 1920 ms (client timeout 1618 ms). Trace:
W20260709 13:06:47.383860 16468 rpcz_store.cc:269] 0709 13:06:45.340392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.340532 (+   140us) service_pool.cc:224] Handling call
0709 13:06:47.260213 (+1919681us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002a8ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.260375 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293726464}
I20260709 13:06:47.185281 18259 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.258795 17933 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.174607 18386 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:06:47.396857 16615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.105s	sys 0.201s
W20260709 13:06:47.397399 16615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.105s	sys 0.201s
I20260709 13:06:47.268039 18281 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.399158 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 290569us
I20260709 13:06:47.221714 18369 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.382238 18222 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.402173 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.378367 18424 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.392606 18259 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.391458 18289 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.428706 17957 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.428965 18289 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.430696 18267 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.406437 18424 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.431339 18267 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.440068 18260 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.441053 18325 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.432075 18267 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.443524 18267 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.404560 18389 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.446086 18389 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.452556 18389 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.450064 18259 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.402331 18281 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.459228 18259 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.469041 16611 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:47.497447 18357 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.783s	user 0.002s	sys 0.003s
I20260709 13:06:47.501181 18281 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:47.489707 16466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.143s	sys 0.285s
W20260709 13:06:47.502607 16466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.144s	sys 0.285s
I20260709 13:06:47.505539 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:47.506449 17124 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:06:47.507771 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 372794us
I20260709 13:06:47.508675 16582 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:47.513932 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:47.512486 18325 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:47.521040 17933 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.521386 18259 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:47.555925 16469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.073s	sys 0.151s
I20260709 13:06:47.531334 18264 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:47.544013 17933 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.557576 16469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.073s	sys 0.151s
I20260709 13:06:47.550534 18259 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.543044 18325 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.560056 17933 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.560679 18259 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.563591 18375 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:47.572216 18386 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:47.585526 18426 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:06:47.582888 18375 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:47.587445 18369 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.602134 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:47.594394 18386 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:47.611690 18390 consensus_meta.cc:287] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.915s	user 0.010s	sys 0.003s
I20260709 13:06:47.604218 18389 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:06:47.623536 18389 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.616098 18281 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.626718 18390 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.632552 18386 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:47.633579 18428 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:47.648176 18390 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.638177 18325 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.638746 18424 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.618181 18375 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.649456 18375 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.650405 18424 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.680883 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1374) took 1098 ms. Trace:
I20260709 13:06:47.681789 16538 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:47.681408 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1235) took 1415 ms. Trace:
I20260709 13:06:47.682328 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1485) took 2060 ms. Trace:
I20260709 13:06:47.683681 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1678) took 1033 ms. Trace:
I20260709 13:06:47.682974 16614 rpcz_store.cc:276] 0709 13:06:45.621251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.621385 (+   134us) service_pool.cc:224] Handling call
0709 13:06:45.621683 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.622013 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.622050 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.622501 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.508100 (+1885599us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18001e1c60. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:06:47.613315 (+105215us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.613358 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.613538 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.681425 (+ 67887us) raft_consensus.cc:1685] finished
0709 13:06:47.681491 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.682000 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13105,"raft.queue_time_us":1306,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8940,"spinlock_wait_cycles":2957056,"thread_start_us":104991,"threads_started":1,"wal-append.queue_time_us":1994061}
I20260709 13:06:47.682893 16542 rpcz_store.cc:276] 0709 13:06:46.265700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.276786 (+ 11086us) service_pool.cc:224] Handling call
0709 13:06:46.277113 (+   327us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:46.485820 (+208707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.485861 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:46.838273 (+352412us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:06:46.838996 (+   723us) log.cc:844] Serialized 52 byte log entry
0709 13:06:47.145095 (+306099us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:47.561167 (+416072us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.562191 (+  1024us) log.cc:844] Serialized 14 byte log entry
0709 13:06:47.567240 (+  5049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.615211 (+ 47971us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54003e8d54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.615273 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.615322 (+    49us) raft_consensus.cc:1685] finished
0709 13:06:47.615339 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.681017 (+ 65678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4674,"prepare.queue_time_us":523984,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":2889,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":17192,"spinlock_wait_cycles":482013824,"thread_start_us":695874,"threads_started":2,"wal-append.queue_time_us":545923}
I20260709 13:06:47.684463 16539 rpcz_store.cc:276] 0709 13:06:46.650500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.146684 (+496184us) service_pool.cc:224] Handling call
0709 13:06:47.146929 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.166763 (+ 19834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:47.166791 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.167229 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.588746 (+421517us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.588823 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.588923 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.683182 (+ 94259us) raft_consensus.cc:1685] finished
0709 13:06:47.683223 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.683500 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19444,"raft.queue_time_us":23838,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5424,"thread_start_us":209332,"threads_started":1,"wal-append.queue_time_us":380907}
I20260709 13:06:47.682082 16466 rpcz_store.cc:276] 0709 13:06:46.581803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.825742 (+243939us) service_pool.cc:224] Handling call
0709 13:06:46.826141 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.827127 (+   986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.827177 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.827874 (+   697us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.503160 (+675286us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.503221 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.503329 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.679956 (+176627us) raft_consensus.cc:1685] finished
0709 13:06:47.680032 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.680491 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":430,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":674842,"threads_started":1,"wal-append.queue_time_us":769013}
I20260709 13:06:47.692575 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:47.683557 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 252) took 1038 ms. Trace:
I20260709 13:06:47.694201 16615 rpcz_store.cc:276] 0709 13:06:46.645002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.652937 (+  7935us) service_pool.cc:224] Handling call
0709 13:06:46.653370 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.653804 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.653844 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.654374 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.397949 (+743575us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:47.398009 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.398115 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.682992 (+284877us) raft_consensus.cc:1685] finished
0709 13:06:47.683033 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.683344 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14571,"thread_start_us":743235,"threads_started":1,"wal-append.queue_time_us":900312}
I20260709 13:06:47.698186 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:47.699342 17126 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.700510 18205 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.701706 18205 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:46.683009 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:47.704239 18179 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.705896 18205 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.644122 18259 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:47.637094 18222 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.710297 18259 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.684388 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1452) took 1648 ms. Trace:
I20260709 13:06:47.715876 16469 rpcz_store.cc:276] 0709 13:06:46.035780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.809822 (+774042us) service_pool.cc:224] Handling call
0709 13:06:46.810643 (+   821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.811824 (+  1181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.811876 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.812552 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.568281 (+755729us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:47.568329 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.568400 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.683915 (+115515us) raft_consensus.cc:1685] finished
0709 13:06:47.683948 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.684215 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":200,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":170,"thread_start_us":746871,"threads_started":1,"wal-append.queue_time_us":799431}
I20260709 13:06:47.729387 18222 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.737244 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1672) took 1128 ms. Trace:
I20260709 13:06:47.741155 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1669) took 1133 ms. Trace:
I20260709 13:06:47.741582 16544 rpcz_store.cc:276] 0709 13:06:46.607943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.608645 (+   702us) service_pool.cc:224] Handling call
0709 13:06:47.740686 (+1132041us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400001754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.740984 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295261568}
I20260709 13:06:47.737823 16538 rpcz_store.cc:276] 0709 13:06:46.608722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.643526 (+ 34804us) service_pool.cc:224] Handling call
0709 13:06:47.736936 (+1093410us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002503d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.737137 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382987136}
W20260709 13:06:47.744830 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1418) took 3408 ms (client timeout 3294 ms). Trace:
W20260709 13:06:47.745450 16467 rpcz_store.cc:269] 0709 13:06:44.335927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.336701 (+   774us) service_pool.cc:224] Handling call
0709 13:06:44.740664 (+403963us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:45.315374 (+574710us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8e9c 00007ffa343d8a5b 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:47.744346 (+2428972us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003af054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.744564 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104409088}
W20260709 13:06:47.747639 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1444) took 2126 ms (client timeout 1624 ms). Trace:
W20260709 13:06:47.748178 16470 rpcz_store.cc:269] 0709 13:06:45.620696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.620919 (+   223us) service_pool.cc:224] Handling call
0709 13:06:47.747147 (+2126228us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.747453 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911034112}
W20260709 13:06:47.748890 18059 consensus_meta.cc:287] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.011s
I20260709 13:06:47.749799 16463 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:06:47.751729 16463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1367) took 1815 ms (client timeout 1597 ms). Trace:
W20260709 13:06:47.752192 16463 rpcz_store.cc:269] 0709 13:06:45.936425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.975862 (+ 39437us) service_pool.cc:224] Handling call
0709 13:06:47.751435 (+1775573us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400264154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.751633 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3871773568}
I20260709 13:06:47.753698 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 356) took 2372 ms. Trace:
I20260709 13:06:47.754084 17127 rpcz_store.cc:276] 0709 13:06:45.381579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.580857 (+199278us) service_pool.cc:224] Handling call
0709 13:06:45.581120 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.017586 (+436466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.753182 (+1735596us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54004d0b54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.753508 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002431744}
I20260709 13:06:47.744801 16541 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:47.744721 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 250) took 1303 ms. Trace:
I20260709 13:06:47.762624 16613 rpcz_store.cc:276] 0709 13:06:46.441413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.441539 (+   126us) service_pool.cc:224] Handling call
0709 13:06:46.441815 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.575873 (+134058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.744084 (+1168211us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540025d354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.744463 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306729728}
I20260709 13:06:47.767098 18045 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.778456 18262 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:47.782133 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.782823 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.783115 16536 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:47.783968 18292 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.784541 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.786140 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.787743 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.787943 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.786149 18390 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:47.788892 16545 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:47.789513 18390 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.792302 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.793241 16544 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.793769 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:47.788825 16537 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:47.794226 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:47.795215 18390 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.809163 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.810088 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.814599 16542 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:47.816066 18074 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.817989 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1598) took 1628 ms. Trace:
I20260709 13:06:47.818531 16611 rpcz_store.cc:276] 0709 13:06:46.189792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.190075 (+   283us) service_pool.cc:224] Handling call
0709 13:06:46.191237 (+  1162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.469660 (+1278423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.817471 (+347811us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002481d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.817798 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937912576}
I20260709 13:06:47.816588 18074 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.821718 18074 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.824499 16539 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:47.823556 16611 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:47.834604 17923 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.832314 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.837206 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.838217 17126 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:47.841607 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.842813 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.845516 16539 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:47.841629 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:47.846532 16545 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.846745 17923 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:47.846930 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.847333 17923 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:47.852981 16544 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:06:47.854264 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.852911 16615 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:47.859910 18182 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.860975 18182 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.862365 18222 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.863131 18222 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.864225 18182 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:47.870308 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 267976us
I20260709 13:06:47.871534 17090 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:47.872602 18182 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:47.867609 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1445) took 2235 ms. Trace:
I20260709 13:06:47.873883 18182 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:47.873914 16464 rpcz_store.cc:276] 0709 13:06:45.631691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.637343 (+  5652us) service_pool.cc:224] Handling call
0709 13:06:45.637658 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.424654 (+786996us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:46.449703 (+ 25049us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.784912 (+335209us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b18002b8640. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:06:46.848089 (+ 63177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.849435 (+  1346us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:46.850620 (+  1185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.791225 (+940605us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b18002b8640. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:47.867105 (+ 75880us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400357fd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.867191 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.867387 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13299,"prepare.queue_time_us":29787,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":18469,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":8979,"spinlock_wait_cycles":1819726336,"thread_start_us":57948,"threads_started":1,"wal-append.queue_time_us":622181}
I20260709 13:06:47.877597 18222 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.878861 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.879869 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.881182 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:47.882360 16537 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:47.885885 18182 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.888037 17127 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:47.872916 17923 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.888634 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:47.889977 16539 raft_consensus.cc:2376] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4. Re-sending same reply.
I20260709 13:06:47.853796 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:47.840133 17933 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.892228 18045 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:47.895586 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1670) took 1287 ms. Trace:
I20260709 13:06:47.896063 16540 rpcz_store.cc:276] 0709 13:06:46.608205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.610609 (+  2404us) service_pool.cc:224] Handling call
0709 13:06:47.895134 (+1284525us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540031ae54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:47.895396 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330872576}
I20260709 13:06:47.898414 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:47.915782 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:47.896662 18210 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.921443 18210 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.924242 18210 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:47.940028 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 87479.1us
I20260709 13:06:47.946118 16542 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:47.947894 17126 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:47.952152 18260 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.952661 17090 leader_election.cc:400] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:47.953086 17090 leader_election.cc:403] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.953032 18260 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.954325 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:47.955926 16434 leader_election.cc:400] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:47.956506 18281 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.957310 18281 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.958534 18222 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.958590 18365 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:47.959529 18365 raft_consensus.cc:2764] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:47.959967 18371 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.960938 18059 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:47.960683 18371 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:47.961764 18059 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.963047 18375 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:47.963485 18375 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.964118 18059 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.964432 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:47.965025 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:47.965798 16464 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:47.966462 18260 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.967367 18260 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.967887 18260 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.968005 16545 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:47.968288 18260 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.959450 18222 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.956305 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:47.956317 16434 leader_election.cc:403] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.969758 16544 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:47.963397 18371 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:47.964169 18375 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:47.976644 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 434) took 2090 ms. Trace:
I20260709 13:06:47.959540 18281 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:47.979544 18292 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:47.980350 18205 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.977164 17119 rpcz_store.cc:276] 0709 13:06:45.885525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.897663 (+ 12138us) service_pool.cc:224] Handling call
0709 13:06:45.935600 (+ 37937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.005707 (+ 70107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.005741 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.006203 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.136486 (+130283us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:46.139776 (+  3290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.971941 (+1832165us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:47.972028 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.972115 (+    87us) raft_consensus.cc:1685] finished
0709 13:06:47.972126 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.975799 (+  3673us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1890,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":154363776,"thread_start_us":112735,"threads_started":1,"wal-append.queue_time_us":273196,"wal-append.run_cpu_time_us":2358,"wal-append.run_wall_time_us":1242163}
I20260709 13:06:47.987475 18441 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:47.988921 18441 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:47.989831 18441 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.994071 18179 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:47.994616 18179 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:47.995033 18291 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.995752 18179 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:47.980901 18205 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.002171 18205 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.008061 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.008387 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.011086 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.011341 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.011821 16615 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.008116 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.013918 16619 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.015956 16611 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:48.002298 18289 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:48.013968 18407 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.017398 18407 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:47.980391 18292 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:48.019744 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.020221 18292 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.020536 17933 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.020869 18432 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:06:48.021855 18259 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.022257 18259 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.022297 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:48.023226 17119 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.023414 18259 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.025779 18407 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.027819 18242 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:06:48.028926 18242 tablet_bootstrap.cc:492] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:06:48.029390 18179 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.029868 18242 ts_tablet_manager.cc:1403] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 1.436s	user 0.030s	sys 0.027s
I20260709 13:06:48.032370 18289 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.033219 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.033010 18289 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.033416 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.034000 16461 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.035355 18289 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.036180 18259 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.036108 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.037489 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.047178 16470 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.047386 18222 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:48.048938 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 93526.4us
W20260709 13:06:48.054783 18445 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 13:06:48.056035 16464 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:48.059754 16619 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:48.063474 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.064316 16470 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:48.064921 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.066740 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:48.067627 18291 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.067907 16470 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:48.068176 18291 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.068792 18291 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.069909 16540 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.070336 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:48.070926 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.071830 16539 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:48.073030 18407 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.073297 18432 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.073954 18432 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.074455 16582 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.074796 18148 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.075423 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:48.039932 18374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.736s	user 0.000s	sys 0.027s
I20260709 13:06:48.073877 16436 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.085973 18262 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:48.081923 18374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.879s	user 0.000s	sys 0.028s
I20260709 13:06:48.058409 18441 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.093925 17127 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.030717 18212 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.100931 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.105839 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.111917 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.117479 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.117489 16536 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:48.117605 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 43850.8us
I20260709 13:06:48.115352 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:48.086964 18205 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.119869 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.099804 18407 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.112838 18441 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.127099 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.130182 18383 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.130885 18148 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.133961 17933 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.131829 18291 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:48.140280 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59332.4us
W20260709 13:06:48.149497 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 74196.5us
I20260709 13:06:48.154520 17121 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.155104 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.154551 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1362) took 2323 ms. Trace:
I20260709 13:06:48.155869 16462 rpcz_store.cc:276] 0709 13:06:45.792127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.372037 (+579910us) service_pool.cc:224] Handling call
0709 13:06:46.372326 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:46.426679 (+ 54353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.426727 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:46.426792 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:46.426839 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.086681 (+1659842us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54001081d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:48.086803 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.115079 (+ 28276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113154816}
I20260709 13:06:48.138242 18212 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.160583 18212 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:48.162427 18446 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:06:48.164364 18450 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:06:48.161855 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.162111 18205 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.122534 18074 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.160871 17933 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.169627 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.177809 16542 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:48.142133 18375 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.186583 18074 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.187408 18212 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.189607 18289 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.190398 18289 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.191457 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.191944 17122 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.192523 18289 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.192829 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.193380 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.194362 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.194983 17123 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:48.195962 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.196856 16539 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:48.195943 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.198217 18390 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:48.198920 18390 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.200700 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.201170 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.180855 18374 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.202199 16436 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.202621 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.204003 16470 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:48.204107 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.204942 18370 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.205411 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.205888 18212 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.206398 18292 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.206606 18212 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:48.206877 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.207540 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:48.199497 18452 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:06:48.208390 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.214211 16469 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.209208 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:48.209563 18451 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 13:06:48.210382 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.202929 18289 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:48.211292 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.213054 17933 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.149154 18441 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.203393 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.202210 16461 raft_consensus.cc:2410] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:48.217247 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.171715 18259 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.168922 18432 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.220206 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.194134 17122 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:48.227998 18212 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.230377 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.231351 16462 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.231288 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.231592 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.202204 18374 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.233155 18374 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.234257 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.235603 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:48.236439 16511 connection.cc:256] RPC call timeout handler was delayed by -1.4345680410000341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:06:48.233042 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.238771 16467 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.242439 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:48.245035 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 53668.4us
I20260709 13:06:48.250696 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.252867 16468 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.246320 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.253971 16464 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 1.
W20260709 13:06:48.254596 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47207.9us
I20260709 13:06:48.255533 16544 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:48.255843 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.259706 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1683) took 1117 ms. Trace:
I20260709 13:06:48.260236 16541 rpcz_store.cc:276] 0709 13:06:47.142530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.150096 (+  7566us) service_pool.cc:224] Handling call
0709 13:06:47.744031 (+593935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.762106 (+ 18075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.259443 (+497337us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54002503d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:48.259620 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1352446336}
I20260709 13:06:48.261703 18459 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.262351 18459 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.262679 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:48.262907 18369 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.263278 16539 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.263614 18369 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.264937 18370 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.265781 18370 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.268014 18370 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.268352 18375 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.265198 18458 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:48.261696 18148 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.269454 18260 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.269656 18458 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.271770 18260 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.272293 18458 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.272532 16463 raft_consensus.cc:2368] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6.
I20260709 13:06:48.268540 18370 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:48.273634 17119 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:48.264712 18459 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.279119 16469 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:48.282337 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.238194 18182 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.277683 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:48.283465 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.274755 18370 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.226330 16465 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:48.237598 18074 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.286759 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.232666 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.295351 18291 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.295487 18040 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.308724 18040 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:48.309629 18281 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.310350 18281 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:48.309923 18040 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:48.312893 18276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.050s	user 0.000s	sys 0.025s
W20260709 13:06:48.313515 18276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.112s	user 0.000s	sys 0.026s
I20260709 13:06:48.313834 18276 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:48.314880 18276 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.245828 18292 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:06:48.315753 18441 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.297269 16463 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:48.316514 18074 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.318873 18074 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.319554 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.321815 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.322161 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.299405 16466 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:48.322835 16470 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.302794 16461 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:48.304020 18390 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.300402 18242 raft_consensus.cc:359] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.323983 16467 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.295939 17118 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:48.319741 16618 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.325030 18242 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:06:48.280901 18262 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.326067 18242 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:48.326812 18262 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:48.329255 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.321775 18182 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.330058 18182 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.298365 18369 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.301255 18379 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:48.331439 18379 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:48.332365 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.322901 16468 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.333544 18379 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.333855 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.334587 16613 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:48.334661 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.323984 16465 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:48.335827 17127 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:48.337630 18370 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.338902 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.339751 16618 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:48.339939 18370 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.280628 18458 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.340653 18458 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.342978 18458 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.286046 18259 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.345417 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.345741 18259 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.346863 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.347687 16614 raft_consensus.cc:2368] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5.
I20260709 13:06:48.348758 16618 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:48.306548 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.364297 16469 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:48.368808 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83944us
W20260709 13:06:48.368957 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 83968.9us
I20260709 13:06:48.371958 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:48.378266 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.378312 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.381906 16464 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:48.392629 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:48.393564 17127 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:48.268996 18375 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:06:48.403239 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.405841 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:48.406261 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:48.412190 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.413146 16619 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:48.414319 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.417605 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:48.421293 16539 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:48.378290 18260 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.424141 16613 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:48.424611 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.428074 16469 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:48.390488 18379 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:48.300458 18374 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.425384 16462 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.428352 16619 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:48.431595 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.433840 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.435321 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.439076 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.423384 18370 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.442211 16468 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:48.442545 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.411865 16610 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:48.441923 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.447100 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.447386 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:48.449483 16611 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:48.422673 18369 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:48.425678 18390 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.454793 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 133074us
I20260709 13:06:48.450125 18059 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.456930 18267 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:48.457612 18267 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:48.459530 18462 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.462765 18292 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.463240 18292 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:48.463514 18460 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:48.463626 18292 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.464751 18375 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:48.435051 18179 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:48.469247 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.431421 18407 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:48.473838 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.482370 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.483839 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:48.483978 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.484747 16610 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:48.458194 18212 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.458410 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.485951 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:48.485868 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.460368 18364 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.441844 18379 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:48.482476 18461 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:48.461493 18074 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:48.474364 18370 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.460227 18462 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.461205 18260 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:48.545713 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71926us
I20260709 13:06:48.559537 17093 leader_election.cc:400] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6.
I20260709 13:06:48.559839 17093 leader_election.cc:403] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.548368 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:48.554961 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.456941 18059 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.558979 18260 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.587155 16464 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 1.
I20260709 13:06:48.554674 18459 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:48.588984 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 141962us
I20260709 13:06:48.591137 16434 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:06:48.591216 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 157422us
I20260709 13:06:48.523536 18371 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 13:06:48.591413 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 105541us
I20260709 13:06:48.482475 18369 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.591241 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.486596 18390 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.527385 18179 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:48.594955 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:48.557507 18365 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.553879 16610 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:48.601949 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.597043 18406 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.602687 18467 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:48.600557 17119 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:48.603318 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.589298 18260 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.584444 16465 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:48.600543 18267 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.616068 18375 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.618353 18242 ts_tablet_manager.cc:1434] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.588s	user 0.012s	sys 0.000s
I20260709 13:06:48.619221 18464 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.622766 16615 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:48.620735 16619 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:48.621999 18467 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.642611 18289 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.643101 18289 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.643469 18289 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.643273 18467 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.622349 18435 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:06:48.616662 18281 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.645920 18374 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.628506 18364 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6.
I20260709 13:06:48.646462 18281 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.647042 18292 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:48.645406 18242 ts_tablet_manager.cc:1467] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Tablet startup took 607ms
I20260709 13:06:48.649205 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.650348 16612 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:48.588088 18074 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.671855 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.651508 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.681171 16619 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:06:48.689419 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 141140us
I20260709 13:06:48.690250 18370 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.690623 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:48.693104 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:48.710012 18148 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.712127 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:48.649045 18242 ts_tablet_manager.cc:1469] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Trace:
0709 13:06:42.683982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.688430 (+  4448us) service_pool.cc:224] Handling call
0709 13:06:42.931711 (+243281us) ts_tablet_manager.cc:934] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
0709 13:06:45.208310 (+2276599us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:45.771160 (+562850us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:45.778141 (+  6981us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:46.012457 (+234316us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:46.026413 (+ 13956us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:46.026815 (+   402us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:46.026875 (+    60us) inbound_call.cc:177] Queueing success response
0709 13:06:46.593549 (+566674us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:48.030389 (+1436840us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:48.132959 (+102570us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:48.133699 (+   740us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":19995,"mutex_wait_us":43686,"raft.queue_time_us":82144,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7001,"tablet-copy.queue_time_us":53499,"tablet-download-pool.queue_time_us":124,"tablet-download-pool.run_cpu_time_us":1428,"tablet-download-pool.run_wall_time_us":375088,"thread_start_us":87299,"threads_started":2}
I20260709 13:06:48.713344 18464 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.713551 18374 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.713902 18379 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.714223 18374 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.679551 18406 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:48.715353 18148 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.716207 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:48.716534 18369 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.716367 18148 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.717615 18374 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.616616 18462 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.721848 18059 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.691924 18375 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:48.723196 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.696038 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.724047 16618 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:48.621416 18390 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.719887 18289 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.747639 16462 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:48.723474 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 437926us
I20260709 13:06:48.748217 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.748678 16466 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:48.733098 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.738130 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.747408 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.747507 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.717849 18074 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.749768 16619 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:48.764689 16469 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.747973 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:48.766111 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.764098 16468 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 1.
W20260709 13:06:48.771378 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 324007us
I20260709 13:06:48.772459 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.745637 18464 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.746264 18205 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.780243 16469 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:48.776998 16461 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:48.782073 16436 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.762748 18370 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.784035 16436 leader_election.cc:400] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5.
I20260709 13:06:48.786758 16436 leader_election.cc:403] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.786978 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.777159 18365 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.777648 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.801925 16611 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:48.782639 18374 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:48.804275 18219 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.804281 18374 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.804852 18219 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.782843 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.805235 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.805734 16465 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:48.782670 18406 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.806761 18219 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.771152 18182 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.813031 17935 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5.
I20260709 13:06:48.813656 18182 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.814666 18479 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:06:48.796967 18365 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.816030 18365 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.812948 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.784963 18464 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.820555 18276 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:48.822541 18289 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.835482 16585 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.837688 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.838642 18466 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.838686 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.839159 18466 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.839557 18466 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.839850 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.840830 18262 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:48.841070 18074 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.841274 18262 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.841686 18074 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.841794 18262 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:48.842208 18074 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.843976 18459 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:48.844538 18459 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.835446 18260 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.846365 16463 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:48.847864 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.875867 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:48.879268 18390 raft_consensus.cc:2764] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:06:48.891024 17123 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:48.882968 16610 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:48.845554 18459 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.895237 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.902221 18466 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:48.885699 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 82441.5us
I20260709 13:06:48.909214 18483 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.909698 18483 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.909539 18375 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:48.910143 18483 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:48.910728 18375 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:48.911077 18375 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.911883 18375 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.914088 18464 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.915537 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.917258 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.913618 18375 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.921957 18260 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:48.931676 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 147896us
I20260709 13:06:48.932758 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:48.930737 18467 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:48.934954 18148 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.935384 18148 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:48.935464 18390 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:48.936477 18148 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.931825 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:48.937954 18148 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.939047 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.939193 18212 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:48.944420 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.945524 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:48.947774 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:48.945604 18074 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.946412 18260 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.953866 18222 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:48.954115 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:48.954432 18222 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.955065 18222 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:48.955304 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.956522 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:48.953998 18466 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.967254 18486 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:48.975890 18486 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.976293 18486 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:48.977811 18475 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:06:48.968264 18482 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:48.982183 18074 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:48.969053 17923 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:48.965406 18365 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.986014 18365 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.986929 17119 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:48.944995 18390 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:48.963940 18267 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:48.989085 18267 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:48.989574 18267 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.990784 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:48.991660 18289 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.992235 18289 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:48.993060 18490 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.993296 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:48.993641 18490 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.994270 18289 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:48.996079 18490 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:48.984315 17923 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:49.007157 17923 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.010429 18374 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:49.012603 16619 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:48.987517 18486 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:48.996356 16467 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:48.996637 18276 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.996904 18281 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:48.997504 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:48.999117 18458 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.999181 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.999521 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.001184 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:49.002689 18292 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.005510 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:48.964211 18179 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:49.015306 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:48.980147 18262 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:49.031258 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 87919.5us
I20260709 13:06:49.032488 17125 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:49.032732 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:49.033435 16464 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.032529 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:49.034248 16466 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.024752 18374 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.025095 18458 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:49.062453 16466 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:49.030318 18179 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:49.064940 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.065970 16614 raft_consensus.cc:2410] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:49.074994 16511 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:49.075331 17123 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:49.075431 16511 leader_election.cc:403] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.082150 17127 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:49.051966 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:49.027206 18276 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:49.088356 16464 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:49.049575 18281 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:49.052161 18435 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:49.076040 18179 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:49.103665 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.104475 18383 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.106328 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:49.107007 16612 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:49.107656 18383 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:49.109679 18486 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.110862 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:49.065342 18374 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:49.129081 18276 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:49.129480 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.130132 16619 raft_consensus.cc:2368] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:49.130982 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.131811 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.129262 17923 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:49.132792 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.133813 18222 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:49.134011 17923 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.134436 18424 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:49.091753 18267 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:49.135871 18222 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.137044 18483 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:49.142472 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.139322 18483 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:49.100095 18390 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:49.145349 17125 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:49.144351 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 118304us
I20260709 13:06:49.125278 18480 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:49.144232 17121 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:49.151122 18281 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.162115 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:49.153537 18480 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:49.125129 18458 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:49.159507 18375 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:06:49.188560 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:49.213416 16470 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:49.165436 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59665.4us
I20260709 13:06:49.222095 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:49.222496 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.222608 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:49.223549 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91821.2us
I20260709 13:06:49.223874 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:49.224457 16464 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:49.224906 17935 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.226495 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:49.227283 16465 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:49.227586 18504 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
I20260709 13:06:49.228403 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:49.228644 18509 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:06:49.229306 16585 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:49.229715 18464 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:06:49.230430 18464 consensus_queue.cc:1243] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer 98881185daee4f13b69385e36026216c log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:49.232182 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:49.232311 16469 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:49.232792 16539 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:49.237388 16464 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:49.244678 16461 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:49.264940 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.272213 16539 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:49.275104 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.167411 18262 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:49.170781 18291 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:49.277390 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47326.2us
I20260709 13:06:49.276693 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.182080 18267 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.181413 18374 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:49.169346 18205 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:49.323137 18205 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.329586 18040 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:49.285051 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:49.287133 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:49.333636 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46556.7us
I20260709 13:06:49.334857 16436 leader_election.cc:400] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:49.335194 16436 leader_election.cc:403] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.292924 16542 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:49.272951 18458 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.287110 18289 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:49.309156 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:49.288650 18407 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:49.317816 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:49.318087 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-14ab75d98ba64a9caa062cd19a0594fb received from {username='slave'} at 127.0.0.1:42898
I20260709 13:06:49.184023 18390 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:06:49.258405 18424 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:49.374895 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:49.330394 18040 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:49.281399 18506 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:49.285049 18074 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:49.286971 18212 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:49.366636 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 123448us
I20260709 13:06:49.366665 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:49.344193 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:49.282531 18281 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
W20260709 13:06:49.962780 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 268763us
W20260709 13:06:49.379434 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61707.7us
I20260709 13:06:49.498651 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:49.971411 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 627214us
W20260709 13:06:49.614945 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 306808us
I20260709 13:06:49.506316 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:49.988260 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:49.491389 18383 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:49.967622 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:49.515808 18279 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:49.517365 18040 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:49.531003 16465 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:49.659380 18374 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.049504 16542 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:49.488760 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:49.377367 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:49.488361 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-14ab75d98ba64a9caa062cd19a0594fb on tablet 14ab75d98ba64a9caa062cd19a0594fb with peer 98881185daee4f13b69385e36026216c
I20260709 13:06:49.351212 18511 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.552249 18510 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:06:49.775599 16364 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 3, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.378223 18276 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3.
I20260709 13:06:49.488445 18486 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.352591 18259 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.669s
I20260709 13:06:49.261634 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:49.345515 18371 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:49.839368 16618 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.000s
I20260709 13:06:50.062640 16618 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:49.492238 18490 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.377951 16616 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:50.037616 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.038152 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.035764 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:50.040441 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 105073us
I20260709 13:06:50.054976 18505 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.064482 18432 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:06:50.062399 18371 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.066998 18371 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.066665 18505 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.057404 18459 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:49.560802 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.069114 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.058014 16364 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.034454 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64019us
I20260709 13:06:50.038645 18289 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.758103 16368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 169) took 7281 ms. Trace:
I20260709 13:06:50.069130 18459 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.077461 18459 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:50.078125 18505 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.079366 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1640) took 1013 ms. Trace:
I20260709 13:06:50.046783 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:50.044140 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.039471 18059 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.349659 18370 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.684s
I20260709 13:06:50.047850 16615 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:49.536113 18467 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.074285 16364 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 5, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.080925 18490 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.093321 18490 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.093925 18486 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.372622 18480 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.095714 18212 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.096668 18212 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.085567 18267 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.080150 18289 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.099822 18267 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:50.100304 18212 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.100870 18267 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.050514 16536 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.049482 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.051118 18383 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.056249 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.044939 18182 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.057709 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.087435 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1519) took 1438 ms. Trace:
I20260709 13:06:50.042714 18483 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:50.104696 16544 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:49.515384 18179 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.048413 18506 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.063822 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.051530 17119 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.074963 16368 rpcz_store.cc:276] 0709 13:06:42.476610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.484198 (+  7588us) service_pool.cc:224] Handling call
0709 13:06:49.757851 (+7273653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.777185 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.820954 (+ 43769us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.821004 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:44.821022 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:44.898564 (+ 77542us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.898664 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.898704 (+    40us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:06:44.899758 (+  1054us) tablet.cc:701] Row locks acquired
0709 13:06:44.899784 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:06:44.899957 (+   173us) write_op.cc:270] Start()
0709 13:06:44.900090 (+   133us) write_op.cc:276] Timestamp: P: 1783602404899905 usec, L: 0
0709 13:06:44.900117 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.950803 (+ 50686us) log.cc:844] Serialized 4240 byte log entry
0709 13:06:45.267221 (+316418us) op_driver.cc:464] REPLICATION: finished
0709 13:06:45.314828 (+ 47607us) write_op.cc:301] APPLY: starting
0709 13:06:45.314932 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:45.315161 (+   229us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:45.315313 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:45.520739 (+205426us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:45.520966 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:06:45.521007 (+    41us) write_op.cc:312] APPLY: finished
0709 13:06:45.521275 (+   268us) log.cc:844] Serialized 77 byte log entry
0709 13:06:45.522209 (+   934us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.522462 (+   253us) write_op.cc:454] Released schema lock
0709 13:06:45.522595 (+   133us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:45.523604 (+  1009us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.523678 (+    74us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":826523,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":47317,"apply.run_cpu_time_us":4062,"apply.run_wall_time_us":208534,"num_ops":10,"prepare.queue_time_us":146314,"prepare.run_cpu_time_us":37140,"prepare.run_wall_time_us":357654,"raft.queue_time_us":109639,"raft.run_cpu_time_us":13415,"raft.run_wall_time_us":64976,"replication_time_us":366876,"thread_start_us":305752,"threads_started":4,"wal-append.queue_time_us":195870,"wal-append.run_cpu_time_us":11805,"wal-append.run_wall_time_us":1381634}]]}
I20260709 13:06:50.079789 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:49.489151 18477 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:50.124374 18477 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:50.079794 16613 rpcz_store.cc:276] 0709 13:06:49.066019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.066158 (+   139us) service_pool.cc:224] Handling call
0709 13:06:49.066524 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.066919 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.066958 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.077105 (+ 10147us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.140067 (+ 62962us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:49.140121 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.140208 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.079168 (+938960us) raft_consensus.cc:1685] finished
0709 13:06:50.079194 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.079311 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3513,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":1362176,"thread_start_us":55747,"threads_started":1,"wal-append.queue_time_us":82843}
I20260709 13:06:50.125159 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.101341 18289 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.053565 18374 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.041154 18074 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.105305 16615 rpcz_store.cc:276] 0709 13:06:48.649138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.552312 (+903174us) service_pool.cc:224] Handling call
0709 13:06:50.087378 (+535066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:50.042035 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:50.107626 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 71896.8us
I20260709 13:06:49.587191 18205 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.086374 18370 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.085834 18059 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.088973 18407 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:50.087651 18467 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.110901 18182 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.112473 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.127197 18483 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.115545 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.116861 16538 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:50.089769 16364 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 5, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 5 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:50.122077 16540 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:50.055477 18511 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:50.104633 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 66555.1us
I20260709 13:06:50.137745 16612 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.089685 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.105940 18383 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.111701 18480 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.106151 18281 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.115769 17923 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:50.132787 17123 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:50.134087 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.081727 16543 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:50.112525 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:50.128528 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.125629 18477 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.150785 16364 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:50.163703 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51242.9us
I20260709 13:06:50.167016 17124 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:50.167313 16364 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.157022 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:50.160230 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.139223 18370 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.159781 17122 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.171995 16469 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.136732 18390 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:06:50.174539 16462 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:50.175608 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.178896 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.173164 16364 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 2 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:50.184031 18459 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:50.184834 18458 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.834s	user 0.012s	sys 0.000s
I20260709 13:06:50.185385 17126 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.185617 16613 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:50.186028 16613 pending_rounds.cc:85] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:06:50.186251 16613 pending_rounds.cc:107] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:50.186527 16613 raft_consensus.cc:2889] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.186605 16470 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.187808 16536 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:50.189064 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.189247 16536 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:50.189635 18040 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.190632 16536 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:50.191865 16536 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:50.191867 16464 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:50.192842 16536 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:50.193216 16536 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:50.189292 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:50.170096 16582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.517s (SENT) [suppressed 3 similar messages]
I20260709 13:06:50.205812 16540 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:50.204293 16536 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.173681 18485 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.166109 17923 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:50.166030 16537 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:50.147989 18074 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.194912 18506 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.210791 16536 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.216737 16544 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:50.218156 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.222524 16541 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:50.177695 18289 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.193015 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.193040 18483 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.227244 18374 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.204640 18365 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.228541 18179 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.229166 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.230293 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.231323 18511 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:50.212622 18527 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:06:50.182735 16364 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 4, term changed from 3 to 4, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to <none>, VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added, no longer has a pending config: VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65), VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66), VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67), NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:50.257421 16536 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:50.279287 16536 pending_rounds.cc:85] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 2
I20260709 13:06:50.208856 18219 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:50.240247 18526 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:50.279592 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:50.279637 16536 pending_rounds.cc:107] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:06:50.211844 17923 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:50.256455 16540 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.209141 18432 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:50.212577 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.282987 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.282415 16364 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.241509 18182 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.299304 16364 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 5, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 5 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } }
I20260709 13:06:50.208961 18458 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:50.302129 18458 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.211570 18485 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:50.287236 16536 raft_consensus.cc:2889] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.232345 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.290673 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.233894 18059 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.235169 16465 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:50.231881 18289 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.301537 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.304054 16469 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:50.303987 16541 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:50.300519 16364 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 2, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.311784 16364 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 5, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.317159 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:50.321527 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 91325.6us
I20260709 13:06:50.255990 18505 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:06:50.323230 16364 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 4, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 4 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.326658 18289 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.302062 18459 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:50.328014 18522 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:50.326670 18485 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.321527 18219 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.349534 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.363125 16364 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.349864 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 244) took 1109 ms. Trace:
I20260709 13:06:50.364838 16364 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.364270 16545 rpcz_store.cc:276] 0709 13:06:49.240248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.240401 (+   153us) service_pool.cc:224] Handling call
0709 13:06:49.329712 (+ 89311us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b5800003398. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:49.329848 (+   136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.330211 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.330238 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.330717 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.710798 (+380081us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:49.710837 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.710910 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.333027 (+622117us) raft_consensus.cc:1685] finished
0709 13:06:50.333056 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.349776 (+ 16720us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12152,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":35502,"spinlock_wait_cycles":8282368,"thread_start_us":379695,"threads_started":1,"wal-append.queue_time_us":801101}
I20260709 13:06:50.369321 16364 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 3, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.374271 16364 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.336292 18511 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.312544 18521 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:06:50.390316 16541 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:50.356882 18179 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:50.384627 16364 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 4 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.384048 18477 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.423580 16364 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 3, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:50.451725 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:50.468353 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 93618.7us
I20260709 13:06:50.475828 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.453514 18289 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.398744 18511 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:50.475296 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 305205us
I20260709 13:06:50.451721 18179 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.497263 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.473678 18365 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.507273 16540 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.455386 18383 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.487274 18505 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.516733 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.487309 18432 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:50.522341 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 228958us
I20260709 13:06:50.532402 16542 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:50.538393 16540 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:50.541863 18390 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.542488 18179 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.514251 18365 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.545185 18365 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:50.545102 18544 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:50.545637 18511 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.546106 18541 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:50.546478 18432 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.547322 16612 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:50.486119 18289 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.533560 18505 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.574055 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.557368 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1646) took 1198 ms. Trace:
I20260709 13:06:50.581669 18289 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.587694 18518 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:50.588241 18518 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:50.577430 18371 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.002s
I20260709 13:06:50.593325 18371 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.613233 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.614087 16543 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:50.611997 18371 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.639439 18505 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.639611 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.640985 18467 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:50.640754 18365 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.641300 18544 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.641902 18544 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.640998 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.646876 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.600363 18390 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.649458 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.650818 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.656402 17123 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:06:50.649363 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 76160.2us
I20260709 13:06:50.656985 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:50.664338 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 85081us
I20260709 13:06:50.577720 16612 rpcz_store.cc:276] 0709 13:06:49.352916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.375463 (+ 22547us) service_pool.cc:224] Handling call
0709 13:06:50.550938 (+1175475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:50.674959 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:50.675382 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 127324us
I20260709 13:06:50.645833 16537 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:50.658224 18505 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:50.688107 18557 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:50.690224 18557 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:50.690995 18557 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.692353 18259 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:50.692934 18259 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.694005 18259 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.697691 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1279) took 1099 ms. Trace:
I20260709 13:06:50.698200 16542 rpcz_store.cc:276] 0709 13:06:49.598656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.057417 (+458761us) service_pool.cc:224] Handling call
0709 13:06:50.697431 (+640014us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003854d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:50.697616 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980771584}
I20260709 13:06:50.684038 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.672809 18543 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:50.706614 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.707746 18511 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.708436 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:06:50.713466 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56579.3us
I20260709 13:06:50.714840 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:50.660928 18390 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.716697 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:50.723487 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.716174 18543 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.685217 18525 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.710956 18259 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.716578 18371 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.732756 16540 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:50.724427 18544 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.718223 18289 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.727671 18553 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.745802 17923 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.735911 18179 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:50.746763 18543 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.739768 18458 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.742252 18467 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:50.743312 18364 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.748708 18364 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.665649 18518 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.750494 18518 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:50.751168 18364 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.753125 18371 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:50.754312 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.754937 18205 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.714644 18505 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.758862 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.724463 18562 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.765527 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.766281 18370 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:50.771298 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52622.2us
I20260709 13:06:50.777583 16539 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:50.779418 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:50.778524 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.783906 18557 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.732677 18432 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.788707 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.808303 18563 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.810123 18371 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.812784 18505 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.777297 18562 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.813493 18562 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:50.813889 18390 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.787153 18289 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.787988 18521 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:06:50.819154 18530 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.299s	user 0.006s	sys 0.000s
I20260709 13:06:50.792876 18525 raft_consensus.cc:2764] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:50.818148 18370 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:50.820377 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 381) took 1132 ms. Trace:
I20260709 13:06:50.820698 17127 rpcz_store.cc:276] 0709 13:06:49.688130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.688285 (+   155us) service_pool.cc:224] Handling call
0709 13:06:50.035753 (+347468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.036185 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:50.036241 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.041759 (+  5518us) log.cc:844] Serialized 26 byte log entry
0709 13:06:50.382957 (+341198us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:50.382997 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:50.383091 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.818375 (+435284us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:50.820094 (+  1719us) raft_consensus.cc:1685] finished
0709 13:06:50.820121 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.820324 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":659,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":7760,"spinlock_wait_cycles":66202880,"thread_start_us":340863,"threads_started":1,"wal-append.queue_time_us":445876}
W20260709 13:06:50.825737 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 66958.4us
I20260709 13:06:50.827010 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:50.828464 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 49106.5us
I20260709 13:06:50.791640 18374 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:06:50.838380 18544 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.838792 18544 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.839121 18544 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.843895 18390 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:50.840586 18289 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.844698 18466 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:50.845897 17923 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:50.846433 18521 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:50.847790 18521 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:50.849661 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.851017 18553 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:50.852661 18553 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.853168 18432 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:50.854236 18432 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:50.854635 18432 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:50.854507 18511 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:50.855504 18432 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.856143 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.853291 18553 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:50.832191 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:50.856980 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 191467us
W20260709 13:06:50.832239 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.860147 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 128296us
I20260709 13:06:50.860802 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.861179 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:50.868096 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:50.868124 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.872407 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:50.873204 17127 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:50.858184 18432 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.874372 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.827014 18525 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:50.878433 16618 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.858599 17923 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.880342 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1271) took 1284 ms. Trace:
I20260709 13:06:50.892064 16539 rpcz_store.cc:276] 0709 13:06:49.596046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.112255 (+516209us) service_pool.cc:224] Handling call
0709 13:06:50.880127 (+767872us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540031a454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:50.880290 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434150272}
I20260709 13:06:50.883898 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.873013 18289 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:50.894743 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.875612 18505 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:50.895556 18505 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:50.896275 18219 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.896821 18219 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:50.897310 18219 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.897964 18505 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:50.871205 18371 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:50.867103 18407 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.874271 18521 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.901510 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.901837 18521 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.903376 18370 raft_consensus.cc:1027] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: attempt to promote peer 98881185daee4f13b69385e36026216c: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:06:50.904297 18521 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:50.884595 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.913232 18557 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:50.913331 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.914707 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:50.915330 18371 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:50.886416 16538 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:50.886919 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:50.889793 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.919626 16617 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 2.
I20260709 13:06:50.890568 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.905490 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.908203 16469 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.922976 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.923810 16469 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:50.884429 16619 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:06:50.909438 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.924568 16619 pending_rounds.cc:85] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:06:50.926038 16619 pending_rounds.cc:107] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:06:50.926379 16619 raft_consensus.cc:2889] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:50.915422 16465 raft_consensus.cc:2368] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:06:50.885759 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.914958 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.920941 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:50.874177 18390 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:50.913404 16468 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:50.929127 16467 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:50.931088 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.934845 16539 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:50.936455 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.937273 16539 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:50.878027 18276 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:50.970526 16468 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.941887 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:50.943812 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75747us
I20260709 13:06:50.972565 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.972903 16469 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:50.974472 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:50.945971 18566 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.947118 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.947713 18569 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.948881 18370 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:50.950012 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.951076 16619 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:50.985276 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.952752 16618 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.986310 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:50.987165 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:50.953193 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:50.954057 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.954339 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.955363 16543 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:50.957233 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:50.958154 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.960160 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:50.960630 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:50.961207 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:50.962072 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.962837 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:50.964666 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.909515 18559 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:50.975656 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.916241 18371 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.977670 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:50.979346 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.991814 16544 raft_consensus.cc:606] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:50.895123 18562 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:50.929813 18074 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.996707 16544 raft_consensus.cc:614] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:50.992502 16466 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:50.986248 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.993377 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.997944 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:50.980875 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.001294 16464 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:51.005323 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:50.976284 18567 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.971045 18364 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:50.978829 18182 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:50.980093 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:51.011946 16613 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:51.014902 16464 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:50.988152 18518 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:51.023852 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.025223 16466 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:51.002934 16469 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:51.027252 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:51.027550 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.989653 18490 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.995398 18553 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:50.977265 18568 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.028803 16615 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:06:51.037696 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 45632.2us
I20260709 13:06:51.039378 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:51.002579 18289 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.040166 18289 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:50.989629 18370 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:51.040580 18289 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.040809 18370 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.031018 18364 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.042639 18383 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.042970 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.043735 16538 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:51.044553 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.045081 16538 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:51.045450 16467 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:51.020290 18182 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.045768 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.046101 18182 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.046566 16467 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:51.046819 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:51.047765 16462 pending_rounds.cc:85] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 3
I20260709 13:06:51.048159 16462 pending_rounds.cc:107] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:51.047724 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.034678 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:50.983302 18267 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:51.048786 16538 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:51.055182 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:51.048430 16462 raft_consensus.cc:2889] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.030300 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.037508 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.057279 16613 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:51.057348 16611 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:50.988719 18566 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.059921 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.061244 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.048568 16467 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:51.022239 18458 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:51.084620 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.085088 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:51.085291 16613 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:51.083998 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:51.089689 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.090276 16538 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:51.090958 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.032424 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.093910 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.096390 16613 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:51.092819 18535 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:06:51.097596 18535 consensus_queue.cc:1243] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:51.098089 18535 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:51.098412 18535 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:51.099210 18535 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.048491 18485 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.100730 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:50.989995 18569 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.103184 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.103744 16538 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.031599 18374 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:51.083956 18383 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:51.012512 18074 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.028545 18567 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:51.094357 18458 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.105877 18559 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.120421 18562 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.052963 17923 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:06:51.121435 16611 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:51.121515 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.094974 18553 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.160676 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:51.121680 18370 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.122892 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.092613 18565 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:51.084085 18390 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:51.105216 18407 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:51.105285 18570 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:51.178124 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.123728 16614 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:51.157198 16469 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:06:51.162814 16542 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:51.102928 18485 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.199548 16469 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:51.205328 16461 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:51.211378 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:51.160977 18459 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:51.168586 18276 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.219849 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:51.220643 16542 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.178037 18291 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.170895 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:51.171471 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:51.169412 16544 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:51.159179 18059 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.237514 16611 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:06:51.241195 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 69830us
I20260709 13:06:51.177510 18582 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 13:06:51.243322 18580 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:51.244551 18582 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.245185 18582 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.245743 18483 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:51.245858 18569 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.246232 18483 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.246687 18483 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.247323 18582 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.205612 18485 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.251577 16611 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:51.247378 18566 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.162901 18535 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:51.331312 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 77083us
I20260709 13:06:51.336053 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:51.335743 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 87400.3us
I20260709 13:06:51.251421 18291 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.219098 18553 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:06:51.236676 18276 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:51.389484 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51492.2us
I20260709 13:06:51.370721 16542 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:51.168751 18559 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.423545 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.442901 16464 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:51.445230 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.445966 16542 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:06:51.341840 18550 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.635s	user 0.000s	sys 0.010s
I20260709 13:06:51.319443 18544 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:51.494059 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 394132us
I20260709 13:06:51.330658 18435 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.340310 18365 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.496994 18506 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.319880 18259 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:51.347258 18291 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.505899 16468 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:51.507596 16511 leader_election.cc:400] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:06:51.250428 18459 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.360178 18267 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.504314 16466 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:51.533427 18458 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.535655 16610 raft_consensus.cc:2368] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7.
I20260709 13:06:51.510100 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.519276 18365 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.497666 18467 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.537976 18467 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:51.539427 18219 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.001s
I20260709 13:06:51.539803 18219 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.540412 18276 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.541921 18219 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.542236 18544 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.542564 16537 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.518288 18435 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.518062 18506 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:51.355078 18564 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.162s
W20260709 13:06:51.547856 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 100655us
I20260709 13:06:51.339025 18182 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.355398 18557 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.152s
I20260709 13:06:51.552137 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:51.522262 16511 leader_election.cc:403] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.348366 18566 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
W20260709 13:06:51.529498 16617 consensus_meta.cc:287] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.006s
I20260709 13:06:51.554698 16617 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 2.
I20260709 13:06:51.573246 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.575011 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.575788 16538 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:51.521281 18390 consensus_queue.cc:1243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:51.598202 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:51.599313 16617 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:51.540441 18467 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.550086 18459 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.608058 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:51.609108 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:51.653743 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45748.5us
I20260709 13:06:51.652386 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:51.656741 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.660537 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:51.602134 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.614104 18566 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:51.665030 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 157623us
W20260709 13:06:51.615712 18432 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.718s	user 0.005s	sys 0.005s
I20260709 13:06:51.550298 18267 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.667987 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:51.652304 18567 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.671748 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:51.661747 18584 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
W20260709 13:06:51.661624 18571 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:51.656589 18563 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:51.667378 18566 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:51.661612 18374 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.699120 18371 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:51.708868 18364 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.710413 18364 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.710002 18566 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.710881 18364 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.711457 18566 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:51.701212 18588 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:06:51.669481 18040 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:06:51.711169 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.666504 18459 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.721048 16463 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:51.722790 16538 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:51.668563 18544 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:06:51.667168 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.697826 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:51.696923 18567 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:51.735769 16543 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.024s	sys 0.029s
W20260709 13:06:51.736203 16543 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.024s	sys 0.029s
W20260709 13:06:51.764822 16619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.018s	sys 0.022s
W20260709 13:06:51.765403 16619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.018s	sys 0.022s
I20260709 13:06:51.738807 18182 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.770097 18182 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.770599 18182 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:51.771059 18182 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.732539 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.773648 16463 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:51.720873 18371 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.730979 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63962us
I20260709 13:06:51.780078 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.784334 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:51.742316 18040 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:06:51.807108 18597 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:51.807528 18597 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:51.809763 18490 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.810349 18490 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:51.811924 18485 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.003s
I20260709 13:06:51.720655 18374 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.725037 18592 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:06:51.743002 18390 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:06:51.778483 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:51.808387 18597 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.812489 18485 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.785486 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:51.783710 18563 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.823050 16544 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:51.817906 18596 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.883589 18365 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.839275 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:51.817353 18276 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.830402 16545 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:51.791800 18459 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:51.819869 18483 consensus_meta.cc:287] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.003s
W20260709 13:06:51.815609 18289 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.009s
I20260709 13:06:51.890002 16465 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.787864 18371 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.827049 16537 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:51.817518 18267 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.836972 18364 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.838107 18279 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:51.941069 18279 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:51.941854 18182 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.942080 18279 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.943178 17118 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:51.943647 18279 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:51.944571 18182 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.816039 18601 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.945205 18601 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.945628 18601 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.946605 18374 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.829447 18291 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.947566 17127 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:51.948269 18585 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.441s	user 0.004s	sys 0.000s
I20260709 13:06:51.948858 18291 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.916824 18289 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.877329 18477 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:51.882296 18596 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.950836 16467 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:51.951551 18289 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.951640 18596 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.952251 16461 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:51.908913 18485 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.953397 18371 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.955770 18074 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.956290 18074 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:51.912195 16542 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:51.899210 18459 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:51.918246 18597 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.797978 18603 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.817668 18562 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:51.913261 18483 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.921111 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:51.957170 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1429) took 1047 ms. Trace:
I20260709 13:06:51.956724 18601 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.905789 18276 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.965327 18590 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:51.922129 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 137944us
I20260709 13:06:51.958633 18459 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:51.966281 18276 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.923858 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:51.927417 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:51.968612 18570 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:51.969014 18570 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:51.816529 18559 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.898025 16616 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:51.933528 18365 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.969847 18570 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:51.970112 18365 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:51.971071 18570 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.971580 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 295) took 1019 ms. Trace:
I20260709 13:06:51.972186 18365 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:51.812613 18490 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.926904 18435 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:51.952875 16467 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:06:51.966144 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.963997 16470 rpcz_store.cc:276] 0709 13:06:50.909623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.911604 (+  1981us) service_pool.cc:224] Handling call
0709 13:06:50.911872 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:50.912201 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:50.912236 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:50.919267 (+  7031us) log.cc:844] Serialized 26 byte log entry
0709 13:06:51.157031 (+237764us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:51.157086 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.157157 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:51.947635 (+790478us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:51.956854 (+  9219us) raft_consensus.cc:1685] finished
0709 13:06:51.956877 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:51.957109 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":6336768,"thread_start_us":145488,"threads_started":1,"wal-append.queue_time_us":360086}
I20260709 13:06:51.933189 17121 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:51.922813 18564 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.928057 18407 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:51.972112 16544 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:51.959399 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1293) took 1003 ms. Trace:
I20260709 13:06:51.949347 18383 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:51.984365 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:06:51.993722 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.016335 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.971956 16616 rpcz_store.cc:276] 0709 13:06:50.952222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.960895 (+  8673us) service_pool.cc:224] Handling call
0709 13:06:51.971428 (+1010533us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540025e254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:51.971526 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574521728}
I20260709 13:06:52.012746 16545 rpcz_store.cc:276] 0709 13:06:50.956031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.140482 (+184451us) service_pool.cc:224] Handling call
0709 13:06:51.156329 (+ 15847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.893068 (+736739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.959186 (+ 66118us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54002053d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:51.959344 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549250944}
I20260709 13:06:52.014168 16544 pending_rounds.cc:85] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 2
I20260709 13:06:52.019392 16544 pending_rounds.cc:107] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:52.020625 16544 raft_consensus.cc:2889] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:52.018358 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:52.023821 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:52.025517 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:51.961503 18483 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:52.027765 18276 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.073179 18599 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.067585 18605 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:06:52.073700 18599 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.073583 18276 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.074112 18599 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.074311 18605 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:52.074524 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:52.074771 18605 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:52.012578 18564 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:52.075912 18564 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.066948 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1535) took 1112 ms. Trace:
I20260709 13:06:52.077107 16613 rpcz_store.cc:276] 0709 13:06:50.954484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.097158 (+142674us) service_pool.cc:224] Handling call
0709 13:06:51.097407 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.172381 (+ 74974us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:51.208007 (+ 35626us) log.cc:844] Serialized 14 byte log entry
0709 13:06:51.494854 (+286847us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:51.494918 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:51.494971 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.967976 (+473005us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b1800452560. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:52.066723 (+ 98747us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b54000a05d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:52.066773 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.066888 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35715,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":34718,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":176872064,"thread_start_us":248303,"threads_started":1,"wal-append.queue_time_us":335590}
I20260709 13:06:52.080368 18563 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.082355 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.083134 18564 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:52.083616 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.015113 18559 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.084735 16465 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:52.084640 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.084955 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1743) took 1053 ms. Trace:
I20260709 13:06:52.086069 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.086405 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.095502 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.097054 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.090978 16538 rpcz_store.cc:276] 0709 13:06:51.032047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.723652 (+691605us) service_pool.cc:224] Handling call
0709 13:06:51.723941 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.724158 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:51.737968 (+ 13810us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.084448 (+346480us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b1800390f40. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a
0709 13:06:52.084639 (+   191us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:52.084690 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.084732 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.084809 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.084910 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10276,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3869,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":18632960,"thread_start_us":37200,"threads_started":1,"wal-append.queue_time_us":136259}
I20260709 13:06:52.105995 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:51.961266 18370 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:51.965711 18590 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:51.965710 18601 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:52.015082 18407 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.119764 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:52.067569 16537 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:52.075682 18276 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:52.098387 18569 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:52.028903 18544 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.026548 18383 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.028875 18505 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.026520 18522 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.067673 18059 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:52.168617 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49480.5us
I20260709 13:06:52.193542 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.194572 17090 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:51.985183 18074 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:52.172240 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.173712 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54057.4us
I20260709 13:06:52.199800 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:52.178499 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 506777us
W20260709 13:06:52.191887 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 494100us
I20260709 13:06:52.201812 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:52.196251 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 259) took 1042 ms. Trace:
I20260709 13:06:52.117872 18205 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:06:52.109592 18597 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:06:52.206842 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:52.193950 16464 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:52.112403 18459 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.176378 18564 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:52.175948 18544 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:52.213196 17126 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:52.197108 18059 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.224195 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:52.205905 18365 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.226357 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:52.218815 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:52.220808 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:52.175516 18467 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:52.212042 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:52.221443 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:52.222713 16613 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:06:52.226917 17125 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.962399 18603 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:52.189306 18370 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:06:52.212142 18543 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.245748 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:52.213272 18483 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.246080 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.257562 16542 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:52.223048 18544 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:52.265848 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.245998 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:52.224108 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:52.247824 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:52.267637 16461 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:52.251015 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:52.267529 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:52.261200 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.251804 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:52.224782 18592 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:52.266746 16470 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.282591 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1740) took 1257 ms. Trace:
I20260709 13:06:52.282980 16536 rpcz_store.cc:276] 0709 13:06:51.025400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.605268 (+579868us) service_pool.cc:224] Handling call
0709 13:06:51.605603 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.669665 (+ 64062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.669698 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.670128 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.003477 (+333349us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.003517 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.003585 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.282393 (+278808us) raft_consensus.cc:1685] finished
0709 13:06:52.282414 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.282534 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59648,"raft.queue_time_us":70669,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":20928,"thread_start_us":317582,"threads_started":1,"wal-append.queue_time_us":508998}
I20260709 13:06:52.284898 18597 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.285283 18597 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:52.285638 18597 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.258589 16616 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:52.257583 18276 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.289033 18276 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.289392 18276 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.273674 17125 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:52.259887 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:52.292832 18583 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.175s
I20260709 13:06:52.293042 17126 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:52.214370 18590 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.294487 18590 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.296798 16470 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:52.302062 18371 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:52.302047 18506 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.303251 18506 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.302971 18371 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:52.266928 18483 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:52.305330 18371 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:52.313851 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.317385 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.276289 18259 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.208027 16537 rpcz_store.cc:276] 0709 13:06:51.153442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.826523 (+673081us) service_pool.cc:224] Handling call
0709 13:06:51.826926 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.168999 (+342073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.196183 (+ 27184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:52.227092 18279 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:06:52.465184 18279 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.465569 18279 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:52.465665 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.466216 16542 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:52.466396 18279 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.467548 18279 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:52.284636 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.469480 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.470464 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.471331 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:52.472178 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.275781 18074 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:52.273878 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:52.306701 18483 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:52.296610 18603 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:52.229626 18627 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.473670 16536 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:52.473980 18627 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:52.474426 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:52.475005 16536 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:52.475188 18627 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.262184 18606 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:52.263350 18626 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:52.478081 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1294) took 1521 ms. Trace:
I20260709 13:06:52.478569 16539 rpcz_store.cc:276] 0709 13:06:50.956250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.145513 (+189263us) service_pool.cc:224] Handling call
0709 13:06:51.154904 (+  9391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.513772 (+358868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.513818 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.554314 (+ 40496us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.118939 (+564625us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:52.119186 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.119282 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.477863 (+358581us) raft_consensus.cc:1685] finished
0709 13:06:52.477883 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.478031 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178786,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":24626,"thread_start_us":828143,"threads_started":2,"wal-append.queue_time_us":628214}
I20260709 13:06:52.481065 16539 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:52.407148 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 90864.5us
I20260709 13:06:52.340230 18383 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:52.462543 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 195094us
I20260709 13:06:52.463135 18555 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.428030 17126 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:52.505457 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:52.431914 17118 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:06:52.508386 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 234557us
I20260709 13:06:52.518723 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:52.472678 16542 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:52.514290 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:52.526608 16536 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:52.520633 16542 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:52.528132 16542 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:52.426970 18582 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:52.539208 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:52.488016 18553 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:52.432533 18583 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:52.605615 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55746.6us
I20260709 13:06:52.548008 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:52.611394 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:52.547683 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:52.550514 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.589536 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.623843 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.623610 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:52.625447 16619 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:52.604166 16542 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.432348 18567 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:06:52.627303 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:52.631726 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:52.652802 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:52.651454 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:52.528160 18483 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.500958 18592 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:52.518150 18626 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.633663 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:52.529105 18565 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.691797 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:52.465184 18259 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.538367 18606 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:52.541821 18074 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:52.522871 18569 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:52.811846 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.617820 18559 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.133s
I20260709 13:06:52.691669 18603 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:52.716005 18483 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.634888 18543 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 13:06:52.759156 16611 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:52.699028 18596 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:52.604966 18582 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:52.896634 16465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.030s	sys 0.041s
W20260709 13:06:52.899176 16465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.030s	sys 0.041s
W20260709 13:06:52.842976 17119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.044s	sys 0.053s
I20260709 13:06:52.628046 18583 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:52.772130 18562 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42888 (request call id 8) took 11321 ms. Trace:
W20260709 13:06:52.924022 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 402026us
I20260709 13:06:52.769629 18074 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:52.633198 18553 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:52.932296 16470 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:52.938637 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 325175us
I20260709 13:06:52.885888 18259 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:52.943181 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:52.888429 18483 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.816716 16612 raft_consensus.cc:1217] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
W20260709 13:06:52.924028 17119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.044s	sys 0.054s
I20260709 13:06:52.906405 18606 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.901912 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:52.747380 18592 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:52.987305 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45982us
W20260709 13:06:53.007409 18407 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.000s
W20260709 13:06:53.008054 18632 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:53.007951 18407 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.009369 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1451) took 1462 ms. Trace:
I20260709 13:06:52.939222 18370 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:53.019840 18564 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:53.020648 16466 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:52.939086 18074 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:52.897854 18603 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.009819 16468 rpcz_store.cc:276] 0709 13:06:51.547009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.889420 (+342411us) service_pool.cc:224] Handling call
0709 13:06:51.889823 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.890090 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.890129 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.892628 (+  2499us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.175967 (+283339us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:52.176004 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.176065 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.009124 (+833059us) raft_consensus.cc:1685] finished
0709 13:06:53.009148 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.009298 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":272844,"threads_started":1,"wal-append.queue_time_us":723694}
I20260709 13:06:53.028403 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:52.908187 18596 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.009539 16612 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:06:53.041728 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:52.892585 18645 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.203s
I20260709 13:06:53.049280 16466 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:53.067976 16465 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:53.041384 18633 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:53.060026 18279 consensus_meta.cc:287] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.003s
I20260709 13:06:53.050221 18370 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.074887 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1295) took 2118 ms. Trace:
I20260709 13:06:53.077661 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 213) took 1740 ms. Trace:
I20260709 13:06:53.094210 16464 rpcz_store.cc:276] 0709 13:06:51.337116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.443557 (+106441us) service_pool.cc:224] Handling call
0709 13:06:51.444136 (+   579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:51.493764 (+ 49628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.494036 (+   272us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:51.830197 (+336161us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b18003d14a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa357c9a20 00007ffa357daa29 00007ffa357a0644 00007ffa357c7f2d
0709 13:06:51.831882 (+  1685us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4c002e7dc0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa357c9a20 00007ffa357daa29 00007ffa357a0644 00007ffa357c7f2d 00007ffa357c7b93 00007ffa374f818b 00007ffa374f8cb5 00007ffa374fa004 00007ffa374f9729 00007ffa374fed96 00007ffa374f3adb
0709 13:06:51.876046 (+ 44164us) log.cc:844] Serialized 590 byte log entry
0709 13:06:52.193835 (+317789us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:52.513297 (+319462us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.518876 (+  5579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.518973 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.077438 (+558465us) raft_consensus.cc:1685] finished
0709 13:06:53.077458 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.077600 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274,"raft.queue_time_us":71576,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7443,"spinlock_wait_cycles":79032064,"thread_start_us":279186,"threads_started":1,"wal-append.queue_time_us":1176684}
I20260709 13:06:53.077751 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1503) took 1341 ms. Trace:
I20260709 13:06:53.078011 18583 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:53.056941 18383 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.058089 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 479) took 1177 ms. Trace:
I20260709 13:06:53.040705 18564 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.078117 18596 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.051553 18626 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:53.088712 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:53.126354 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53981.5us
I20260709 13:06:53.053035 18646 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:53.097798 16469 rpcz_store.cc:276] 0709 13:06:51.735910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.914168 (+178258us) service_pool.cc:224] Handling call
0709 13:06:51.914490 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.914836 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.914862 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.930368 (+ 15506us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.266806 (+336438us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:52.344582 (+ 77776us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.402347 (+ 57765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.402454 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.077557 (+675103us) raft_consensus.cc:1685] finished
0709 13:06:53.077576 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.077686 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77529,"prepare.run_wall_time_us":38,"raft.queue_time_us":2519,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":19974,"spinlock_wait_cycles":47521664,"thread_start_us":332218,"threads_started":1,"wal-append.queue_time_us":1087598}
I20260709 13:06:53.003298 18606 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:53.092135 18276 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.802s	user 0.002s	sys 0.009s
I20260709 13:06:53.080075 18653 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:53.039572 18569 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.105324 18592 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:53.186125 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 58658.9us
I20260709 13:06:53.107689 17119 rpcz_store.cc:276] 0709 13:06:51.878153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.882946 (+  4793us) service_pool.cc:224] Handling call
0709 13:06:51.883269 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:51.883520 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:52.223088 (+339568us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.009972 (+786884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.024794 (+ 14822us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:53.040135 (+ 15341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.045313 (+  5178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.055215 (+  9902us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":580562,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":4872,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11709,"spinlock_wait_cycles":24278528,"thread_start_us":1051478,"threads_started":2,"wal-append.queue_time_us":774303}
I20260709 13:06:53.159662 18383 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:53.091683 18633 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.092985 16543 rpcz_store.cc:276] 0709 13:06:50.956484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.206605 (+250121us) service_pool.cc:224] Handling call
0709 13:06:51.206957 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.739809 (+532852us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:51.739851 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.767393 (+ 27542us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.110390 (+342997us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:52.110426 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.110485 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.074691 (+964206us) raft_consensus.cc:1685] finished
0709 13:06:53.074711 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.074825 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2604,"raft.queue_time_us":292048,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"thread_start_us":875004,"threads_started":2,"wal-append.queue_time_us":1305788}
I20260709 13:06:53.181290 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.215842 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.223093 18603 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.186582 18653 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.225687 18653 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.151777 18626 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.226138 18219 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.226724 18219 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:53.228003 18626 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.227759 18219 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:53.231189 18590 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.936s	user 0.008s	sys 0.000s
W20260709 13:06:53.230183 18597 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.944s	user 0.007s	sys 0.002s
I20260709 13:06:53.231503 18219 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.235214 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.238853 16543 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:06:53.231642 18059 consensus_meta.cc:287] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.985s	user 0.006s	sys 0.004s
W20260709 13:06:53.221827 18506 consensus_meta.cc:287] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.918s	user 0.007s	sys 0.004s
I20260709 13:06:52.933228 18562 rpcz_store.cc:276] 0709 13:06:41.380031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.382777 (+  2746us) service_pool.cc:224] Handling call
0709 13:06:41.640344 (+257567us) log.cc:844] Serialized 506 byte log entry
0709 13:06:41.832798 (+192454us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b5400105520. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa3747db26 00007ffa3747749a 00007ffa37476714 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354
0709 13:06:41.887692 (+ 54894us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5400105520. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37476142 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199 00007ffa34410475
0709 13:06:42.893131 (+1005439us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5400105520. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37476142 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199 00007ffa34410475
0709 13:06:52.650959 (+9757828us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20211,"raft.run_cpu_time_us":7355,"raft.run_wall_time_us":1622965,"spinlock_wait_cycles":26350080,"thread_start_us":12289,"threads_started":1,"wal-append.queue_time_us":1793,"wal-append.run_cpu_time_us":1688,"wal-append.run_wall_time_us":1008599}
I20260709 13:06:53.183594 18276 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.202734 18646 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.250171 18626 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:53.254729 18626 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:53.244539 17126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.018s
I20260709 13:06:53.185362 18655 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:06:53.235889 18544 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.000s
I20260709 13:06:53.217732 18645 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:06:53.255703 17123 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
W20260709 13:06:53.256016 17126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.011s	sys 0.018s
I20260709 13:06:53.250217 18644 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.265440 17123 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:06:53.220642 18567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.011s	sys 0.016s
I20260709 13:06:53.220727 18383 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.255016 18646 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.250283 18407 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.255774 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.260092 18582 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.240665 18597 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.220144 18370 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:53.285655 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 409198us
I20260709 13:06:53.291980 17093 leader_election.cc:400] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7.
I20260709 13:06:53.292382 17093 leader_election.cc:403] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.295830 18582 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7.
I20260709 13:06:53.298560 16434 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.302371 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.305958 18582 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:53.306586 18582 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:53.306923 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1313) took 1132 ms. Trace:
I20260709 13:06:53.307529 16536 rpcz_store.cc:276] 0709 13:06:52.174195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.476269 (+302074us) service_pool.cc:224] Handling call
0709 13:06:52.526325 (+ 50056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.527107 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.306634 (+779527us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54000ac3d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:53.306835 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114468736}
I20260709 13:06:53.307672 18582 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.249517 18059 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.309763 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.274164 18655 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:53.314953 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.269506 18522 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:53.280004 18553 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.267309 18544 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.281208 18645 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.316921 18407 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.278440 18644 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.340574 18564 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:53.344223 18652 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:06:53.335881 18599 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.261s	user 0.007s	sys 0.005s
I20260709 13:06:53.344923 18291 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.346386 18606 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.347841 18597 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.354300 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1751) took 1073 ms. Trace:
I20260709 13:06:53.354465 18059 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.331108 18645 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.365307 16539 rpcz_store.cc:276] 0709 13:06:52.281134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.481850 (+200716us) service_pool.cc:224] Handling call
0709 13:06:52.482144 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.011482 (+529338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.011526 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.011584 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:53.011632 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.353989 (+342357us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54001e2b54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:53.354052 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.354215 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216773504}
I20260709 13:06:53.367347 16539 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.369617 16539 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:53.329929 18522 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.327138 18655 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:53.363163 18291 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:53.383685 16539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:53.384442 16539 raft_consensus.cc:606] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.384938 16539 raft_consensus.cc:614] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.363703 18599 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.387684 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.393996 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:53.402697 18483 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:53.403860 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.407552 18626 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.409278 18553 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:53.412576 18505 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.219s	user 0.006s	sys 0.006s
I20260709 13:06:53.413134 18505 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.415064 18383 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.415205 18522 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:53.390847 18633 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.416985 18276 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.419044 18291 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:53.422399 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.20031e+06us
I20260709 13:06:53.415964 18645 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.425585 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.463111 18074 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.490418 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:53.419044 18599 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:53.390169 18219 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:06:53.497283 18291 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.512483 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.513165 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.497545 18407 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:53.518332 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.027s
I20260709 13:06:53.502617 18371 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:53.537361 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.017s	sys 0.027s
I20260709 13:06:53.538216 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.539386 18599 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:53.539796 18555 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:53.540575 18599 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:53.540601 18555 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:53.539731 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.541379 18599 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.542537 18599 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.543427 18555 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.544269 18599 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.546020 16583 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.547060 18555 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.549312 16613 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:53.549686 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.550612 16465 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:53.555233 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.556159 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.557621 16619 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:53.506343 18645 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.549711 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.575785 16617 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:53.578791 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:53.585532 16618 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:53.502948 18633 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:06:53.587803 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:53.588955 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.595316 16611 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:53.589586 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.596194 16619 raft_consensus.cc:2368] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:53.590586 16616 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:53.590749 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.601866 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:53.603211 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 53573.6us
I20260709 13:06:53.599782 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.606913 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:53.574195 18219 consensus_queue.cc:1243] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:06:53.607788 16466 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:53.554388 18544 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.536568 18371 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:53.515606 18603 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:06:53.628427 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.629724 16611 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:53.616971 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.633360 17124 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:53.585227 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 452) took 1379 ms. Trace:
I20260709 13:06:53.636363 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.599200 18383 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.637671 16611 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:06:53.635957 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.641201 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.639621 16469 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:53.641819 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.644279 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 454) took 1423 ms. Trace:
I20260709 13:06:53.640153 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.628382 18371 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.619746 18458 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:53.653887 18458 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.654772 18458 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.656167 18458 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.644668 17124 rpcz_store.cc:276] 0709 13:06:52.215875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.228477 (+ 12602us) service_pool.cc:224] Handling call
0709 13:06:53.616813 (+1388336us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:53.638800 (+ 21987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13915904}
I20260709 13:06:53.651347 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.610658 18483 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.657243 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.608440 18663 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:53.634384 18657 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.638748 18407 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.670514 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.649268 18490 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.675416 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.678951 16616 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:53.679512 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:06:53.682049 16610 raft_consensus.cc:606] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:06:53.682524 16610 raft_consensus.cc:614] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.663940 18582 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:53.690534 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 174118us
I20260709 13:06:53.670437 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:53.674237 18663 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:53.685338 18490 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.709967 18595 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:53.710937 18595 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.705008 18074 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.643996 18383 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:53.714843 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.718555 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.721915 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:53.723214 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 160404us
I20260709 13:06:53.723696 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.726430 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1314) took 1552 ms. Trace:
I20260709 13:06:53.727001 16544 rpcz_store.cc:276] 0709 13:06:52.174494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.725402 (+1550908us) service_pool.cc:224] Handling call
0709 13:06:53.725788 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.726001 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.726049 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.726102 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:53.726158 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.726221 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.726355 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:53.728715 17127 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 2: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:53.729400 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 457) took 1241 ms. Trace:
I20260709 13:06:53.729799 17127 rpcz_store.cc:276] 0709 13:06:52.487618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.490623 (+  3005us) service_pool.cc:224] Handling call
0709 13:06:53.718389 (+1227766us) spinlock_profiling.cc:243] Waited 927 us on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:53.729321 (+ 10932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2132864}
I20260709 13:06:53.689659 18655 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:53.676982 18407 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.637018 17121 rpcz_store.cc:276] 0709 13:06:52.198948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.206942 (+  7994us) service_pool.cc:224] Handling call
0709 13:06:53.405984 (+1199042us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:06:53.472869 (+ 66885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.501699 (+ 28830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.503398 (+  1699us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.506641 (+  3243us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:53.508681 (+  2040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.517600 (+  8919us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.577719 (+ 60119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23559552}
I20260709 13:06:53.732908 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 401) took 1305 ms. Trace:
I20260709 13:06:53.737507 17126 rpcz_store.cc:276] 0709 13:06:52.427081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.427284 (+   203us) service_pool.cc:224] Handling call
0709 13:06:52.427648 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:52.427888 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:52.715080 (+287192us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.550038 (+834958us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.732425 (+182387us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.732490 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:53.732559 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.732646 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.732834 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":386203,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":3714,"raft.queue_time_us":1002,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":1015500,"threads_started":3,"wal-append.queue_time_us":624274}
W20260709 13:06:53.745797 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.732604 18565 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.715713 18582 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.741153 18603 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:53.780905 18383 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.781114 18595 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.773504 18655 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:53.782011 18674 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:53.782063 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:06:53.782894 16544 raft_consensus.cc:606] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.783272 16544 raft_consensus.cc:614] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:53.783587 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 273) took 1471 ms. Trace:
I20260709 13:06:53.783998 16543 rpcz_store.cc:276] 0709 13:06:52.311869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.245270 (+933401us) service_pool.cc:224] Handling call
0709 13:06:53.247773 (+  2503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.258245 (+ 10472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.258292 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.259135 (+   843us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.552669 (+293534us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.552820 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.553093 (+   273us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.783357 (+230264us) raft_consensus.cc:1685] finished
0709 13:06:53.783379 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.783530 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":12158,"thread_start_us":278984,"threads_started":1,"wal-append.queue_time_us":402504}
I20260709 13:06:53.785349 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1319) took 1261 ms. Trace:
I20260709 13:06:53.785763 16541 rpcz_store.cc:276] 0709 13:06:52.524069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.322491 (+798422us) service_pool.cc:224] Handling call
0709 13:06:53.322775 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.322966 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:53.641107 (+318141us) log.cc:844] Serialized 14 byte log entry
0709 13:06:53.785004 (+143897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.785070 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:53.785124 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.785193 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.785302 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":427610,"raft.queue_time_us":6919,"thread_start_us":442257,"threads_started":2}
I20260709 13:06:53.793308 18583 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:53.795800 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:53.800596 18582 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:53.796811 18663 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.803869 18407 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.782203 18603 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:53.812000 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 125374us
I20260709 13:06:53.782063 18655 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.824432 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.825120 16616 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:53.826426 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:53.828121 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 104528us
I20260709 13:06:53.810683 18603 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.824467 18583 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:53.831979 16416 auto_rebalancer.cc:629] Failed to schedule move for tablet c8566128e1c24c7fa1f9894bd8ffdec7: Illegal state: Replica 6f34f184d0dd4382bee8790b4c077d05 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:53.852191 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:53.853125 16616 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:53.855556 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.857892 17122 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:06:53.858322 17122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 453) took 1645 ms (client timeout 1601 ms). Trace:
W20260709 13:06:53.858983 18682 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:53.860256 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1323) took 1334 ms. Trace:
I20260709 13:06:53.860618 16540 rpcz_store.cc:276] 0709 13:06:52.525376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.325147 (+799771us) service_pool.cc:224] Handling call
0709 13:06:53.325444 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.331749 (+  6305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.331782 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.335383 (+  3601us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.633537 (+298154us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:53.633580 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.633666 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.860048 (+226382us) raft_consensus.cc:1685] finished
0709 13:06:53.860069 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.860201 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5914,"raft.queue_time_us":6055,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4124,"thread_start_us":257436,"threads_started":1,"wal-append.queue_time_us":392867}
W20260709 13:06:53.861665 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.862412 16542 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:53.863282 18655 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:53.866477 16541 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:53.838321 18490 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:53.851895 18219 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.872908 18276 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:53.868759 16613 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
W20260709 13:06:53.858753 17122 rpcz_store.cc:269] 0709 13:06:52.212858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.216051 (+  3193us) service_pool.cc:224] Handling call
0709 13:06:53.851713 (+1635662us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:53.858238 (+  6525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14656128}
I20260709 13:06:53.871340 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.878978 16542 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:53.910326 16542 pending_rounds.cc:85] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 1
I20260709 13:06:53.910630 16542 pending_rounds.cc:107] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:53.910691 16611 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:53.910882 16542 raft_consensus.cc:2889] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.911036 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:53.886540 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.914204 16544 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:53.915144 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:53.915802 16544 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:53.887977 16538 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:53.888761 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:53.917075 16539 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.918365 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.918742 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:53.918979 16538 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:53.919401 17127 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:53.919757 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:53.920275 16538 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:53.921092 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:53.921604 17126 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:53.922736 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.894145 18655 raft_consensus.cc:1064] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:06:53.929363 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.930047 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:53.908836 18219 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:53.909190 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:53.933424 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1752) took 1623 ms. Trace:
I20260709 13:06:53.933816 16619 raft_consensus.cc:2376] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 2. Re-sending same reply.
I20260709 13:06:53.933823 16542 rpcz_store.cc:276] 0709 13:06:52.309968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.520138 (+210170us) service_pool.cc:224] Handling call
0709 13:06:52.520499 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.861907 (+1341408us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540023fb20. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37472a1d 00007ffa374591a4 00007ffa374db447 00007ffa374f3fe7 00007ffa374f57de 00007ffa374ffb49 00007ffa37500416 00007ffa374fcd8f 00007ffa374fc83e 00007ffa3c4c1419
0709 13:06:53.933188 (+ 71281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.933369 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630379392}
I20260709 13:06:53.920742 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:53.933211 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 107237us
I20260709 13:06:53.925168 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:53.899261 18640 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.151s	user 0.003s	sys 0.006s
W20260709 13:06:53.906168 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.847807 18693 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:06:53.907598 18276 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:53.922747 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:53.885053 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.930747 17126 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:53.849260 18583 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:53.922834 18407 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:53.931099 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:53.922869 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.932893 18696 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:53.959836 16539 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:53.935487 18059 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:53.960301 18697 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:53.969388 18647 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:53.983032 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.983352 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 261) took 1904 ms. Trace:
I20260709 13:06:53.983964 16545 rpcz_store.cc:276] 0709 13:06:52.079411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.086637 (+  7226us) service_pool.cc:224] Handling call
0709 13:06:52.086989 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:52.087358 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:52.087396 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:52.087906 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.252961 (+165055us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.253278 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.253376 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:53.898436 (+1645060us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:53.982982 (+ 84546us) raft_consensus.cc:1685] finished
0709 13:06:53.983011 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:53.983271 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1432,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":110,"spinlock_wait_cycles":17608960,"thread_start_us":163810,"threads_started":1,"wal-append.queue_time_us":520500}
I20260709 13:06:53.971429 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:53.985816 16544 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:53.976317 18490 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.977952 18693 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:53.989831 16538 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:06:53.981678 18696 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:53.982591 18647 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:53.998472 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 75823.3us
I20260709 13:06:53.972173 18059 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:06:53.994905 18690 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
W20260709 13:06:54.003973 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78868us
I20260709 13:06:53.999293 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.991379 18693 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:54.005125 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:53.996042 18696 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.011891 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.011602 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:54.005872 17122 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:53.992944 18490 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.015530 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:53.982673 18276 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.006373 18603 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.028513 18219 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.029075 18704 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:54.029599 18704 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.030331 18490 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.030874 18490 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.031288 18490 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.031683 18704 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.032220 18704 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.013880 18697 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.033183 18695 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:54.024420 18383 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.033819 18695 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.034194 18383 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.036185 18695 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.037526 18693 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.038921 18693 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:54.041661 18459 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.032550 18704 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.042279 18704 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.045409 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:06:54.047171 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.021652 18597 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:54.064021 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:54.013916 18696 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.020609 18686 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:54.061827 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1321) took 1537 ms. Trace:
I20260709 13:06:54.068810 16536 rpcz_store.cc:276] 0709 13:06:52.524755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.323113 (+798358us) service_pool.cc:224] Handling call
0709 13:06:53.323414 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:53.323754 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.323783 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:53.324214 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:06:53.628872 (+304658us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18000f07c0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:06:53.785441 (+156569us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:53.785500 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.785599 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.051493 (+265894us) raft_consensus.cc:1685] finished
0709 13:06:54.051522 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.061735 (+ 10213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1005,"raft.queue_time_us":88,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3677,"spinlock_wait_cycles":5704448,"thread_start_us":156319,"threads_started":1,"wal-append.queue_time_us":492682}
W20260709 13:06:54.049878 18699 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:54.065685 18219 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.062563 18697 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:54.090488 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.099331 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.092168 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.092736 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.093394 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.093552 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.093909 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.094709 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.095999 16616 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.096503 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.058988 18490 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.078423 18371 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.067476 18703 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.078884 18383 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.059237 18647 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.073834 18597 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.162966 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1467) took 1150 ms. Trace:
W20260709 13:06:54.187462 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 75398.2us
W20260709 13:06:54.204406 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.101307 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:54.192822 16468 rpcz_store.cc:276] 0709 13:06:53.012530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.058864 (+ 46334us) service_pool.cc:224] Handling call
0709 13:06:53.059190 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.061022 (+  1832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.061061 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.061111 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:53.061152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.162740 (+1101588us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b54002a80d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:54.162785 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.162909 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3705216}
I20260709 13:06:54.206463 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.180723 16536 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:54.207074 16466 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:54.109247 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.101127 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.100131 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.209856 16469 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:54.208202 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:54.213107 16461 raft_consensus.cc:2410] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:54.192860 16619 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
W20260709 13:06:54.213876 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 113822us
I20260709 13:06:54.217720 16616 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:54.208261 16611 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:54.221714 16467 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:54.223186 16466 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:54.224457 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.110637 18708 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.098413 18686 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.162887 18697 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:54.187592 18645 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.610s	user 0.009s	sys 0.004s
I20260709 13:06:54.231985 16464 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:54.109417 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.187814 18565 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.121630 18603 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.126214 18583 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.171770 18570 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.144469 18459 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:54.123565 18705 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.228349 18383 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.107949 18219 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.257015 17122 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:54.265494 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.257200 18570 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:54.266615 18570 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.267874 18570 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.265779 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.228396 18553 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:06:54.251120 18686 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:54.253384 18701 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.228308 18703 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.278949 16618 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:54.252697 18697 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.156658 18655 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:54.284607 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.257727 18059 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:54.289548 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.261937 18383 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:54.300216 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 72258.8us
I20260709 13:06:54.251785 18708 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.255434 18603 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.308216 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.272459 18583 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:54.263790 18459 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.313197 17124 raft_consensus.cc:2393] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:54.306216 18383 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.272233 18705 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.335291 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.299624 18697 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:54.341787 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 127201us
I20260709 13:06:54.344554 16465 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:54.310233 18642 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.362628 18642 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.312466 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:54.352026 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:54.355173 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46886.2us
I20260709 13:06:54.367161 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:54.360306 18703 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.336591 18654 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:54.369184 16582 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:54.381933 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:54.385321 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:54.385386 18703 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:54.373349 18458 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.397977 18458 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.403900 18605 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.405325 18605 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.409482 18219 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.417541 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.418823 18603 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.366912 18597 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.354290 18686 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.423382 18708 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.424432 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.427067 18705 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.428272 18642 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.430023 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.430620 17126 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:54.430738 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.434394 16615 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:54.441474 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.449652 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.449862 18705 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:54.450702 17121 raft_consensus.cc:2410] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:54.450618 18705 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.385291 18599 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.385803 18371 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.466701 18705 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.467774 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:54.468322 18567 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:54.468931 18567 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:54.471181 18567 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.471535 18289 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.471650 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:54.472324 16539 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.473721 18644 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.474898 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.475324 18701 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.475737 18701 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:54.476698 18705 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.476115 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.433638 18704 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.478039 18708 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.478739 18696 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.479332 18704 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.479617 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.480010 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:54.480623 16542 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:54.480824 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.481586 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:54.482030 18407 consensus_meta.cc:287] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.001s
I20260709 13:06:54.482542 18407 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:54.482604 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:54.481879 18708 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:54.483336 16542 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:54.483222 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.484133 18708 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.478034 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:54.485955 16544 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:54.488603 16470 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:54.488519 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.477939 18459 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.483227 18407 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.462191 18597 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:54.491076 18407 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.491590 18407 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.491516 18597 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.493010 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.493770 18597 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.494398 16541 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.494638 18696 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.492305 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:54.463335 18205 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:54.496439 16545 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:54.500353 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:54.501185 16618 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.484120 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:54.503084 16542 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:54.507076 16539 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:54.516932 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:54.517513 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:54.486816 18663 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.014s	sys 0.018s
I20260709 13:06:54.493799 17121 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:54.484643 18708 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:54.521152 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 145776us
I20260709 13:06:54.522003 16618 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:54.525068 17093 leader_election.cc:400] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
I20260709 13:06:54.526949 17093 leader_election.cc:403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.528481 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:54.530166 16613 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.533015 17127 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:54.519636 18663 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.014s	sys 0.018s
I20260709 13:06:54.536293 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.536931 18705 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:54.538281 18705 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:54.538522 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:54.539156 18603 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:54.539629 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.540390 18712 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.540676 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.540943 18707 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.541193 18712 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.541996 18709 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:54.542503 18709 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.542568 18712 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.543403 18709 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.519146 18716 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.547545 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:54.519414 18717 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.538653 18705 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.492367 18383 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.524320 18664 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.531760 18696 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.532140 18205 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5.
W20260709 13:06:54.549774 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 167930us
I20260709 13:06:54.557461 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:54.558295 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:54.560667 16613 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:54.601734 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.602566 16466 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:54.553335 18705 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:54.618069 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.619494 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.621307 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.554770 18717 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.624161 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:54.624912 18708 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.554435 18696 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.589360 18582 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.624287 18717 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.629873 16436 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.630887 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.632644 18599 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.632896 16461 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:54.633205 18599 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:54.620757 18459 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.634143 18459 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:54.634593 18459 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.626101 18704 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.635496 18704 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.637609 18704 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.621310 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.596926 18714 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:06:54.639920 18643 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 1.742s	user 0.005s	sys 0.000s
I20260709 13:06:54.618476 18646 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:54.642647 18646 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.643011 18646 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.558828 18664 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:54.644711 18638 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.897s	user 0.008s	sys 0.000s
I20260709 13:06:54.644837 18722 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:54.645448 18722 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:54.646229 18383 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.646411 18722 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.647140 18276 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.648135 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.648680 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1505) took 2912 ms. Trace:
I20260709 13:06:54.633884 18289 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:54.650461 16618 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.633692 18599 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.596199 18715 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:54.649097 16462 rpcz_store.cc:276] 0709 13:06:51.736722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.925038 (+188316us) service_pool.cc:224] Handling call
0709 13:06:51.925340 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.957166 (+ 31826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.957205 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.957691 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.119313 (+161622us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:52.189821 (+ 70508us) log.cc:844] Serialized 14 byte log entry
0709 13:06:52.190050 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:53.101597 (+911547us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b18000c6280. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:53.900377 (+798780us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18000c6280. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419
0709 13:06:53.902775 (+  2398us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b54002a85d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:53.902822 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:54.644186 (+741364us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:54.648480 (+  4294us) raft_consensus.cc:1685] finished
0709 13:06:54.648504 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.648622 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70231,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":6178,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":43332,"spinlock_wait_cycles":105667584,"thread_start_us":161268,"threads_started":1,"wal-append.queue_time_us":580687}
I20260709 13:06:54.620568 18707 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.654214 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:54.654978 18371 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.655637 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.620174 18720 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.657264 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.558432 18723 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:06:54.640231 18697 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.652484 18663 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.658278 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.632190 18696 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:54.664145 16610 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:54.664670 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.663369 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.659195 16616 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 3: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:54.678629 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:54.679536 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.681634 16615 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:54.675290 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.677739 16614 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:54.662365 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.684193 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.684412 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.684846 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:54.663857 18371 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:54.680855 16537 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:06:54.686237 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.687124 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.677727 18663 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:54.688951 18695 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:54.689509 18695 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.690522 18695 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.681159 18543 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.687074 18374 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.693253 18374 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.693001 18543 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.693686 18374 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.671547 18720 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.697350 18720 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.687903 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.657742 18715 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.552174 18716 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:54.828090 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.735296 17124 raft_consensus.cc:2368] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:54.763335 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.688073 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.702385 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.807624 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.832142 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.734642 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.702786 16618 raft_consensus.cc:2393] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:54.833485 16610 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:54.702574 16583 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:54.835547 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 133027us
I20260709 13:06:54.831804 16614 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:06:54.837329 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 134989us
I20260709 13:06:54.843513 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.701575 16537 pending_rounds.cc:85] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 2
I20260709 13:06:54.836230 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:54.686493 18664 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.851522 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:54.688663 18663 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.852408 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.863782 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.763064 16612 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:54.851197 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.854655 16537 pending_rounds.cc:107] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:06:54.702003 18371 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.858325 16618 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.754629 18729 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.853840 18704 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:54.855926 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:54.847473 18644 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:54.870280 18059 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.856855 18458 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:54.820642 18599 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.815950 18646 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.731066 18374 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.880645 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.882165 16614 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:54.885028 18704 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.885237 18654 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:54.886008 18704 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.886909 18599 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.878969 18059 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:54.889568 18059 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:54.825548 18707 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:54.893241 18459 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:54.874035 16537 raft_consensus.cc:2889] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.901386 18715 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:54.904711 16613 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:54.903928 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:54.870472 18712 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:54.911134 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:54.911357 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:54.881843 18729 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:54.913041 16618 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:54.915225 18644 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:54.913261 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:54.899029 18407 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:55.088616 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 232744us
W20260709 13:06:55.087489 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:55.117571 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.061033 16462 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.063499 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:55.119791 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:55.121335 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:54.913686 18059 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:55.086169 18736 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:06:55.125394 16467 raft_consensus.cc:2368] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6.
I20260709 13:06:55.129163 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1466) took 2124 ms. Trace:
I20260709 13:06:55.130059 16463 rpcz_store.cc:276] 0709 13:06:53.005214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.054372 (+ 49158us) service_pool.cc:224] Handling call
0709 13:06:53.054685 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:53.241370 (+186685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:53.241399 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:53.241442 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:53.241476 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.128972 (+1887496us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54001077d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:55.129004 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.129090 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428896128}
I20260709 13:06:55.131865 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:54.918414 18459 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:54.920224 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1318) took 2741 ms. Trace:
I20260709 13:06:55.077943 18289 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.120462 18724 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:54.914893 18712 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:55.151276 18697 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.153229 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:55.156322 18276 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260709 13:06:55.189325 16469 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:55.132655 16463 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:55.120692 18598 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:55.188483 18734 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:06:55.127624 18059 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.935155 18705 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:55.133044 18644 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.275416 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:55.273500 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:55.512722 18737 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.520593 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:55.520215 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.350497 18716 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.133929 18729 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:55.450042 18746 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:55.527501 16467 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.163341 18695 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.548708 16618 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:55.471872 18696 consensus_meta.cc:287] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.786s	user 0.010s	sys 0.000s
W20260709 13:06:55.450567 18371 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.003s
I20260709 13:06:55.163105 17121 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:55.563549 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:55.349666 18374 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.452139 18407 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:55.459780 18663 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.000s
I20260709 13:06:55.525238 18059 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.467247 18722 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.585062 18722 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.587040 18722 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.574532 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:55.588346 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:55.588742 16467 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:55.590034 18712 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.523854 18646 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.580837 18663 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.577526 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:06:55.438652 18740 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.180s	user 0.003s	sys 0.000s
I20260709 13:06:55.583007 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 497) took 1294 ms. Trace:
W20260709 13:06:55.582012 18742 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:55.160962 16537 rpcz_store.cc:276] 0709 13:06:52.175580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.676361 (+2500781us) service_pool.cc:224] Handling call
0709 13:06:54.680442 (+  4081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.913224 (+232782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.917402 (+  4178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:55.626207 17127 rpcz_store.cc:276] 0709 13:06:54.288428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.288545 (+   117us) service_pool.cc:224] Handling call
0709 13:06:54.288844 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.535102 (+246258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.582773 (+1047671us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400578ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:55.582947 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556689152}
I20260709 13:06:55.591234 16461 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:55.590054 16467 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:55.539031 18737 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:55.631671 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.633008 16467 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:55.634262 16461 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:55.634546 16467 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:55.634845 16461 pending_rounds.cc:85] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 2
I20260709 13:06:55.635258 16461 pending_rounds.cc:107] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:55.635603 16461 raft_consensus.cc:2889] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.635813 16467 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.234687 18289 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:55.639626 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.641520 16618 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:55.643877 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.573776 18696 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:55.190500 18724 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.648586 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:55.629769 17122 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.271643 18598 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.650848 16585 leader_election.cc:400] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6.
I20260709 13:06:55.665046 16585 leader_election.cc:403] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:55.651679 16618 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:55.574870 18695 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.644016 18059 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:55.644809 18710 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.742698 16616 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:06:55.744194 16616 pending_rounds.cc:85] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 2
I20260709 13:06:55.744587 16616 pending_rounds.cc:107] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:55.744943 16616 raft_consensus.cc:2889] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:55.751034 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 101162us
I20260709 13:06:55.576912 18371 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:55.752315 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:55.758523 16463 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:55.742251 18658 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6.
I20260709 13:06:55.742550 18642 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.742015 18723 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:55.758026 18633 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.755125 18710 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.761060 18641 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.770256 18641 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.770664 18641 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.771206 18658 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:55.771579 18710 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.771468 18059 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.772542 18705 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.773783 18695 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.774647 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 463) took 1389 ms. Trace:
I20260709 13:06:55.775030 17124 rpcz_store.cc:276] 0709 13:06:54.384867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.385050 (+   183us) service_pool.cc:224] Handling call
0709 13:06:55.774461 (+1389411us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400120054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:55.774590 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725766528}
I20260709 13:06:55.775451 18724 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.776455 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.776650 18696 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.777061 17127 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:55.777323 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1527) took 1442 ms. Trace:
I20260709 13:06:55.777643 16469 rpcz_store.cc:276] 0709 13:06:54.334886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.335033 (+   147us) service_pool.cc:224] Handling call
0709 13:06:55.777182 (+1442149us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400378a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:55.777272 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947728768}
I20260709 13:06:55.779044 18289 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.779464 18371 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.782539 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.782934 17121 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.764240 18633 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.787204 18646 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:55.788973 18633 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.789635 18737 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:55.790576 18291 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:55.791052 18291 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.791275 18663 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.791584 17122 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:55.792846 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.793097 18291 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:55.764663 18642 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.793593 18291 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:55.794010 18291 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.795370 18291 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:55.796625 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.799389 18663 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.801380 18663 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:55.803347 18663 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.803668 18658 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:55.772562 18598 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.806037 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.806423 16469 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:55.806671 16616 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.807947 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.764869 18723 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.796393 18642 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:55.816251 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:55.816560 16434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.735s (SENT) [suppressed 10 similar messages]
I20260709 13:06:55.856093 17126 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:55.853645 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.858472 17124 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:55.819675 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:55.861159 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:55.843552 17127 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:55.859680 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.857126 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:55.861403 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.862296 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:55.851037 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:55.838996 18703 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.864642 16617 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:55.864957 16467 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:55.867669 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1326) took 1399 ms. Trace:
I20260709 13:06:55.867498 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:55.867146 16618 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:55.867506 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:55.874536 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:55.878290 16467 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:06:55.876070 16616 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
W20260709 13:06:55.880134 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.880859 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:55.870000 16538 rpcz_store.cc:276] 0709 13:06:54.468370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.476854 (+  8484us) service_pool.cc:224] Handling call
0709 13:06:54.477105 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.477289 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:54.558010 (+ 80721us) log.cc:844] Serialized 14 byte log entry
0709 13:06:54.657337 (+ 99327us) log.cc:844] Serialized 14 byte log entry
0709 13:06:55.867181 (+1209844us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b1800066760. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:06:55.867334 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:55.867380 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:55.867427 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.867493 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:55.867616 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1201767,"prepare.queue_time_us":223448,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":6351,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":5398,"spinlock_wait_cycles":21627648,"thread_start_us":178181,"threads_started":2,"wal-append.queue_time_us":135871,"wal-append.run_cpu_time_us":1409,"wal-append.run_wall_time_us":1001422}
I20260709 13:06:55.884125 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:55.886197 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:55.821404 18598 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:06:55.822861 18723 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:55.853857 18641 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.894068 18598 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:55.888589 18737 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:55.879807 18720 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.882071 18664 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.888582 18291 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.884028 18754 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:55.905328 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0595225839999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
I20260709 13:06:55.879787 18703 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.957243 16616 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:06:55.959425 17093 connection.cc:256] RPC call timeout handler was delayed by -1.1429807409999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:06:55.959822 17093 connection.cc:256] RPC call timeout handler was delayed by -1.0502807409999377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2298s for a response
I20260709 13:06:55.960613 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:55.928457 16617 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.905556 18737 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:55.896010 18714 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.901932 18598 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:06:55.968854 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 152404us
I20260709 13:06:55.970685 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:55.971333 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:06:55.972014 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0109225839998999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:06:55.972311 16617 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.973404 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:55.974179 18646 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:55.974843 18646 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.975246 18646 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:55.969977 18291 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:55.978417 18291 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:55.979374 18291 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.974119 18657 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:55.985922 16434 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:55.963277 18706 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:55.994179 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:55.997448 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:55.992935 18595 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.969092 18737 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:55.921957 18562 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:56.008054 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.008821 16616 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:55.926255 18642 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:06:55.969677 18714 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:55.927250 18664 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.971707 18761 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.971921 18490 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:55.974851 18597 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:55.986732 18716 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.020964 16616 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.007164 18565 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.021073 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:56.020403 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47900.6us
I20260709 13:06:56.024319 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.026628 18721 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.028944 18701 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:55.962946 18720 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.035208 18761 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.043710 18761 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.043867 18720 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.031386 16540 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.044492 18732 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.032145 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.045593 16543 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:56.017352 18714 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.033491 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.033824 16541 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.050381 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.046643 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.063056 16543 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:56.047525 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.064098 16540 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:56.013258 16617 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:06:56.013653 18707 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.037770 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.038331 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.039860 16434 leader_election.cc:400] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:56.037771 18597 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.041280 18715 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.063759 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.022187 18705 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.065944 16434 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:56.070873 18701 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.027132 18567 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:56.087913 18597 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.018007 18595 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.045292 18703 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.045948 18696 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.038826 18565 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.045410 18761 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:56.060971 18723 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.069471 18525 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.061720 18720 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.016366 18706 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.005338 18657 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.045529 18716 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.113540 18760 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.036217 18490 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.081998 18705 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:56.149009 18705 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.045011 18732 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.101168 18644 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:56.113076 18758 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:56.125358 18525 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.134495 18720 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.136289 16618 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.046157 18721 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:56.183094 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63654us
I20260709 13:06:56.141542 18490 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.144330 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.191013 18721 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.191237 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.123725 18761 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.192135 16461 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.163277 18732 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.163841 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.193674 18761 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.193888 16537 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 2.
I20260709 13:06:56.195132 18595 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.195380 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.164960 18641 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.118098 18565 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.109436 18597 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.079834 18707 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.179731 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.097916 18715 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:56.181324 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.199674 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.184232 16538 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:06:56.125919 18723 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.206646 18737 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.169797 18657 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.105284 18567 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:56.208709 18648 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 2.114s	user 0.007s	sys 0.014s
I20260709 13:06:56.046875 18598 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.200985 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.202363 18525 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.167485 18760 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.199416 18595 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.215706 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 317) took 1590 ms. Trace:
W20260709 13:06:56.237823 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58203.3us
I20260709 13:06:56.253784 16613 rpcz_store.cc:276] 0709 13:06:54.625424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.627815 (+  2391us) service_pool.cc:224] Handling call
0709 13:06:54.637111 (+  9296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.905241 (+268130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.215346 (+1310105us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54003e6a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:56.215624 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614711680}
I20260709 13:06:56.254331 16461 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:56.254536 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.218555 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.255522 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.255621 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.255556 16469 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.257246 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.258579 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.258735 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.259133 16461 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:56.212355 18597 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.213928 16537 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:56.259865 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.260102 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:56.200762 18642 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.262629 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.263741 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.243871 18647 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.213676 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.264472 18706 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.257586 18525 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.268497 18761 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.265347 18595 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.270743 18595 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.271142 18595 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.273689 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.266352 18543 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.265892 16461 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:56.274308 16536 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:56.274969 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.275184 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.265990 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.268953 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.254012 18716 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.275784 16469 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:56.260360 18605 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.263159 18598 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.280058 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.279457 18605 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:56.269176 18642 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.279253 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.262992 18657 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.284588 16536 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:06:56.267412 18703 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:56.277573 18761 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.291038 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.289714 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.273830 18707 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.298146 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.289683 18605 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.280109 17119 raft_consensus.cc:2376] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6. Re-sending same reply.
I20260709 13:06:56.291493 18543 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.269061 18646 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.308259 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.309194 16461 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:56.306412 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.292466 18703 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.313050 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.297209 18525 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.302692 18737 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.301250 18570 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:06:56.310662 18732 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.293231 18705 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.310976 18703 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.331086 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.324133 18715 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:56.333446 18735 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.477s	user 0.010s	sys 0.012s
I20260709 13:06:56.321947 18761 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.339538 16464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 223) took 2749 ms (client timeout 2298 ms). Trace:
W20260709 13:06:56.339993 16464 rpcz_store.cc:269] 0709 13:06:53.590403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.590523 (+   120us) service_pool.cc:224] Handling call
0709 13:06:56.339366 (+2748843us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54003e4254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.339455 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459331328}
I20260709 13:06:56.341131 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:56.320516 17119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 461) took 2231 ms (client timeout 1735 ms). Trace:
W20260709 13:06:56.342033 17119 rpcz_store.cc:269] 0709 13:06:54.080510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.084744 (+  4234us) service_pool.cc:224] Handling call
0709 13:06:56.213501 (+2128757us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:06:56.310249 (+ 96748us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60895488}
I20260709 13:06:56.343245 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.343870 16461 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:56.345433 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1486) took 1200 ms. Trace:
I20260709 13:06:56.346076 18642 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.347218 16461 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.318003 18723 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.345826 16463 rpcz_store.cc:276] 0709 13:06:55.144551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.273015 (+128464us) service_pool.cc:224] Handling call
0709 13:06:56.345216 (+1072201us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.345374 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515315456}
I20260709 13:06:56.349431 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.349481 18595 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.350207 16463 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.349874 18605 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.299968 18565 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.352304 18565 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.353075 16467 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.353150 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.354564 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.355152 16467 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
W20260709 13:06:56.355686 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1515) took 2266 ms (client timeout 2467 ms). Trace:
I20260709 13:06:56.355997 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:06:56.356055 16470 rpcz_store.cc:269] 0709 13:06:54.089365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.091940 (+  2575us) service_pool.cc:224] Handling call
0709 13:06:56.355509 (+2263569us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001081d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.355634 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642099456}
I20260709 13:06:56.355300 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.322577 18721 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.351043 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.365152 16463 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:56.368096 16470 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:56.368343 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.369033 16463 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:56.369167 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.373788 16470 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.374454 18739 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:56.375912 16465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1520) took 2285 ms (client timeout 1839 ms). Trace:
W20260709 13:06:56.376500 16465 rpcz_store.cc:269] 0709 13:06:54.090813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.093709 (+  2896us) service_pool.cc:224] Handling call
0709 13:06:56.375733 (+2282024us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b5400357ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.375844 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311451520}
I20260709 13:06:56.381588 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.368065 18570 consensus_queue.cc:1243] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:56.382978 18732 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.383523 18720 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.384088 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:56.385310 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:56.386058 18570 raft_consensus.cc:2764] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:56.386672 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:56.386677 18570 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.387539 18667 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.387678 18570 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:56.388013 18667 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.388415 18667 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.388597 18570 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.404251 16463 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.397477 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:56.352340 18605 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.330827 18567 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.375088 18739 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.414187 18667 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.416638 18739 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.417587 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.412281 18761 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.418303 16461 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.423956 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:06:56.424899 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 161014us
I20260709 13:06:56.426908 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.427232 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.427794 16610 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:56.442615 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:56.443440 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.424899 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:56.489704 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:56.489013 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.419945 18720 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.464498 18761 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.428743 18605 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.501308 18605 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.501710 18605 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.494568 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.492002 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:56.506785 18693 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.507182 18693 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.507534 18693 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.488240 18714 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.498450 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.511096 18714 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.511958 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.491731 18641 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.512979 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:56.512755 18641 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.514417 18525 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:56.518663 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.515913 18658 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.430410 18667 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.489130 18647 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.441931 18663 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.500272 18761 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.499809 18701 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.504140 18720 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.529865 18658 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:56.502955 18645 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.514858 18525 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:56.514765 18641 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.515470 18705 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.491997 18567 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:56.514587 18693 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.549913 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.515607 18654 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.698518 18701 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.700678 18693 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.610044 16610 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.535816 18543 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.699913 18525 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:06:56.701294 16610 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:56.702378 18525 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.702281 18605 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.702509 16610 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.535383 18697 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:06:56.705164 18720 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.705094 16610 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.706343 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 187711us
I20260709 13:06:56.585511 16461 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:56.515770 18459 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:56.709627 18459 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:56.710547 18459 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.712296 18219 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.527813 18715 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:56.712656 18219 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:56.713033 18597 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.713521 18219 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.714586 16610 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:56.714998 18219 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.718108 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.718430 16619 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.718700 16545 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:06:56.548934 18647 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.719457 16610 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:56.719700 18760 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.720634 18647 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.720930 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.721609 16542 raft_consensus.cc:2368] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:56.722319 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.722832 16541 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.722342 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.723523 16463 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:06:56.725593 16614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1725) took 1835 ms (client timeout 1531 ms). Trace:
I20260709 13:06:56.720628 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:56.726006 16614 rpcz_store.cc:269] 0709 13:06:54.889908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.903201 (+ 13293us) service_pool.cc:224] Handling call
0709 13:06:56.725421 (+1822220us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003dbb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.725531 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406199040}
I20260709 13:06:56.726902 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.727447 16545 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:56.725354 18697 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:56.729775 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.730321 16542 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.730767 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1473) took 1780 ms. Trace:
I20260709 13:06:56.731123 16462 rpcz_store.cc:276] 0709 13:06:54.950287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.950446 (+   159us) service_pool.cc:224] Handling call
0709 13:06:54.950756 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.118816 (+168060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.730486 (+1611670us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400264154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:56.730714 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253081984}
I20260709 13:06:56.733800 16463 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:56.735149 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:56.735713 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.736111 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.736819 18629 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.737304 18629 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.739022 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.739416 18629 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.739998 18737 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:56.740067 18629 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.740679 18737 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:56.741231 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:56.550136 18761 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.741605 18737 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.740759 18629 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.542383 18714 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:06:56.744931 18629 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.631635 18663 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.746447 17122 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:56.748219 18663 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.748881 17122 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:56.751322 17122 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:56.757491 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.757726 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1476) took 1695 ms. Trace:
I20260709 13:06:56.758051 16466 rpcz_store.cc:276] 0709 13:06:55.062644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.080200 (+ 17556us) service_pool.cc:224] Handling call
0709 13:06:56.375842 (+1295642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:56.375989 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.376014 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.376038 (+    24us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:56.376057 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.376094 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.757577 (+381483us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400357ad0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:56.757673 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2978828032}
I20260709 13:06:56.759020 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.762178 16541 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:56.766337 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.592276 18644 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.698380 18658 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:56.657068 18775 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:06:56.795326 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.701028 18701 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.698766 18595 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.741362 17118 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:56.793239 18644 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:56.681497 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 169603us
I20260709 13:06:56.814738 18459 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:56.815280 18644 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.816152 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.772729 16542 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:56.738853 18543 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.816759 17122 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:56.773651 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.817164 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.817346 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.696367 18703 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.817888 16615 raft_consensus.cc:2368] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:56.818218 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.818783 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.800915 18737 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:56.796187 17124 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:56.819562 16614 raft_consensus.cc:2410] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:56.819933 18737 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.820024 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.820358 18737 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:56.803856 18658 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.820824 16619 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:56.821187 18737 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.805351 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.822417 18737 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.822837 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.823285 17119 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.823822 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.819367 18703 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:56.824858 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.806059 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.825646 16543 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:56.825718 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 136163us
I20260709 13:06:56.809900 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.826354 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.810750 16537 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:56.828356 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.829365 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.829953 16617 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:56.812175 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.831095 16545 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.812872 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.773454 18714 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:56.819356 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.832748 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.803000 18761 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:56.821627 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.804572 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.826601 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.766600 18605 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.832355 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.833724 16610 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:56.833540 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:56.834432 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.839028 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.839591 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.840031 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.834053 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.835064 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.840756 16611 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:56.840996 16540 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.841050 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.840824 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.842233 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.843061 16618 raft_consensus.cc:2410] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:56.842941 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.843345 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.844280 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.845916 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:56.846333 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.846910 16618 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.845772 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.848069 16541 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:56.848083 16617 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:56.770032 18641 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:06:56.850169 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:56.851558 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.851855 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.856272 16540 raft_consensus.cc:2410] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:56.857046 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.857363 16545 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:56.794373 18645 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:56.860152 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.860946 16614 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:56.862216 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.865298 17090 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.866334 16511 leader_election.cc:400] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:56.866636 16511 leader_election.cc:403] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:56.867296 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.867650 16509 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.857751 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:56.871778 16618 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:06:56.870092 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:56.873770 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.866503 18179 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.877061 18179 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.877398 18179 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:56.877444 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.878201 18655 raft_consensus.cc:2764] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:56.879390 18655 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:06:56.880322 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.880982 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.882180 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.882861 16537 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:56.883610 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.883715 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:56.884155 16537 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:56.884390 18655 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:56.884872 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.886085 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.886926 18641 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.888360 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.889178 18641 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.889760 18761 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.891207 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:56.893890 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.859848 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.894518 18722 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:56.894688 18658 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.862354 18629 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.871147 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.872802 17122 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:56.869814 18723 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:56.872929 18525 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5.
I20260709 13:06:56.884815 18655 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:56.874570 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.870368 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.888579 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.895977 18595 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.937333 18664 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:56.864953 18714 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.914108 18059 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.973827 18059 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:56.974174 18371 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:56.974483 18059 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.974764 18371 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:56.900318 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1475) took 1838 ms. Trace:
I20260709 13:06:56.959236 16614 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:56.869626 18583 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:56.898407 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:56.970194 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:56.936885 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 194557us
I20260709 13:06:56.977285 16545 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.970417 16544 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:56.896991 16543 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:56.900513 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 834531us
I20260709 13:06:56.907650 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:56.972137 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:56.920405 18761 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.938611 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.985090 16541 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:06:56.987980 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 80459.2us
I20260709 13:06:56.988830 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.987851 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.989162 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.990231 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:56.990564 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.991091 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.991420 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:56.982366 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.983942 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:56.993232 18459 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:56.993593 18459 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.993738 18567 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:56.993993 18459 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.994159 18567 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.994571 18567 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.997200 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.997924 16467 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:56.999003 16462 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:57.001358 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 130581us
I20260709 13:06:57.001443 18459 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.003746 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:57.005059 18788 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.005784 18788 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.006376 18788 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.004086 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:57.016185 16470 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:57.017755 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:56.983367 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.918856 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:56.933889 18658 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.036604 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56352.2us
W20260709 13:06:57.039937 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 58111.8us
I20260709 13:06:56.960090 18655 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.049341 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:57.050289 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.899560 18629 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:57.056248 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.056491 16611 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:57.058233 16540 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:57.059620 16540 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:56.971884 18595 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:57.016121 18657 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.016306 18605 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.043012 18179 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.075430 18179 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:56.975745 16468 rpcz_store.cc:276] 0709 13:06:55.062234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.063502 (+  1268us) service_pool.cc:224] Handling call
0709 13:06:55.063863 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.064129 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:55.995595 (+931466us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b180020ce00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa3aef53c7 00007ffa375079a7 00007ffa375170bf
0709 13:06:55.995734 (+   139us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.060588 (+ 64854us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.271640 (+211052us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b180020ce00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:56.899850 (+628210us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b180020ce00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:06:56.899976 (+   126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:56.900023 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:56.900088 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.900159 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.900265 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":803959,"prepare.queue_time_us":511209,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":10871,"raft.queue_time_us":841335,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":33511,"spinlock_wait_cycles":55206784,"thread_start_us":529315,"threads_started":2,"wal-append.queue_time_us":114571}
I20260709 13:06:57.044333 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:56.926298 18722 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:57.078112 18722 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.048290 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:57.062875 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 71859.6us
I20260709 13:06:57.063915 16540 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.082162 16545 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:57.082350 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:56.978006 18583 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:56.984480 18645 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.976274 16537 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:56.870107 18543 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
W20260709 13:06:57.059554 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 191118us
I20260709 13:06:56.951357 18720 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.086935 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:57.092891 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.087626 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:57.094185 17126 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:57.087934 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:57.047355 18641 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.089665 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:57.090912 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:57.049808 18646 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:57.062332 18644 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.093572 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:57.047281 18603 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:06:57.067036 18595 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.096661 16540 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.069182 18719 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:57.067803 18667 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.070210 18706 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.093554 17124 raft_consensus.cc:2376] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6. Re-sending same reply.
I20260709 13:06:57.088977 18583 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.068327 18714 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:06:57.086440 18695 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:57.063774 18658 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.069993 18711 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:57.093063 18761 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.068076 18705 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:06:57.156661 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.125142 16539 raft_consensus.cc:2368] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:57.164562 16542 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:57.158145 16368 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.178433 16540 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:57.174088 16364 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 256) took 8869 ms. Trace:
I20260709 13:06:57.180460 16540 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:06:57.181320 16540 pending_rounds.cc:85] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 2
I20260709 13:06:57.179447 16364 rpcz_store.cc:276] 0709 13:06:48.301089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.301324 (+   235us) service_pool.cc:224] Handling call
0709 13:06:57.156522 (+8855198us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.810957 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.811494 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.811549 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:50.811562 (+    13us) tablet.cc:662] Decoding operations
0709 13:06:50.823536 (+ 11974us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.823626 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.823661 (+    35us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:50.825397 (+  1736us) tablet.cc:701] Row locks acquired
0709 13:06:50.847163 (+ 21766us) write_op.cc:260] PREPARE: finished
0709 13:06:50.847337 (+   174us) write_op.cc:270] Start()
0709 13:06:50.847488 (+   151us) write_op.cc:276] Timestamp: P: 1783602410847276 usec, L: 0
0709 13:06:50.847524 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.848193 (+   669us) log.cc:844] Serialized 7497 byte log entry
0709 13:06:51.742572 (+894379us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b540013d920. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa3747b343 00007ffa3747ed75 00007ffa3747ed09 00007ffa3747ec99 00007ffa3747ec61 00007ffa3747df5d 000000000038f354 000000000038f199 00007ffa34410475 00007ffa344127c1
0709 13:06:51.805090 (+ 62518us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.011629 (+206539us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b1800237580. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:52.494325 (+482696us) write_op.cc:301] APPLY: starting
0709 13:06:52.518283 (+ 23958us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.921504 (+403221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.977620 (+ 56116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:53.341116 (+363496us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:53.341605 (+   489us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:06:53.341670 (+    65us) write_op.cc:312] APPLY: finished
0709 13:06:53.342256 (+   586us) log.cc:844] Serialized 132 byte log entry
0709 13:06:53.660724 (+318468us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:53.664323 (+  3599us) write_op.cc:454] Released schema lock
0709 13:06:53.684659 (+ 20336us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:53.753694 (+ 69035us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:53.755994 (+  2300us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201449,"reported_tablets":31,"spinlock_wait_cycles":15744,"child_traces":[["op",{"apply.queue_time_us":584815,"apply.run_cpu_time_us":36143,"apply.run_wall_time_us":1302383,"num_ops":19,"prepare.queue_time_us":210551,"prepare.run_cpu_time_us":13319,"prepare.run_wall_time_us":166042,"raft.queue_time_us":25179,"raft.run_cpu_time_us":43154,"raft.run_wall_time_us":1245458,"replication_time_us":938518,"spinlock_wait_cycles":28939904,"thread_start_us":917019,"threads_started":5,"wal-append.queue_time_us":477097,"wal-append.run_cpu_time_us":21741,"wal-append.run_wall_time_us":2068925}]]}
I20260709 13:06:57.097631 18641 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:57.109848 18697 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.188169 16536 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:57.110997 18459 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:57.190989 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 105899us
I20260709 13:06:57.193771 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:57.178103 16368 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 4, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:57.195428 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.112705 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:06:57.197474 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 112553us
I20260709 13:06:57.192639 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:57.204166 18567 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.196133 16368 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 5 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.205542 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.207382 16368 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.208994 16368 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 3, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:57.209982 16368 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 5 to 6, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.211333 16368 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:06:57.181967 16540 pending_rounds.cc:107] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.3
I20260709 13:06:57.133621 18707 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:06:57.134039 18719 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.091128 18629 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.200747 18641 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.201735 18525 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.212977 16540 raft_consensus.cc:2917] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Aborting config change with OpId 3.3: Aborted: Op aborted by new leader
I20260709 13:06:57.100164 18179 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:06:57.215868 16540 raft_consensus.cc:2889] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:57.173174 18715 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.220853 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:57.212414 16368 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.189431 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:57.219830 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:37064 (request call id 10) took 3358 ms. Trace:
I20260709 13:06:57.192238 18603 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.193590 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:57.228165 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:57.228785 16539 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:57.213879 18629 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.133920 18657 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:06:57.214982 18371 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:57.220978 18722 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.224001 16368 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 6, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.214473 18658 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:57.214424 18705 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.237969 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.152750 18706 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.225315 16540 rpcz_store.cc:276] 0709 13:06:53.861530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.864882 (+  3352us) service_pool.cc:224] Handling call
0709 13:06:53.874038 (+  9156us) log.cc:844] Serialized 506 byte log entry
0709 13:06:54.427643 (+553605us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b540003c120. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37476142 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199 00007ffa34410475
0709 13:06:54.900719 (+473076us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b540003c120. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37476142 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199 00007ffa34410475
0709 13:06:55.567376 (+666657us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800409420. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa3747db26 00007ffa3747749a 00007ffa37476714
0709 13:06:55.979210 (+411834us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b540003c120. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa3747db26 00007ffa3747749a 00007ffa37476714 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354
0709 13:06:57.219674 (+1240464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":837287,"raft.queue_time_us":7386,"raft.run_cpu_time_us":24361,"raft.run_wall_time_us":3446700,"spinlock_wait_cycles":28778112,"thread_start_us":132241,"threads_started":1,"wal-append.queue_time_us":184578,"wal-append.run_cpu_time_us":1735,"wal-append.run_wall_time_us":1002946}
I20260709 13:06:57.251940 16468 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.223130 18695 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:57.234781 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 139783us
I20260709 13:06:57.230770 16539 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:06:57.242169 16368 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 3, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.246860 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:57.246925 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.260342 16466 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:57.250344 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.227385 18761 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:57.274521 16540 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:06:57.276453 16470 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.240139 16537 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.236269 18795 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:57.220094 18787 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:06:57.271164 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.241779 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:57.307126 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1503) took 1496 ms. Trace:
I20260709 13:06:57.290067 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.272333 16368 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 6, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.094578 18562 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:57.262045 18761 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:57.299831 18791 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:06:57.300307 18784 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:06:57.254503 18705 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:57.301115 18789 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:57.273536 18658 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:57.305279 18797 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.322914 16464 rpcz_store.cc:276] 0709 13:06:55.810581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.341984 (+531403us) service_pool.cc:224] Handling call
0709 13:06:56.342257 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.918827 (+576570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.918860 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.925262 (+  6402us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.096487 (+171225us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.096529 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.096596 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.306898 (+210302us) raft_consensus.cc:1685] finished
0709 13:06:57.306922 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.307061 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576228,"raft.queue_time_us":583184,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":99,"thread_start_us":170906,"threads_started":1,"wal-append.queue_time_us":298025}
W20260709 13:06:57.321455 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 83589.4us
I20260709 13:06:57.324810 16368 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 4, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.346604 18701 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.310802 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:57.390504 18797 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:57.390331 18595 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.391223 18646 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:57.391649 18646 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.391770 18701 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:57.391388 18797 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.392050 18646 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.386529 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:57.308710 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.348058 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.346340 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:57.348935 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:57.250025 18722 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:57.390695 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 79989.4us
I20260709 13:06:57.235345 18603 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.389969 18658 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:57.347394 16541 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:57.306234 18729 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:06:57.396883 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 204403us
I20260709 13:06:57.397603 16543 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:57.393761 16368 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 3, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.283456 18796 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:57.372009 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:57.470918 16470 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:57.471796 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73223.4us
W20260709 13:06:57.346937 18737 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.004s
I20260709 13:06:57.330400 18707 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.348147 18761 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.386448 18723 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:57.396299 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50047.1us
I20260709 13:06:57.488289 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.346509 18693 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.443799 16434 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:57.509339 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:57.509799 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 66109.5us
I20260709 13:06:57.510751 16434 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:57.386317 18629 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.125s
W20260709 13:06:57.513034 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.330812 18795 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:57.475224 16368 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 4, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.430261 18598 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.392732 18595 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:57.407330 16611 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:57.395236 17118 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.513826 18693 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:57.614408 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:57.615007 18598 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.389351 18597 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:57.618336 18597 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:57.491075 18695 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.619143 18597 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.330758 18565 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.620337 18565 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:57.621235 18565 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.621987 17118 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:57.513921 16541 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:57.517416 16368 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.624722 16368 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 4, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 4 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:57.399966 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 179195us
I20260709 13:06:57.447962 18722 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:57.489245 17121 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:06:57.386759 18641 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:57.610599 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 122379us
I20260709 13:06:57.611763 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:57.414324 18714 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:57.438910 18647 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:57.426627 18658 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:57.516397 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:57.490909 18645 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:06:57.614936 18693 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.331265 18779 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
W20260709 13:06:57.729760 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 336569us
I20260709 13:06:57.634843 16542 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:06:57.634857 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.730878 16461 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:57.642468 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.471055 18729 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:57.612571 18789 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:57.669761 16470 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:06:57.626703 16368 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 3, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 3 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.742066 16368 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 5, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 5 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
W20260709 13:06:57.638830 18059 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:06:57.743840 16368 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:06:57.746873 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.754451 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.746486 16368 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 3, leader changed from <none> to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:57.755991 16368 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
W20260709 13:06:57.760421 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 249725us
I20260709 13:06:57.762079 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:06:57.765215 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.778894 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:57.780465 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:57.635376 18707 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:06:57.737073 16612 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:57.791903 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 282596us
I20260709 13:06:57.731773 18817 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.522374 18705 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.760378 18739 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.811399 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:57.814759 16617 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:06:57.738517 18647 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.784263 18693 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:57.821220 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 193110us
W20260709 13:06:57.839102 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 99850.9us
I20260709 13:06:57.839757 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:57.840893 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:06:57.815845 16469 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.035s	sys 0.035s
I20260709 13:06:57.774736 18714 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:06:57.845260 16469 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.036s	sys 0.035s
I20260709 13:06:57.858299 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:57.864588 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1502) took 2055 ms. Trace:
I20260709 13:06:57.874060 18714 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.805513 18817 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.870929 16469 rpcz_store.cc:276] 0709 13:06:55.810215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.296323 (+486108us) service_pool.cc:224] Handling call
0709 13:06:56.296654 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:56.917424 (+620770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.917453 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:56.917987 (+   534us) log.cc:844] Serialized 52 byte log entry
0709 13:06:57.088279 (+170292us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:57.232973 (+144694us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.863759 (+630786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.864126 (+   367us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.864289 (+   163us) raft_consensus.cc:1685] finished
0709 13:06:57.864327 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.864503 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":725395,"prepare.queue_time_us":433251,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":709498,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":17570,"thread_start_us":877572,"threads_started":3,"wal-append.queue_time_us":275128}
I20260709 13:06:57.759608 18059 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:57.881323 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 119322us
W20260709 13:06:57.860059 18655 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.000s
W20260709 13:06:57.881858 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 60802.5us
I20260709 13:06:57.806313 18816 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.888298 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:06:57.814433 18739 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:57.835848 18779 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:57.868209 18706 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:57.818535 18644 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:06:57.861156 18663 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:06:57.912756 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:57.857522 18701 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:57.878372 18815 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:57.805737 18658 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.880545 18817 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.901738 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 152773us
I20260709 13:06:57.908354 18722 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:57.815070 18795 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:57.897923 18655 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.962556 18803 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.967454 18803 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.967795 18803 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.969101 18655 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:57.970109 18646 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.000s
W20260709 13:06:57.970481 18808 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:06:57.949043 18707 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:57.955677 18816 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.916678 18779 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.966508 18825 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.977911 18603 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:57.972447 18658 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:57.958688 18722 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:57.976040 18655 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.957952 18739 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:58.042673 18788 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.036s	user 0.010s	sys 0.000s
I20260709 13:06:58.044806 18647 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.040879 18059 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.273530 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:58.275339 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:58.208802 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:58.226235 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 386466us
I20260709 13:06:58.279528 16433 leader_election.cc:400] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:58.284139 16618 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:58.245004 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 609973us
I20260709 13:06:58.246954 16544 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:58.257910 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 378602us
I20260709 13:06:58.271925 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:58.289153 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:57.977169 18598 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:57.976966 18641 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:57.970541 18646 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:58.386382 18761 consensus_meta.cc:287] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.001s
I20260709 13:06:58.387120 18761 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.043090 18788 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.043123 18739 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.162570 18779 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:57.977550 18796 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.169586 18803 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:58.394438 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94149.3us
I20260709 13:06:58.395565 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:06:58.395968 17124 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:58.053277 18826 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.181946 18815 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.964607 18823 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
W20260709 13:06:58.153966 18837 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:58.353541 18818 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.355078 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.013s	sys 0.004s
I20260709 13:06:58.363544 18567 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:58.378286 18583 consensus_meta.cc:287] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.173s	user 0.006s	sys 0.006s
I20260709 13:06:58.381242 18821 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.381460 18847 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:06:58.382436 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.382228 18598 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.418092 18598 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.396713 18803 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:58.383908 16618 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:58.045403 18647 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:58.043072 18655 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.431100 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1363) took 1554 ms. Trace:
I20260709 13:06:58.038595 18644 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:58.433468 18644 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.397020 18695 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:58.432693 16536 rpcz_store.cc:276] 0709 13:06:56.876088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.199891 (+323803us) service_pool.cc:224] Handling call
0709 13:06:57.200290 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.493450 (+293160us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:57.857949 (+364499us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.246309 (+388360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.247806 (+  1497us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.248130 (+   324us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:58.248706 (+   576us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.249306 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.249494 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.414522 (+165028us) raft_consensus.cc:1685] finished
0709 13:06:58.414557 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.430844 (+ 16287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45089,"prepare.queue_time_us":321887,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":16138,"raft.queue_time_us":120965,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3630,"thread_start_us":846865,"threads_started":3,"wal-append.queue_time_us":184595}
W20260709 13:06:58.400295 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.407831 17123 raft_consensus.cc:2368] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8.
I20260709 13:06:58.407781 18810 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:06:58.409337 18788 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:58.408951 18818 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:58.409926 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.013s	sys 0.004s
I20260709 13:06:58.416677 18583 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.421569 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1504) took 1175 ms. Trace:
I20260709 13:06:58.427572 18729 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:58.427280 18817 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.426587 18646 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.428323 18598 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.426283 18490 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.424136 18847 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:58.408981 18562 consensus_meta.cc:287] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.015s
I20260709 13:06:58.438542 18644 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.463167 18847 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.441056 16461 rpcz_store.cc:276] 0709 13:06:57.245346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.245509 (+   163us) service_pool.cc:224] Handling call
0709 13:06:57.282588 (+ 37079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.731313 (+448725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.420233 (+688920us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54003af054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.420730 (+   497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030483712}
I20260709 13:06:58.469827 18761 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:58.471697 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 485475us
W20260709 13:06:58.439744 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 598881us
I20260709 13:06:58.430918 18647 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:58.442656 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.440372 18804 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:58.389065 18719 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.434993 18821 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.446210 18795 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:58.447058 17127 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:58.447336 18818 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.449481 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 293) took 1624 ms. Trace:
W20260709 13:06:58.451661 16612 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.639s	user 0.013s	sys 0.000s
I20260709 13:06:58.452317 18838 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.398365 18657 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:58.447336 18583 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.454201 18655 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.399540 18815 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:58.493376 18708 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:58.493265 18815 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.494163 18708 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.494799 18846 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:58.495875 18815 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.455848 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:58.495765 18846 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:58.496380 18708 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.463037 17126 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:58.482424 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1517) took 1063 ms. Trace:
I20260709 13:06:58.481313 16544 rpcz_store.cc:276] 0709 13:06:56.825113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.062197 (+237084us) service_pool.cc:224] Handling call
0709 13:06:57.067336 (+  5139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.288487 (+1221151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.449171 (+160684us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002fb554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.449412 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710774016}
I20260709 13:06:58.487183 16612 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:58.487622 18821 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.458863 18490 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:58.479514 18804 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:58.496759 16610 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.457482 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:58.455842 18813 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.473322 18695 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:06:58.505193 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 54084.7us
W20260709 13:06:58.506124 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.508437 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 335) took 1102 ms. Trace:
I20260709 13:06:58.508859 16612 rpcz_store.cc:276] 0709 13:06:57.406126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.414331 (+  8205us) service_pool.cc:224] Handling call
0709 13:06:58.508286 (+1093955us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:58.506613 16466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.004s	sys 0.012s
W20260709 13:06:58.510871 16466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.004s	sys 0.012s
I20260709 13:06:58.511646 16611 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.514354 16615 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:58.514516 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:58.514973 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:58.515745 17122 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:58.517053 16610 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:06:58.517436 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:58.518752 18846 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:58.520352 18814 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.707s	user 0.000s	sys 0.010s
I20260709 13:06:58.522387 18695 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.501016 16462 rpcz_store.cc:276] 0709 13:06:57.384227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.395361 (+ 11134us) service_pool.cc:224] Handling call
0709 13:06:57.395647 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.769792 (+374145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.769836 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.769891 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:57.769935 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.446806 (+676871us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001086d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.446870 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.447133 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859872512}
I20260709 13:06:58.530333 18583 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:58.530699 18490 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.532912 18795 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.533882 18583 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:58.534970 18787 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:58.535348 16537 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.128s	user 0.012s	sys 0.009s
I20260709 13:06:58.535411 18787 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:58.487501 18645 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:58.536509 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:58.535516 18804 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.545491 16537 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:58.549198 18787 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.546367 18645 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:58.551483 18847 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.503363 18644 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.554338 18838 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:06:58.610236 18835 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:58.556128 18720 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:58.594913 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.595240 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.596480 16611 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:06:58.610455 18838 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.612332 18667 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:58.614235 18838 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.615149 16540 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.614838 18644 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.617717 18644 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:58.619653 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.622084 18811 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.526s	user 0.001s	sys 0.004s
I20260709 13:06:58.623467 18847 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:58.624701 18847 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.625108 16509 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:58.626674 18720 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:58.627353 18720 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:06:58.628948 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1366) took 1527 ms (client timeout 1836 ms). Trace:
W20260709 13:06:58.629163 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 121339us
W20260709 13:06:58.629474 16537 rpcz_store.cc:269] 0709 13:06:57.101756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.113375 (+ 11619us) service_pool.cc:224] Handling call
0709 13:06:58.611431 (+1498056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:58.630410 18179 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.630894 18179 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:58.628614 18720 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.631353 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:58.631357 18645 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.595404 18813 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.660955 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1803) took 1681 ms. Trace:
I20260709 13:06:58.674518 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 478) took 1587 ms. Trace:
I20260709 13:06:58.662945 16536 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:58.673569 16463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1514) took 1352 ms (client timeout 1757 ms). Trace:
I20260709 13:06:58.744639 18705 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.755949 18645 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:58.749692 17127 rpcz_store.cc:276] 0709 13:06:57.087294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.088532 (+  1238us) service_pool.cc:224] Handling call
0709 13:06:57.088810 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.494284 (+1405474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.674181 (+179897us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400684554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.674414 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122624256}
I20260709 13:06:58.673370 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:58.744706 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 833698us
I20260709 13:06:58.659055 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1796) took 1826 ms. Trace:
I20260709 13:06:58.748521 16540 rpcz_store.cc:276] 0709 13:06:56.979635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.275469 (+295834us) service_pool.cc:224] Handling call
0709 13:06:58.614775 (+1339306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.615591 (+   816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.660621 (+ 45030us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54000ac3d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:58.660877 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037200768}
I20260709 13:06:58.773583 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1520) took 1334 ms. Trace:
I20260709 13:06:58.777447 17122 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:58.779830 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:58.780342 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.744563 18795 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.734760 18804 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:58.672412 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:58.754401 16463 rpcz_store.cc:269] 0709 13:06:57.321375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.321721 (+   346us) service_pool.cc:224] Handling call
0709 13:06:58.673094 (+1351373us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:58.673326 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341370112}
I20260709 13:06:58.671660 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:58.769273 16543 rpcz_store.cc:276] 0709 13:06:56.808648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.993494 (+184846us) service_pool.cc:224] Handling call
0709 13:06:56.993844 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.488540 (+494696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.634959 (+1146419us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540007a154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.635263 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927974656}
I20260709 13:06:58.674546 18817 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.718760 18490 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.704059 18664 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:58.789371 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 433) took 1008 ms. Trace:
I20260709 13:06:58.744542 16537 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:58.633606 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 424) took 1899 ms. Trace:
I20260709 13:06:58.794080 17126 rpcz_store.cc:276] 0709 13:06:57.776646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.461803 (+685157us) service_pool.cc:224] Handling call
0709 13:06:58.462202 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.462707 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:58.734439 (+271732us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.775744 (+ 41305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.775814 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:58.775883 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.775969 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.776096 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"thread_start_us":18264,"threads_started":1,"wal-append.queue_time_us":18374}
W20260709 13:06:58.792047 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 503203us
I20260709 13:06:58.735067 18797 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:58.799081 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 125868us
I20260709 13:06:58.783651 18644 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.662647 18809 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:06:58.809096 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 259053us
W20260709 13:06:58.802976 18565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.010s	sys 0.024s
I20260709 13:06:58.817631 18813 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:58.818537 18663 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:58.820864 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:58.813865 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.797816 17121 rpcz_store.cc:276] 0709 13:06:56.734031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.734398 (+   367us) service_pool.cc:224] Handling call
0709 13:06:56.734706 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.736822 (+1002116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.632981 (+896159us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b5400523854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:06:58.633392 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522603904}
W20260709 13:06:58.817870 18565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.010s	sys 0.029s
I20260709 13:06:58.796631 18664 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:58.774247 16466 rpcz_store.cc:276] 0709 13:06:57.439216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.440908 (+  1692us) service_pool.cc:224] Handling call
0709 13:06:57.441286 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.441519 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:57.634474 (+192955us) log.cc:844] Serialized 14 byte log entry
0709 13:06:58.772844 (+1138370us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.772978 (+   134us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:58.773122 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.773271 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.773502 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174945,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":261162,"spinlock_wait_cycles":37671552,"thread_start_us":1010175,"threads_started":2,"wal-append.queue_time_us":872655}
I20260709 13:06:58.611014 18835 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.828837 16542 raft_consensus.cc:2368] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:58.805780 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:06:58.833024 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 111221us
I20260709 13:06:58.834693 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:58.831812 18667 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.842718 16544 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:58.845454 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 173884us
I20260709 13:06:58.644112 18179 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.846233 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:58.855701 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 50029.1us
I20260709 13:06:58.850322 18654 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.859086 16543 raft_consensus.cc:2376] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4. Re-sending same reply.
I20260709 13:06:58.826695 18805 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:58.860954 16511 leader_election.cc:400] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:58.867223 18597 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.867987 16511 leader_election.cc:403] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.853902 18663 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:58.831014 18644 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.831362 18562 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:58.867772 18693 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.870s	user 0.011s	sys 0.006s
I20260709 13:06:58.876183 18760 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.876730 18715 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:58.877425 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:06:58.878789 18857 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:06:58.879860 18853 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:58.882488 18805 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.868786 18583 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.883934 18664 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:58.884871 18807 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.885025 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:58.887192 18667 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.890897 18644 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:58.865996 18654 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.887933 18663 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.892529 16463 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:06:58.894146 16461 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:58.894451 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:58.898640 18787 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.898579 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:58.874085 16545 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:06:58.900305 16468 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:58.874915 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1365) took 1853 ms. Trace:
I20260709 13:06:58.909349 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:58.917366 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45632us
W20260709 13:06:58.918200 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66297us
I20260709 13:06:58.923623 16583 leader_election.cc:400] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8.
I20260709 13:06:58.939726 16583 leader_election.cc:403] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:58.926029 18831 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4.
I20260709 13:06:58.942369 18647 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:58.922744 18813 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.937731 16539 rpcz_store.cc:276] 0709 13:06:56.897002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.229536 (+332534us) service_pool.cc:224] Handling call
0709 13:06:57.230186 (+   650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.230632 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:57.315760 (+ 85128us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.522660 (+206900us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.652860 (+130200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.729948 (+ 77088us) log.cc:844] Serialized 564 byte log entry
0709 13:06:57.730092 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:57.730124 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.730185 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.498092 (+767907us) spinlock_profiling.cc:243] Waited 76.9 ms on lock 0x7b1800390ac0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:06:58.519247 (+ 21155us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:06:58.623066 (+103819us) raft_consensus.cc:1685] finished
0709 13:06:58.623088 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.750532 (+127444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29642,"prepare.queue_time_us":46652,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":7043,"raft.queue_time_us":194,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":15972,"spinlock_wait_cycles":186234880,"thread_start_us":159387,"threads_started":1,"wal-append.queue_time_us":432668}
I20260709 13:06:58.937162 18654 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.943171 18813 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:58.926566 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 66445.3us
I20260709 13:06:58.926999 18646 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:58.927065 18855 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:06:58.927419 18722 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:58.927901 18543 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:58.914839 18179 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.901065 18817 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.870251 18809 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.928493 18583 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:06:58.967121 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:58.968566 18739 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.579s	user 0.012s	sys 0.000s
I20260709 13:06:58.969084 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:58.969753 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 59438.1us
I20260709 13:06:58.944254 16544 raft_consensus.cc:2376] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5. Re-sending same reply.
I20260709 13:06:58.991739 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:58.982554 17121 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:58.992412 16539 raft_consensus.cc:2376] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4. Re-sending same reply.
I20260709 13:06:58.926591 18760 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:58.977802 18562 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8.
I20260709 13:06:58.998034 18664 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.998346 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:58.999825 18809 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.000319 18667 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:59.000694 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 166441us
I20260709 13:06:58.977854 18715 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.000900 18818 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.001570 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.001632 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:59.009550 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.017204 16617 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:59.017808 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:06:59.026974 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.025676 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:59.032683 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.011121 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:59.037374 16614 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:59.051074 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.037127 18543 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.053059 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.023449 18835 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:59.060067 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.060874 18644 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.061896 18818 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.062358 18583 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.070001 18715 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:06:59.053861 18860 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:06:59.029336 18817 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.107018 18817 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:59.017591 18807 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:59.088789 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 63266.8us
I20260709 13:06:59.109496 18807 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.073619 16543 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:59.109817 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:06:59.074079 18760 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.040591 18562 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:06:59.076133 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.077575 16539 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:59.021075 18720 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.073925 18797 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:59.085933 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.088387 16462 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:59.092341 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.092908 18818 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:06:59.093406 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91886.2us
W20260709 13:06:59.097879 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.099167 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.102085 18543 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:59.102813 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108943us
I20260709 13:06:59.104413 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:06:59.123364 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.133486 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.134042 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.136660 18801 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:06:59.137351 18760 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:06:59.139307 18856 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:59.080526 18654 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.167119 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.146430 18807 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.147333 18562 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:59.150568 18844 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.405s	user 0.002s	sys 0.002s
I20260709 13:06:59.150451 18646 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.131778 18831 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.130491 18490 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:06:59.153930 16468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1515) took 1822 ms (client timeout 1837 ms). Trace:
W20260709 13:06:59.204901 16468 rpcz_store.cc:269] 0709 13:06:57.331197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.345910 (+ 14713us) service_pool.cc:224] Handling call
0709 13:06:59.153658 (+1807748us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54003e4754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:06:59.153857 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3458496256}
I20260709 13:06:59.205348 18565 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:59.130764 18797 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.205816 18565 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:59.206060 18797 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:59.206883 18565 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.208153 18565 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:59.171507 16542 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:06:59.208952 18664 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.192553 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.205356 18720 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.196085 18695 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:59.209599 18664 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.210248 18695 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:59.211364 18695 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:06:59.187412 18705 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.213393 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.213584 18705 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.214308 16542 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 2.
I20260709 13:06:59.215708 18705 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.168998 18633 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:59.196837 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 87112.7us
I20260709 13:06:59.199206 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.171793 16537 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:06:59.201299 18800 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.201716 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:59.202061 18847 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.202167 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.191085 16543 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:06:59.203094 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.203361 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.203778 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.205456 18760 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.213404 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:59.178876 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.202733 18722 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.222998 18847 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.177876 18562 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:59.227952 17123 raft_consensus.cc:2368] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:59.184916 18805 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.232522 17125 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:06:59.233644 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 49353.1us
I20260709 13:06:59.239827 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.238199 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:06:59.248908 18722 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.236387 18695 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.264055 17122 raft_consensus.cc:2410] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:59.261659 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.224632 18807 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.243743 18664 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.278043 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:06:59.279452 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 46452.6us
I20260709 13:06:59.290153 16539 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:59.297165 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 119100us
I20260709 13:06:59.297863 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.298040 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:59.298581 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.273563 18715 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.298938 17127 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:06:59.284088 18543 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.288144 18795 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:59.311226 16542 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:59.309433 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:06:59.304232 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.307401 18711 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.320631 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:59.322016 17127 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:59.324924 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.327905 18831 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.331107 18831 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.335992 16434 leader_election.cc:400] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:59.336521 16434 leader_election.cc:403] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:06:59.336045 18864 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:06:59.337914 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.337955 18795 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.341044 18633 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.341660 18633 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.342150 18633 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.346045 18697 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.346779 18697 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.349890 18795 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7.
I20260709 13:06:59.353688 17127 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:59.356446 18722 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.323704 18664 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:59.357430 18664 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:59.358739 18664 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:06:59.360481 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.316335 18813 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.314811 18720 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:59.365170 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.321404 18715 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.370227 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:59.324026 18711 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.365942 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:06:59.362116 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.382910 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54276us
I20260709 13:06:59.322734 18654 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.384073 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:06:59.386801 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.370106 17118 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.377686 18711 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.375346 18715 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.369675 18847 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.374858 18543 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.386816 18059 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:59.429327 16539 raft_consensus.cc:2368] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8.
W20260709 13:06:59.439648 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 116611us
I20260709 13:06:59.360862 16537 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:06:59.436973 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 107961us
I20260709 13:06:59.440678 18760 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:59.444469 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.445096 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.447574 18868 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:06:59.449951 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:06:59.451493 18663 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:59.451970 18663 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:59.452934 18663 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.455458 18543 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.441666 18720 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.456349 18720 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:59.437265 18715 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.417932 18797 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.479213 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.479825 16539 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:59.398039 18562 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.475067 18807 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.488003 16539 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:59.480979 18817 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.477725 18059 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:06:59.499935 18797 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.491421 18697 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:06:59.501287 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:06:59.502875 18645 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:59.503865 16416 auto_rebalancer.cc:629] Failed to schedule move for tablet eb71b78423ad47fbb40e65fef063a173: Aborted: Op aborted by new leader
I20260709 13:06:59.504197 18851 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:59.504822 18795 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:59.505270 18795 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:06:59.506270 18795 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.507037 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.507138 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.507371 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.507556 18795 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.507870 16463 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.509478 16470 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.509196 18720 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.510572 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.513444 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:59.515805 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:06:59.516701 16612 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:06:59.518122 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.518951 16614 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:06:59.519773 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.519965 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:59.520416 16539 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:06:59.524871 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.525812 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.527168 16537 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
W20260709 13:06:59.529196 18870 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:59.493808 18817 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.516463 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:06:59.537873 18646 raft_consensus.cc:2764] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:59.538084 18059 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:59.557257 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.512295 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.558292 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.562440 16614 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:59.563735 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.559995 18633 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:06:59.567975 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.569106 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.569871 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.570323 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:06:59.570493 16537 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:06:59.572121 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.572440 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.572755 16610 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:59.573102 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.573755 16611 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:59.575657 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.573143 16615 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:06:59.582233 16539 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:59.583918 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:59.586776 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.585445 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.594900 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.598804 16461 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:06:59.578521 18797 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.599953 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.600200 18797 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.600523 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.601192 16616 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:59.601307 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.546015 18059 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.601934 16611 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:59.602442 18797 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.603324 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.598831 16470 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:59.599829 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.600610 16619 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
W20260709 13:06:59.607450 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 94443.6us
I20260709 13:06:59.607848 16463 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
W20260709 13:06:59.623749 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.631132 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:06:59.685359 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.779304 16466 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:06:59.645658 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.631716 16615 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:06:59.716203 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:06:59.748188 16468 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:06:59.605727 18818 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.644507 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:06:59.785041 16544 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.743999 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.785120 16617 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
W20260709 13:06:59.785545 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 139987us
I20260709 13:06:59.786321 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.757936 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.652807 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.787335 16540 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:06:59.789783 16433 leader_election.cc:400] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:59.790175 16433 leader_election.cc:403] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:59.716729 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.617468 18787 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.794919 18490 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:59.795264 18565 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:06:59.789455 18800 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:59.796378 18722 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.684649 18633 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.801405 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.801714 18059 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.820501 16468 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:06:59.821292 18695 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.007s
I20260709 13:06:59.800344 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.821733 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.822873 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.784248 18809 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:06:59.823253 16468 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:59.803833 18805 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6.
I20260709 13:06:59.799430 18705 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:59.793866 16469 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:59.760762 18797 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:59.829514 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.802341 18787 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.809501 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:06:59.716142 18831 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.817339 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.833695 18809 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.817896 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.851722 16461 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.800676 18818 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:06:59.851871 16540 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:06:59.813192 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:06:59.818432 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:06:59.809573 16511 connection.cc:256] RPC call timeout handler was delayed by -1.64493673700008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 13:06:59.813732 18800 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.823058 16462 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:06:59.813527 18722 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:59.856063 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56976.3us
I20260709 13:06:59.855188 16536 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:06:59.929950 16511 connection.cc:256] RPC call timeout handler was delayed by -1.4433367370000951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:06:59.930378 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
W20260709 13:06:59.930537 16511 connection.cc:256] RPC call timeout handler was delayed by -1.3982850669999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:06:59.931094 16511 connection.cc:256] RPC call timeout handler was delayed by -1.2522631080000792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:06:59.931512 16511 connection.cc:256] RPC call timeout handler was delayed by -1.073163108000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:06:59.930378 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:59.933359 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.934230 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.934594 16618 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:59.935006 16469 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:59.935488 16541 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:59.936072 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.936425 16464 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:59.937114 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.937286 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.937670 16467 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:06:59.937920 16469 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:06:59.938524 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.938748 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.939388 16469 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:06:59.939667 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:06:59.940824 18760 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:06:59.941421 18760 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.942157 18715 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.943456 18760 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.943552 18715 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.944169 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:06:59.854830 18800 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.944319 16613 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.949213 16537 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:06:59.949998 16617 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:59.854030 18817 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:59.953394 18711 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.507s	user 0.013s	sys 0.000s
I20260709 13:06:59.852197 18543 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.953770 18664 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:59.954161 18543 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.953815 18711 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.955547 18654 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.956179 18543 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:06:59.956025 18654 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:06:59.956583 18711 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.957608 18831 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:06:59.832543 18720 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:06:59.958491 18720 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.959681 16461 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:59.956705 18543 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:59.960616 18543 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:06:59.961288 18818 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.961575 18543 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:06:59.962538 18543 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:59.932804 18697 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:59.965696 18697 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.966035 18697 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:59.969714 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.970041 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.970604 16461 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:59.957509 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.010030 16544 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:06:59.971146 18562 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:59.983718 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 49810.3us
I20260709 13:06:59.994585 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:00.043217 16617 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:00.043457 16461 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:59.974094 16462 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
W20260709 13:07:00.037690 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 247082us
I20260709 13:06:59.993014 16470 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:59.973414 16466 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:06:59.986159 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:06:59.992377 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:06:59.960500 18720 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:06:59.989449 18878 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:59.930045 18722 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.046597 16468 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:00.044644 16462 pending_rounds.cc:85] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 6
I20260709 13:06:59.983825 18807 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:59.995661 18817 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.054566 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.064640 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:00.059437 16462 pending_rounds.cc:107] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:00.066028 16462 raft_consensus.cc:2889] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.073045 18705 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.073525 18705 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:00.073933 18705 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.068467 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.072484 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.062662 18720 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:00.090281 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 98066.4us
I20260709 13:07:00.093079 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.094564 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.097517 16617 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:00.102427 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.108654 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.092258 16544 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:00.105854 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.110180 16613 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:00.089838 18831 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.115829 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.066089 18817 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:00.123418 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:00.124159 16541 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.117624 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.089932 18711 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.119463 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.121868 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.122191 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:00.103403 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.108841 18787 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:00.107976 18829 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.102120 18800 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.132606 18805 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.122340 18831 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.122547 16465 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:00.114039 18884 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:00.137006 18875 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.493s	user 0.007s	sys 0.010s
I20260709 13:07:00.145301 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.151252 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.151922 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.158581 16615 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:00.162571 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 90204us
I20260709 13:07:00.163435 16613 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.147239 18817 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:00.165723 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:00.164249 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.163931 18805 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:00.152390 16537 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:00.180740 16544 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:00.184069 17126 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:00.167132 18807 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.188127 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.152252 18711 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.140710 18697 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.206454 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.214259 16618 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:00.214440 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 101415us
I20260709 13:07:00.216997 18809 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:00.219421 18800 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.220347 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.221119 16540 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:00.222204 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:00.223048 16540 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:00.223389 18831 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.223918 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.225068 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:00.226421 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:00.227133 16613 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:00.227867 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.228443 16619 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:00.229442 16613 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:00.232972 18884 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.233105 18795 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.234969 18697 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.235527 18797 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.236580 18797 consensus_queue.cc:1243] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:07:00.237310 18797 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:00.240738 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:00.241520 18887 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:00.242115 18633 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:00.242707 17121 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.243456 18633 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.244004 18633 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.245010 18695 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.245575 18695 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:00.244468 18633 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.249965 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1826) took 1026 ms. Trace:
I20260709 13:07:00.250145 18805 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.250396 16543 rpcz_store.cc:276] 0709 13:06:59.223917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.224027 (+   110us) service_pool.cc:224] Handling call
0709 13:06:59.238329 (+ 14302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.247039 (+  8710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.247082 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.270654 (+ 23572us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.476139 (+205485us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:59.476198 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.476290 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.136248 (+659958us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:00.249654 (+113406us) raft_consensus.cc:1685] finished
0709 13:07:00.249675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.249902 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4350,"raft.queue_time_us":1381,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2549,"spinlock_wait_cycles":159640320,"thread_start_us":179040,"threads_started":1,"wal-append.queue_time_us":294297}
I20260709 13:07:00.251519 18805 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.252731 16543 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:00.253023 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.253615 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:00.255030 18722 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.256063 16543 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:07:00.256623 18876 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.540s	user 0.000s	sys 0.010s
I20260709 13:07:00.257207 18705 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.167472 18787 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:00.258958 16537 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:00.262039 18654 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:00.263247 18871 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.783s	user 0.005s	sys 0.012s
I20260709 13:07:00.225003 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.264739 16611 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:00.266376 16617 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.304378 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.266824 16536 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:00.305025 16543 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:00.267767 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 96793.7us
I20260709 13:07:00.268448 18711 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.271790 18059 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.309422 18059 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:00.310303 18872 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.004s	sys 0.024s
I20260709 13:07:00.277829 16463 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:07:00.311427 18059 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.311554 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.278930 18760 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.278668 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63429.6us
I20260709 13:07:00.312083 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:00.312203 18760 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.312624 16536 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.313709 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:00.314419 18760 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:00.314594 18809 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:00.315173 18809 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:00.315063 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:00.316089 18760 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:07:00.282723 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.316888 18760 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:00.287405 16618 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:00.318019 18697 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:00.318377 18697 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:00.319139 18697 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.320176 18697 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.278158 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.321434 16618 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:00.289037 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:00.323025 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.297394 18800 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:00.298067 18879 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.554s	user 0.010s	sys 0.000s
I20260709 13:07:00.284708 18179 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.328202 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:00.316205 18809 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.329634 18787 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.328446 18179 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.330055 18787 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.330473 18787 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.328413 16612 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:00.310719 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.332086 18711 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:00.272888 18888 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.332305 18490 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.333043 18888 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.333827 18490 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.335132 18888 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.335685 18831 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.327046 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:00.224699 16540 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:00.337522 18831 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.337941 18831 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.338243 18831 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:00.327135 18872 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.004s	sys 0.024s
I20260709 13:07:00.312575 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:00.340350 16543 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:00.282358 16541 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:00.290408 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 193773us
W20260709 13:07:00.344907 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.345551 16536 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:00.326855 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:00.326923 18565 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.327890 18797 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:07:00.329828 18884 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:00.355605 18705 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.355880 18884 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:00.356271 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:00.356465 18884 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:00.357060 17123 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:00.357988 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.357697 18884 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.359419 18884 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.360059 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.361397 18797 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.364935 18705 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:00.337170 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:00.367300 18807 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.367367 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.367766 18807 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.368162 18807 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.368884 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:00.371516 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.372109 16463 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:00.372941 18543 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:00.341590 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52639.3us
I20260709 13:07:00.313894 18633 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.346443 16617 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.374112 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.374198 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:00.375234 16582 leader_election.cc:400] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8.
I20260709 13:07:00.375967 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.317843 18760 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.350641 16537 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:00.351658 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:00.351881 17122 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:00.352387 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:00.344461 18654 raft_consensus.cc:2764] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:00.352933 16545 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:00.394708 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.354486 18565 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:00.358042 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:00.402055 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.402227 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.402642 16468 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:00.397123 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.366365 18705 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.289172 18851 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.391003 18562 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.385234 16617 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:00.386241 17127 raft_consensus.cc:2368] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:00.388891 16463 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:00.390878 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:00.394269 16466 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:00.396317 17118 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:00.354164 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.397012 16469 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:00.398411 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.400844 18565 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.390956 18818 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.418243 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:00.347100 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.426728 18851 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.431931 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:00.436399 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 82302.1us
I20260709 13:07:00.443087 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.443655 16465 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:00.444511 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:00.437774 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 108330us
I20260709 13:07:00.444494 16509 leader_election.cc:400] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
W20260709 13:07:00.445345 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 98315.3us
I20260709 13:07:00.445670 16509 leader_election.cc:403] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.405975 18705 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:00.447264 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.428025 18886 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.449568 16467 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:00.456451 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:00.461104 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.462605 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.463335 16468 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:00.463796 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.464489 16461 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 3: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:00.431398 18562 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.397712 18809 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:07:00.465154 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47041.9us
I20260709 13:07:00.460054 18890 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.468647 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.469722 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.438519 18715 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.477483 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 79112.6us
I20260709 13:07:00.477569 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.478397 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:00.487234 16618 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:00.440539 18898 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:00.432860 18664 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:07:00.486560 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 55966.3us
I20260709 13:07:00.461644 18705 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.505129 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.485535 18543 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.509626 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.510991 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.463645 18646 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.513948 16461 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:00.468902 18562 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.501652 18805 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:07:00.516335 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70174.7us
I20260709 13:07:00.518119 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:00.518577 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 77273.5us
I20260709 13:07:00.516261 16465 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:00.525141 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:00.505594 18889 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:00.533604 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:00.526577 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:00.513875 18886 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.541019 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.514060 18646 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:00.542778 16467 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:00.536994 18886 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.504485 18715 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.549201 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.528445 18805 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:00.612152 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:00.606109 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 65300us
W20260709 13:07:00.793376 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 266935us
I20260709 13:07:00.793879 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:00.793437 18908 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.793388 18695 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:00.795522 18695 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.795202 18908 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:00.797747 18908 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:00.537585 18890 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.542258 18654 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.553691 18646 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.807914 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.550616 18896 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.770619 18886 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.523653 18787 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:00.820040 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 286025us
I20260709 13:07:00.841303 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:00.803510 18805 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:00.842376 16461 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:00.806140 18888 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:00.846287 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52462.1us
I20260709 13:07:00.812559 18633 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:00.812215 18809 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.810850 18654 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.806636 18890 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:00.838685 18896 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.804124 18907 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:00.872903 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1374) took 1481 ms. Trace:
I20260709 13:07:00.865518 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:00.866950 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:00.865347 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 395683us
I20260709 13:07:00.875025 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 253) took 1057 ms. Trace:
W20260709 13:07:00.878304 18900 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:07:00.877921 16464 rpcz_store.cc:276] 0709 13:06:59.817347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.817551 (+   204us) service_pool.cc:224] Handling call
0709 13:06:59.817880 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.936801 (+118921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.873862 (+937061us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54003b8654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:00.874963 (+  1101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41498496}
I20260709 13:07:00.840889 18903 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:00.847571 18059 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:00.849207 18911 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.879016 16582 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:00.878234 18905 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.864197 18565 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:00.873739 18807 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.003s
I20260709 13:07:00.868032 18809 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.870188 18654 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.870293 18890 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.914412 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:00.873420 16542 rpcz_store.cc:276] 0709 13:06:59.407145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.436278 (+ 29133us) service_pool.cc:224] Handling call
0709 13:06:59.443494 (+  7216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.483488 (+ 39994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.483534 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.492590 (+  9056us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.625746 (+133156us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:59.709833 (+ 84087us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.783450 (+ 73617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.783560 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.152670 (+369110us) raft_consensus.cc:1685] finished
0709 13:07:00.152707 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.872709 (+720002us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b54000334d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:00.872840 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72485,"prepare.queue_time_us":77215,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":4972,"raft.queue_time_us":84152,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":6774,"spinlock_wait_cycles":3450624,"thread_start_us":99931,"threads_started":1,"wal-append.queue_time_us":301907}
I20260709 13:07:00.907544 18633 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:07:00.873901 18896 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.922997 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:00.917589 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 407992us
I20260709 13:07:00.872589 18912 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:00.919689 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 386094us
W20260709 13:07:00.929533 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64082us
I20260709 13:07:00.912752 18911 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.924111 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:00.909197 18903 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:00.907785 18059 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.929576 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:00.916213 18809 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.927054 18906 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.910902 18795 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:00.965559 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123345us
I20260709 13:07:01.037873 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:00.919965 18889 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:00.967854 16469 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:01.048244 16469 pending_rounds.cc:85] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 3
I20260709 13:07:00.924922 18818 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:00.975762 16464 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:00.995959 18695 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:01.112264 16469 pending_rounds.cc:107] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:01.112720 16469 raft_consensus.cc:2889] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:00.996884 18565 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:00.997201 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:01.015547 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.974476 18903 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:00.964098 18911 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.113448 16542 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:00.922068 18905 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.032500 18916 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:07:01.032829 18901 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:07:01.033584 18909 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:07:01.034909 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1386) took 1281 ms. Trace:
I20260709 13:07:00.944701 18851 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:00.918581 18807 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:01.060338 18908 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:01.061873 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 137815us
W20260709 13:07:01.062659 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 139706us
I20260709 13:07:01.065435 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:01.153914 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:01.154551 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 89222.7us
I20260709 13:07:00.977166 18059 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.036928 18795 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:01.132396 18831 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.794s	user 0.005s	sys 0.002s
I20260709 13:07:01.062505 18818 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.124003 18797 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.759s	user 0.001s	sys 0.009s
I20260709 13:07:01.146508 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.118984 18888 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.159228 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:01.164877 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:01.133641 16539 rpcz_store.cc:276] 0709 13:06:59.753133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.753626 (+   493us) service_pool.cc:224] Handling call
0709 13:07:00.292961 (+539335us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5800003398. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:07:00.293095 (+   134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.294427 (+  1332us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:00.377711 (+ 83284us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.481372 (+103661us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.481973 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.482131 (+   158us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.482176 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.482258 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.034494 (+552236us) raft_consensus.cc:1685] finished
0709 13:07:01.034617 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.034826 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37346,"prepare.queue_time_us":121429,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":100236,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":253351,"spinlock_wait_cycles":2925440,"thread_start_us":183301,"threads_started":3,"wal-append.queue_time_us":126856}
W20260709 13:07:01.139022 18697 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.004s
I20260709 13:07:01.155319 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:01.133168 18912 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.173930 16466 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:01.142720 18715 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:01.133302 18914 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:01.202482 18910 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:01.164568 18664 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.153235 18908 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:01.172274 18800 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.172259 18795 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.173473 18818 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.210189 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:01.263047 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 107788us
I20260709 13:07:01.263168 16466 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:01.180745 18797 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.173163 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:07:01.265394 16618 raft_consensus.cc:606] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:01.265729 16618 raft_consensus.cc:614] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:01.266413 18809 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.231846 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67065.4us
W20260709 13:07:01.224032 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64886.2us
I20260709 13:07:01.176707 18787 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:01.270391 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.207137 18813 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.208010 18715 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.297578 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.298200 16541 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:01.302356 16536 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.298460 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:01.174556 18831 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.299115 18851 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:07:01.313964 18831 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.314677 18831 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:01.315150 18831 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.301378 16537 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.298273 18918 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:01.317615 18918 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.319739 18918 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:01.319566 18715 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.321533 18715 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:01.323444 18884 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.000s
I20260709 13:07:01.323320 18805 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.295826 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:01.224713 18913 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:07:01.304009 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.223538 18800 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:01.307900 18927 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.308370 18923 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.293759 18910 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.312053 18179 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:01.222784 18888 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.407613 18888 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.407840 18884 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.295220 18697 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.261096 18914 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:01.204211 18912 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.221730 18908 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.304234 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:01.268736 18809 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.361358 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
W20260709 13:07:01.364316 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 68564us
I20260709 13:07:01.365561 16539 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:01.366364 18851 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:01.366751 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1760) took 1215 ms. Trace:
I20260709 13:07:01.366885 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:01.368448 18543 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:01.335613 18923 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:01.371183 18910 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:01.372526 18646 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.533s	user 0.009s	sys 0.000s
I20260709 13:07:01.376204 16465 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:07:01.377048 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:01.320761 18705 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.789s	user 0.005s	sys 0.000s
I20260709 13:07:01.223625 18664 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.332161 18562 consensus_meta.cc:287] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.802s	user 0.010s	sys 0.000s
I20260709 13:07:01.408190 16464 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:01.589345 18928 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:01.697135 18928 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.433102 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:01.439560 18787 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.259s
I20260709 13:07:01.699465 18928 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.636668 18722 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.700338 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:01.428591 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 164773us
W20260709 13:07:01.666123 18896 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.700s	user 0.004s	sys 0.005s
I20260709 13:07:01.589771 18795 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.663800 18886 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.816s	user 0.008s	sys 0.001s
I20260709 13:07:01.702030 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:01.702123 18886 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.702993 18924 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:01.703217 16543 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:01.704401 18886 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.677744 17121 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:07:01.712595 17121 pending_rounds.cc:85] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 7
I20260709 13:07:01.713570 17121 pending_rounds.cc:107] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:07:01.705461 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:01.701272 18896 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.577939 16436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.137s (SENT) [suppressed 22 similar messages]
I20260709 13:07:01.715823 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:01.716347 18896 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.331239 18889 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.701233 17122 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:01.717098 18889 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:01.714488 17121 raft_consensus.cc:2889] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:01.707823 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.718061 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:01.714259 18562 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.718604 16612 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.718047 18722 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:01.719233 18720 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:01.719823 18720 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.720265 18889 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.721251 16614 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.363842 18800 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.722940 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1778) took 1267 ms. Trace:
I20260709 13:07:01.723264 16614 rpcz_store.cc:276] 0709 13:07:00.455570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.457322 (+  1752us) service_pool.cc:224] Handling call
0709 13:07:00.486119 (+ 28797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.721693 (+1235574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.722706 (+  1013us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003db154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:01.722865 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840019200}
I20260709 13:07:01.708709 18646 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.726617 18809 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.726477 18914 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.727137 18809 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:01.708469 16544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.012s
W20260709 13:07:01.665928 18903 consensus_meta.cc:287] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.006s
I20260709 13:07:01.728848 18927 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:01.729359 18903 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.730871 16545 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.443943 16536 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:01.709441 16618 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:01.422228 18805 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.710002 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:01.732486 17126 raft_consensus.cc:2368] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:01.426280 18831 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.581866 18059 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.711431 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:01.727706 18809 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.521852 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:01.741906 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 220147us
I20260709 13:07:01.711647 18705 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.426039 18905 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.728415 16612 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:01.408437 18884 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:01.732708 16544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.000s	sys 0.012s
I20260709 13:07:01.446154 18654 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:01.734081 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.734375 16611 raft_consensus.cc:606] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:07:01.786655 16611 raft_consensus.cc:614] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:01.735185 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.787451 16466 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:01.427012 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1592) took 1032 ms. Trace:
I20260709 13:07:01.707054 18912 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.735220 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:01.741333 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.799672 16469 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:01.800239 16545 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.713663 18664 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.438125 18906 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:01.760928 18896 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.704824 18807 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:01.434381 18919 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
W20260709 13:07:01.631865 18890 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.716s	user 0.003s	sys 0.007s
I20260709 13:07:01.780153 18851 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:01.791307 18933 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:01.514252 18918 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:01.432551 18888 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.742990 18923 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.793128 18705 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.794611 18646 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:01.795050 18059 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.511709 18818 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.795907 16467 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:01.797433 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:01.795876 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.805663 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:01.779935 18898 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:01.801002 18597 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:07:01.806198 18884 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:01.742847 18543 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.780151 18697 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:01.784258 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:01.807538 18562 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:01.732982 16619 rpcz_store.cc:276] 0709 13:07:00.151526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.151662 (+   136us) service_pool.cc:224] Handling call
0709 13:07:01.366579 (+1214917us) spinlock_profiling.cc:243] Waited 58.2 ms on lock 0x7b5400090454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:01.366694 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":133922560}
I20260709 13:07:01.813596 16545 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:01.813961 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 236044us
I20260709 13:07:01.743445 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.859795 16536 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.788648 16470 rpcz_store.cc:276] 0709 13:07:00.394777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.394881 (+   104us) service_pool.cc:224] Handling call
0709 13:07:00.395187 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:00.400835 (+  5648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.400868 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:00.401438 (+   570us) log.cc:844] Serialized 52 byte log entry
0709 13:07:00.446244 (+ 44806us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:00.487091 (+ 40847us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.487289 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.487354 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.308335 (+820981us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b1800069a00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:01.423294 (+114959us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b1800069a00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:01.426769 (+  3475us) raft_consensus.cc:1685] finished
0709 13:07:01.426789 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.426930 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":55129,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":34594,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":31808,"spinlock_wait_cycles":22109952,"thread_start_us":44416,"threads_started":1,"wal-append.queue_time_us":120469}
I20260709 13:07:01.821185 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.821064 16616 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:01.861644 16612 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.780283 18831 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:07:01.790364 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:01.825079 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 89915.6us
W20260709 13:07:01.825130 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44149.5us
I20260709 13:07:01.827545 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.862726 16611 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.741906 18722 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:07:01.819195 18906 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.837224 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.839941 18490 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.832146 18797 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.432555 18911 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.841357 16463 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:01.801119 18760 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:07:01.809546 18905 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:07:01.828791 18910 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:01.846153 17127 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:01.817201 18805 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:07:01.855830 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:01.829178 18890 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.840971 18918 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:01.868412 18935 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:01.946422 18818 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:01.843815 18898 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.868752 17126 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:01.869628 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.869612 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.958639 16537 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.959957 18908 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.870061 18705 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.961104 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:01.961030 18705 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.961690 16462 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.963079 18705 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.870579 18697 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.871364 18654 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:01.871918 18884 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.872893 18059 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.969985 18059 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.831732 18711 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:01.873914 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:01.971360 16470 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.874619 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:01.882923 16611 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:01.895608 16466 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
W20260709 13:07:01.830322 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 127628us
I20260709 13:07:01.974357 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:01.975871 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:01.975987 18910 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:01.823486 18896 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.864188 18831 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:01.867789 17121 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:01.936218 18809 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.931391 18490 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.932358 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:01.932682 18931 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:01.933758 18903 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.939440 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1773) took 1485 ms. Trace:
I20260709 13:07:01.939630 16543 raft_consensus.cc:2368] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:01.937680 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:01.990509 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52893.3us
I20260709 13:07:01.979266 18831 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.945739 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:01.991890 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 201745us
I20260709 13:07:01.948448 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.950496 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.988968 16612 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:01.947065 18898 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:01.965071 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.967875 16536 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:01.929574 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.978295 16537 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:01.981142 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.980475 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:02.000638 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.965041 18720 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.001576 16465 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:01.982905 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:01.939203 18912 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:07:01.993096 16468 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:01.958671 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:02.003032 16461 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.998359 16463 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:01.988529 16617 rpcz_store.cc:276] 0709 13:07:00.453930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.465787 (+ 11857us) service_pool.cc:224] Handling call
0709 13:07:00.501425 (+ 35638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.507892 (+  6467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.507925 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.508359 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:07:00.926653 (+418294us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:00.926701 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.926780 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.433780 (+507000us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:01.930531 (+496751us) raft_consensus.cc:1685] finished
0709 13:07:01.930559 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.939380 (+  8821us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81,"raft.queue_time_us":43514,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":218959,"spinlock_wait_cycles":7046400,"thread_start_us":383838,"threads_started":1,"wal-append.queue_time_us":459991}
I20260709 13:07:01.994443 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:01.912278 18797 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:01.976918 18562 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:02.008500 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:01.977372 18948 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:07:01.984993 18884 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:01.937428 18851 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.014967 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:02.097976 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:02.086115 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 213478us
I20260709 13:07:02.397311 16616 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:02.076756 16462 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:02.412477 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:02.016911 18059 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:02.398039 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:02.075467 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75364.6us
W20260709 13:07:02.429899 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 421464us
I20260709 13:07:02.421489 16461 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:02.435395 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:02.406458 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.208858 18888 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:02.437976 18888 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:02.438635 18888 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:02.439535 18888 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:02.422828 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 439972us
I20260709 13:07:02.208532 18911 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:02.088677 18941 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:02.399232 18908 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.443568 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1846) took 1021 ms. Trace:
I20260709 13:07:02.420699 16470 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:02.061569 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.982291 18818 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:02.435388 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:02.090854 16466 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:02.444046 16539 rpcz_store.cc:276] 0709 13:07:01.421984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.710086 (+288102us) service_pool.cc:224] Handling call
0709 13:07:01.710454 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.711074 (+   620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.711119 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.711760 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.841129 (+129369us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.841186 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.841273 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.443332 (+602059us) raft_consensus.cc:1685] finished
0709 13:07:02.443356 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.443506 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8089,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"thread_start_us":128834,"threads_started":1,"wal-append.queue_time_us":190214}
I20260709 13:07:02.398782 18809 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.436144 16612 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.078825 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:01.988638 18817 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.425s
I20260709 13:07:02.002298 17118 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:02.475239 16462 raft_consensus.cc:2410] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:02.000624 18924 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:02.098104 18939 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:01.999800 18905 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:02.544191 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:02.544834 16463 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.545569 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:02.479640 18896 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.480274 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:02.582098 16470 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:02.084818 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:02.273531 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1544) took 1427 ms. Trace:
I20260709 13:07:02.444824 16585 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:02.100656 18890 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:02.397805 18654 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:02.021514 18795 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:01.991588 18711 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:02.479920 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.027s
I20260709 13:07:02.340266 18923 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:02.489866 16614 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.509266 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:02.207885 18722 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:02.528023 18967 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:02.517460 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 81291.8us
I20260709 13:07:02.444171 18908 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:02.453696 18720 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:02.594839 18905 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:02.532572 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.012s
I20260709 13:07:02.528185 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:02.528944 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:02.088665 18904 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:02.434476 18179 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:07:02.162211 18800 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.542101 18597 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:02.183518 18889 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.546340 16468 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:02.181764 18944 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:07:02.574602 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:02.574942 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1834) took 1402 ms. Trace:
I20260709 13:07:02.462885 18562 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.579061 18807 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:02.530120 18705 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:02.579744 18809 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:02.447350 18949 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:07:02.584271 16615 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.593719 18962 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:07:02.583412 16467 rpcz_store.cc:276] 0709 13:07:00.845934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.846146 (+   212us) service_pool.cc:224] Handling call
0709 13:07:00.870831 (+ 24685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.844680 (+973849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.273229 (+428549us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:02.273453 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126951168}
I20260709 13:07:02.598474 16612 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:02.485268 18898 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.516228 18924 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.608558 16470 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.407003 18918 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:02.619356 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.000s	sys 0.028s
W20260709 13:07:02.892530 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.019s	sys 0.012s
I20260709 13:07:02.943885 18884 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:02.961656 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1792) took 1056 ms. Trace:
I20260709 13:07:02.962237 16612 rpcz_store.cc:276] 0709 13:07:01.905754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.435183 (+529429us) service_pool.cc:224] Handling call
0709 13:07:02.961588 (+526405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:02.949311 18809 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:02.945314 18795 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:02.963567 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:02.963627 18795 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.966640 18795 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.967456 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:02.968432 17121 raft_consensus.cc:2368] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:02.969938 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:02.971864 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:02.973142 17121 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:07:02.974803 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 529989us
I20260709 13:07:02.976317 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:02.947082 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:02.978065 17125 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:02.977423 18939 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.981606 18939 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:02.985529 18939 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:02.606259 18654 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:02.991170 17123 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.992261 18654 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:02.992866 18654 raft_consensus.cc:2764] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:02.692761 16545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.002s
W20260709 13:07:02.993793 16545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.008s	sys 0.006s
I20260709 13:07:02.949723 18705 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:02.994347 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:02.995287 18705 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:02.926720 18906 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.024s	user 0.001s	sys 0.012s
W20260709 13:07:02.926010 18831 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.909s	user 0.010s	sys 0.000s
I20260709 13:07:02.950702 18924 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.951016 16467 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:02.952975 18898 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.953202 16463 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:02.892064 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 925726us
I20260709 13:07:02.954757 18562 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.954597 18908 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:02.917330 18910 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.935s	user 0.010s	sys 0.000s
W20260709 13:07:02.714896 18543 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.002s
I20260709 13:07:02.955386 16617 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:07:02.870114 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.956131 18711 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:02.943671 18818 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:02.956662 18722 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.544286 18664 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.509763 18954 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:02.832387 18963 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:07:02.870306 18953 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
W20260709 13:07:02.944262 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 1.07012e+06us
I20260709 13:07:02.965715 16538 rpcz_store.cc:276] 0709 13:07:01.002442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.002625 (+   183us) service_pool.cc:224] Handling call
0709 13:07:01.003054 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.061745 (+ 58691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.061787 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:01.121243 (+ 59456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.625051 (+503808us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:01.625105 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.625197 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:02.107321 (+482124us) raft_consensus.cc:1685] finished
0709 13:07:02.107346 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:02.404343 (+296997us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110748,"raft.queue_time_us":139164,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":55698,"thread_start_us":452910,"threads_started":1,"wal-append.queue_time_us":693143}
I20260709 13:07:02.977388 18955 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.769331 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 356922us
I20260709 13:07:03.015799 18705 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.656311 18914 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:03.017335 18910 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:02.794672 18930 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:03.018203 18930 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.019829 18908 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:03.020429 18930 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:02.949106 18923 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:02.945681 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 376) took 1149 ms. Trace:
I20260709 13:07:03.071115 16615 rpcz_store.cc:276] 0709 13:07:01.796452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.583700 (+787248us) service_pool.cc:224] Handling call
0709 13:07:02.584062 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.945452 (+361390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.945631 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.016250 18664 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.073057 18907 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:03.074656 18664 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.002234 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.075579 17121 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:03.020699 18818 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.077279 16616 raft_consensus.cc:2410] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:03.022089 18954 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:03.022010 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:03.078660 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56713.5us
I20260709 13:07:02.996974 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:03.018210 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:03.079763 16612 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:03.080919 18945 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.082142 18884 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:03.025478 18490 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:03.022903 18831 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.072757 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:03.093096 17122 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.030925 18967 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.035516 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 338) took 1320 ms. Trace:
I20260709 13:07:03.035633 16614 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:03.096128 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 379) took 1272 ms. Trace:
I20260709 13:07:03.096570 16614 rpcz_store.cc:276] 0709 13:07:01.824007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.073418 (+249411us) service_pool.cc:224] Handling call
0709 13:07:03.096054 (+1022636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.097728 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:03.033672 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 57416.6us
I20260709 13:07:03.036875 16468 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:03.036985 18543 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.102384 18976 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:03.103726 18543 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:02.996974 18906 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.041267 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 489) took 1630 ms. Trace:
I20260709 13:07:03.105121 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:03.041823 18904 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:03.105882 18817 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.106338 18817 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.106595 18906 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:03.106679 18817 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.105383 17127 rpcz_store.cc:276] 0709 13:07:01.411264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.411633 (+   369us) service_pool.cc:224] Handling call
0709 13:07:03.041033 (+1629400us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54006851d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:03.041184 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339301760}
I20260709 13:07:03.044273 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 273) took 1094 ms. Trace:
I20260709 13:07:03.117436 16466 rpcz_store.cc:276] 0709 13:07:01.949523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.980162 (+ 30639us) service_pool.cc:224] Handling call
0709 13:07:03.044123 (+1063961us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b54002a76d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:03.044220 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209174400}
I20260709 13:07:03.046530 18800 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:03.046663 16619 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:03.122424 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 371) took 1383 ms. Trace:
I20260709 13:07:03.121950 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:03.122821 16619 rpcz_store.cc:276] 0709 13:07:01.738881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.046150 (+1307269us) service_pool.cc:224] Handling call
0709 13:07:03.046483 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.122137 (+ 75654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.122357 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.047247 18977 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.047516 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:02.945323 18720 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:03.126716 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 79293.7us
I20260709 13:07:03.051553 18905 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.004341 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 334) took 1290 ms. Trace:
W20260709 13:07:03.127480 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 89788.2us
W20260709 13:07:02.989077 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 275888us
I20260709 13:07:02.986333 18809 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.052521 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:07:03.129138 16611 raft_consensus.cc:606] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:03.129518 16611 raft_consensus.cc:614] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:03.017359 18914 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:02.945597 18886 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:02.987934 18597 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.054965 18889 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.044377 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 274) took 1094 ms. Trace:
I20260709 13:07:03.055460 18962 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.057665 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 547) took 1372 ms. Trace:
I20260709 13:07:03.140431 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50106 (request call id 8) took 1290 ms. Trace:
I20260709 13:07:03.063812 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:03.066673 18958 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.391s	user 0.010s	sys 0.003s
I20260709 13:07:03.146747 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:03.069948 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 130440us
I20260709 13:07:03.078703 18954 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:03.108204 18904 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:02.676986 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:03.147043 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:03.083945 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:03.084175 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 66051.6us
I20260709 13:07:03.083657 18490 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:03.088111 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:03.099444 16536 rpcz_store.cc:276] 0709 13:07:01.715209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.324538 (+609329us) service_pool.cc:224] Handling call
0709 13:07:02.325139 (+   601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.479414 (+154275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:02.952497 (+473083us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.025625 (+ 73128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.026176 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.026337 (+   161us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.026373 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.026442 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.035313 (+  8871us) raft_consensus.cc:1685] finished
0709 13:07:03.035336 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.035459 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":171671,"prepare.queue_time_us":472446,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":139442,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":46584,"thread_start_us":72568,"threads_started":1,"wal-append.queue_time_us":71555}
I20260709 13:07:03.020336 18722 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.098359 16614 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:03.125203 16585 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:03.049448 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.131747 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:03.167217 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:03.083814 18945 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.168071 17124 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:03.168638 18945 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.169872 18654 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.170276 18654 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.170585 18654 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.127727 16545 rpcz_store.cc:276] 0709 13:07:01.714265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.980208 (+265943us) service_pool.cc:224] Handling call
0709 13:07:01.980601 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:01.986458 (+  5857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:01.986501 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.026559 (+ 40058us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.994321 (+967762us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:02.994375 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:02.994442 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.004039 (+  9597us) raft_consensus.cc:1685] finished
0709 13:07:03.004066 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.004244 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51521,"raft.queue_time_us":5496,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":9321,"thread_start_us":829292,"threads_started":1,"wal-append.queue_time_us":916840}
I20260709 13:07:03.135932 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:03.139189 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:03.174823 16470 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:03.144116 17126 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.143695 16611 rpcz_store.cc:276] 0709 13:07:01.840009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.052351 (+1212342us) service_pool.cc:224] Handling call
0709 13:07:03.129908 (+ 77557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:03.148092 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:03.082463 18059 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.176467 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:03.177028 18059 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:03.151371 16434 leader_election.cc:400] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:03.178028 16434 leader_election.cc:403] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.132222 18939 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.136411 16465 rpcz_store.cc:276] 0709 13:07:01.949794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.017188 (+ 67394us) service_pool.cc:224] Handling call
0709 13:07:02.017518 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.073541 (+ 56023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.073578 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.074145 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 13:07:02.718205 (+644060us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.043863 (+325658us) log.cc:844] Serialized 14 byte log entry
0709 13:07:03.044086 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.044154 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:03.044191 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:03.044202 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.044311 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":326940,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":73660,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":179,"thread_start_us":317613,"threads_started":1,"wal-append.queue_time_us":913352}
I20260709 13:07:03.169327 18797 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:03.177568 18059 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.154675 16467 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:03.136337 18179 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.162737 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:03.136085 18886 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:03.184966 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 96913.8us
I20260709 13:07:03.190378 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:03.139988 18962 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:03.184490 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:03.131889 18923 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:07:03.187805 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:03.188833 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:03.194674 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 43524.1us
I20260709 13:07:03.203173 16464 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:03.131733 18908 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:07:03.203341 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:03.187402 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:03.211781 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:03.212590 16615 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:03.196103 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.212333 16434 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:03.213727 16619 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:03.216032 17126 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:03.217190 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:03.165657 18490 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.153501 18711 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:03.179987 18939 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:03.188313 18890 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.275799 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:03.179672 18907 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:03.270964 17125 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:03.202263 18543 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.201154 18179 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:03.285347 18991 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.213310 18705 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:03.201807 18904 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:03.284564 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:03.286194 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:03.341009 16615 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.219362 18884 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.188885 18910 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:07:03.335464 18059 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.194015 18795 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:07:03.278501 18831 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.188539 18851 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:07:03.271772 18905 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:03.271936 18809 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:03.353663 16510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.002s	sys 0.012s
I20260709 13:07:03.353791 18884 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.353964 18059 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.354737 18972 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:03.357316 18910 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.357849 18910 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:03.287207 18543 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:03.358486 18543 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.358685 18910 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.359977 18910 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:03.348160 18646 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:03.363149 18646 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.281383 18797 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:03.135877 18977 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:03.272058 18930 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:03.143260 17118 rpcz_store.cc:276] 0709 13:07:01.685421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.685599 (+   178us) service_pool.cc:224] Handling call
0709 13:07:01.686038 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.528571 (+842533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.057397 (+528826us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b5400551754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:03.057599 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675567872}
I20260709 13:07:03.347993 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:03.354086 16510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.003s	sys 0.012s
W20260709 13:07:03.410483 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 125985us
I20260709 13:07:03.283816 18907 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:03.420258 17125 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:03.344347 18904 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:03.283447 18807 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:07:03.429880 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.287300 18805 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:03.414177 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.415297 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.286677 18715 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.342043 18890 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:03.422360 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.424067 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.387658 18903 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.278085 18939 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.421931 18907 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:03.394260 16615 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:03.427564 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.431806 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.433292 16538 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:03.366374 18905 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:03.437577 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 164034us
I20260709 13:07:03.438123 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.460704 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.461022 16537 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:03.427024 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.426213 18597 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.427227 16543 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:03.337280 18886 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.342159 18991 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:03.347950 18962 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.464195 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.429039 18904 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:03.587800 17122 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
W20260709 13:07:03.505657 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 293345us
I20260709 13:07:03.688251 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:03.508669 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.665493 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:03.514743 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 242963us
I20260709 13:07:03.661720 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:03.733098 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.630564 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 372) took 1891 ms. Trace:
I20260709 13:07:03.733817 16536 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:03.734946 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 322891us
I20260709 13:07:03.507535 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.424293 18930 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:03.736888 16542 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:03.745285 16545 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:03.430447 18955 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:03.617673 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:03.851212 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.854068 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:03.855515 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:03.855767 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.438192 18805 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.852933 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:03.856524 16619 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:03.850142 16617 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:03.857997 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.858687 16544 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:03.859269 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:03.673513 18982 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:07:03.433925 18797 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.860203 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:03.594595 18903 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:04.033294 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:03.960424 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.014s	sys 0.016s
I20260709 13:07:03.875097 16536 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:03.899251 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.035264 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1619) took 1084 ms. Trace:
I20260709 13:07:04.029677 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.035598 16539 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.035702 16619 rpcz_store.cc:276] 0709 13:07:02.951295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.629287 (+677992us) service_pool.cc:224] Handling call
0709 13:07:04.035203 (+405916us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.036116 16537 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.001214 16466 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:03.963429 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:03.964980 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.861224 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:03.860724 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:04.048213 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.016s	sys 0.017s
I20260709 13:07:04.048619 16470 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:07:04.049031 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 196140us
I20260709 13:07:03.507882 18795 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:03.667169 18809 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:03.849386 16618 rpcz_store.cc:276] 0709 13:07:01.739104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.562974 (+1823870us) service_pool.cc:224] Handling call
0709 13:07:03.629576 (+ 66602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.630034 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.630096 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.630185 (+    89us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.630294 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.630363 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:03.630489 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:03.899636 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 44567.5us
W20260709 13:07:03.684017 18986 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:07:03.859797 18886 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.102077 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:03.674288 18957 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:03.981056 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:03.692451 18654 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.002s
W20260709 13:07:03.941282 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.694620 18851 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:03.601464 18760 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:03.672063 18914 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:03.689066 17118 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:07:04.056509 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.050560 16545 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:04.050817 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1608) took 1573 ms. Trace:
I20260709 13:07:04.058104 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:03.963541 18962 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:04.050383 16616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1605) took 1614 ms (client timeout 1665 ms). Trace:
I20260709 13:07:03.679306 18912 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:04.108615 18888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.622s	user 0.019s	sys 0.040s
W20260709 13:07:03.731992 18945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.009s	sys 0.017s
I20260709 13:07:03.852150 18722 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.029973 18997 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:03.759788 18905 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.099735 16537 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:04.098263 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.124270 16542 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:07:04.094848 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.030097 18720 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:03.656993 18646 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:03.673045 18977 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:03.626822 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:03.996348 18543 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.003s
I20260709 13:07:03.594089 18923 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.055933 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:04.159835 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:03.591720 18715 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:04.118726 18912 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.560213 18807 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.996155 18831 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.173482 16542 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:03.899681 18996 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.051880 16465 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:03.695849 18490 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.560015 18924 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.050040 18994 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.112792 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.180452 16545 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.184162 16466 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:04.114171 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.188287 16618 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:04.113031 16617 rpcz_store.cc:276] 0709 13:07:02.477644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.076986 (+599342us) service_pool.cc:224] Handling call
0709 13:07:03.688046 (+611060us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:04.050751 (+362705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15049984}
I20260709 13:07:03.626956 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:04.110574 17118 pending_rounds.cc:85] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 4
I20260709 13:07:04.193921 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.093938 19004 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.052413 18805 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.119588 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:04.118294 16616 rpcz_store.cc:269] 0709 13:07:02.435459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.480864 (+ 45405us) service_pool.cc:224] Handling call
0709 13:07:04.038445 (+1557581us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54000a05d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:04.050321 (+ 11876us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300849536}
I20260709 13:07:04.196281 16619 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:04.111943 18760 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.196950 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.163146 19007 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.618394 18817 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:04.029147 18911 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:07:04.107191 18957 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:03.602236 18179 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:04.121630 18888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.637s	user 0.019s	sys 0.041s
I20260709 13:07:04.114626 18914 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:04.163203 18543 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:04.123221 18945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.013s	sys 0.024s
I20260709 13:07:04.099911 18795 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:04.122319 18908 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.023s	sys 0.030s
I20260709 13:07:04.160781 16538 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:03.684248 18890 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:03.959707 18948 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:04.109819 18654 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:03.642059 18884 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.110419 18851 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.148550 19002 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:04.190330 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.190482 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.191684 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1611) took 1659 ms. Trace:
W20260709 13:07:03.681589 18989 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:04.178938 16537 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.195070 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.276592 16618 rpcz_store.cc:276] 0709 13:07:02.532128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.102379 (+1570251us) service_pool.cc:224] Handling call
0709 13:07:04.191599 (+ 89220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.277151 16466 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:04.277915 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.278169 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:04.279402 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.279544 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:04.280534 16466 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:04.205150 16610 raft_consensus.cc:2368] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:04.132819 18722 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.173674 18807 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:04.108117 18898 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.216284 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.297230 16617 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:04.195461 17118 pending_rounds.cc:107] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:07:04.114645 18930 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.195776 17119 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:04.223372 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.222693 19007 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.122840 18809 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.300525 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:04.237375 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 256363us
I20260709 13:07:04.111726 18999 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:04.245961 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.166980 18923 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.309137 18818 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.310333 18923 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.181547 18831 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.312463 18831 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.258901 16461 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 13:07:04.313198 18993 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.700s	user 0.000s	sys 0.003s
I20260709 13:07:04.314092 18760 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.314257 16544 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.315097 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.315912 16611 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:04.316026 18910 consensus_meta.cc:287] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.956s	user 0.003s	sys 0.009s
I20260709 13:07:04.316322 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1799) took 1115 ms. Trace:
I20260709 13:07:04.235064 18490 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.316745 16611 rpcz_store.cc:276] 0709 13:07:03.200678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.314830 (+1114152us) service_pool.cc:224] Handling call
0709 13:07:04.316264 (+  1434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.317483 18654 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.317792 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.298997 18957 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.318625 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1632) took 1175 ms. Trace:
I20260709 13:07:04.318908 18957 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.319011 16611 rpcz_store.cc:276] 0709 13:07:03.143072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.317563 (+1174491us) service_pool.cc:224] Handling call
0709 13:07:04.318568 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.320065 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.300633 17118 raft_consensus.cc:2889] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:04.254956 17120 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:04.320897 18999 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.321404 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.322268 16613 raft_consensus.cc:2368] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:04.322662 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1609) took 1833 ms. Trace:
I20260709 13:07:04.322975 16613 rpcz_store.cc:276] 0709 13:07:02.489327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.321175 (+1831848us) service_pool.cc:224] Handling call
0709 13:07:04.322605 (+  1430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.323669 18999 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.235571 18912 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.192924 18996 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.263893 16462 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:04.175124 18797 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.323791 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.326689 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1629) took 1196 ms. Trace:
I20260709 13:07:04.326929 19007 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.327044 16613 rpcz_store.cc:276] 0709 13:07:03.129759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.323585 (+1193826us) service_pool.cc:224] Handling call
0709 13:07:04.326611 (+  3026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.175441 18903 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.301208 18898 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.328186 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.329495 18898 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:04.268241 16433 connection.cc:256] RPC call timeout handler was delayed by -1.5002849459999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:07:04.330436 16433 connection.cc:256] RPC call timeout handler was delayed by -1.2749662960000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
I20260709 13:07:04.331312 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1801) took 1129 ms. Trace:
I20260709 13:07:04.331686 16613 rpcz_store.cc:276] 0709 13:07:03.201698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.327945 (+1126247us) service_pool.cc:224] Handling call
0709 13:07:04.331254 (+  3309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.271872 16539 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:04.320645 16611 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:07:04.257236 18908 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.023s	sys 0.031s
W20260709 13:07:04.274252 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.317515 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1617) took 1188 ms. Trace:
I20260709 13:07:04.203583 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1613) took 1602 ms. Trace:
I20260709 13:07:04.334228 16619 rpcz_store.cc:276] 0709 13:07:02.600821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.106116 (+1505295us) service_pool.cc:224] Handling call
0709 13:07:04.203513 (+ 97397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.282572 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.285619 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.335557 16538 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:04.334003 16468 rpcz_store.cc:276] 0709 13:07:03.129459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.129869 (+   410us) service_pool.cc:224] Handling call
0709 13:07:03.130141 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.134674 (+  4533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.134706 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.135168 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.190527 (+ 55359us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:03.190589 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.190689 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.317337 (+1126648us) raft_consensus.cc:1685] finished
0709 13:07:04.317357 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.317460 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18520,"raft.queue_time_us":7121,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":7020,"thread_start_us":54896,"threads_started":1,"wal-append.queue_time_us":292445}
I20260709 13:07:04.324685 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1610) took 1782 ms. Trace:
I20260709 13:07:04.333353 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1627) took 1306 ms. Trace:
I20260709 13:07:04.337862 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.340957 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1628) took 1313 ms. Trace:
I20260709 13:07:04.341437 16613 rpcz_store.cc:276] 0709 13:07:03.027408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.337621 (+1310213us) service_pool.cc:224] Handling call
0709 13:07:04.340878 (+  3257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.261535 18948 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.213758 19004 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.298089 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.300030 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1631) took 1164 ms. Trace:
I20260709 13:07:04.232169 16545 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:04.237624 18715 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:04.303797 16616 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:04.356629 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1615) took 1406 ms. Trace:
I20260709 13:07:04.303779 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:04.268868 18945 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:04.305215 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:04.306042 18817 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.306898 18795 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.307708 18851 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.321519 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 499) took 1157 ms. Trace:
I20260709 13:07:04.262586 16536 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:04.324656 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 548) took 2638 ms. Trace:
I20260709 13:07:04.325101 18912 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:04.330173 16618 raft_consensus.cc:2368] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:04.373100 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.374002 16539 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.370635 17123 rpcz_store.cc:276] 0709 13:07:01.685890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.686305 (+   415us) service_pool.cc:224] Handling call
0709 13:07:01.686623 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.991682 (+1305059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.324409 (+1332727us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400610154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:04.324571 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2999523712}
I20260709 13:07:04.287292 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:04.343274 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:04.342711 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.349691 16615 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:04.337656 16469 rpcz_store.cc:276] 0709 13:07:02.542130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.544757 (+  2627us) service_pool.cc:224] Handling call
0709 13:07:02.545072 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.113044 (+567972us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.113094 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.113156 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.113207 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.324474 (+1211267us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b5400263254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:04.324522 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.324629 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1305518848}
I20260709 13:07:04.316566 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.353168 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.360071 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.414602 16463 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.286253 19002 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.414887 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.353739 16617 rpcz_store.cc:276] 0709 13:07:03.135804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.193518 (+1057714us) service_pool.cc:224] Handling call
0709 13:07:04.299961 (+106443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.414953 16544 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:04.377362 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1623) took 1425 ms. Trace:
I20260709 13:07:04.339569 16611 rpcz_store.cc:276] 0709 13:07:03.027166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.319838 (+1292672us) service_pool.cc:224] Handling call
0709 13:07:04.333300 (+ 13462us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.460145 16618 rpcz_store.cc:276] 0709 13:07:02.952387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.285602 (+1333215us) service_pool.cc:224] Handling call
0709 13:07:04.377280 (+ 91678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.357110 16616 rpcz_store.cc:276] 0709 13:07:02.950204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.196250 (+1246046us) service_pool.cc:224] Handling call
0709 13:07:04.356580 (+160330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:04.459604 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 117099us
W20260709 13:07:04.458415 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 154678us
I20260709 13:07:04.460856 16541 raft_consensus.cc:2376] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 6. Re-sending same reply.
I20260709 13:07:04.462138 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:04.352449 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 498) took 1198 ms. Trace:
I20260709 13:07:04.464155 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:04.462760 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.459993 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.465095 16541 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:04.370159 17120 rpcz_store.cc:276] 0709 13:07:03.164566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.271929 (+107363us) service_pool.cc:224] Handling call
0709 13:07:04.321447 (+1049518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.350971 18898 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:04.464428 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.466939 18898 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.468989 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:04.469465 16465 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:04.353060 18948 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:04.457685 18904 consensus_meta.cc:287] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:07:04.472049 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.470491 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.369619 18760 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.459335 16619 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:04.472821 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.463089 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.455767 19004 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.373085 18945 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.501205 16463 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:04.521857 16539 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:04.522939 18889 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.523340 18889 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:04.523799 18945 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.484824 18924 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.524348 18795 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.464903 17119 rpcz_store.cc:276] 0709 13:07:03.152588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.219040 (+ 66452us) service_pool.cc:224] Handling call
0709 13:07:04.350917 (+1131877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.525123 18562 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.525537 18562 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:04.469077 18831 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:04.526475 18562 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.473451 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.378659 18991 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.527799 16616 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:04.528258 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1798) took 1328 ms. Trace:
I20260709 13:07:04.492220 18904 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.485252 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.470566 18911 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:04.537720 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.528535 16616 rpcz_store.cc:276] 0709 13:07:03.200357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.461851 (+1261494us) service_pool.cc:224] Handling call
0709 13:07:04.528210 (+ 66359us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:04.504499 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.491273 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.543061 16611 raft_consensus.cc:2410] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:04.543397 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1607) took 2089 ms. Trace:
I20260709 13:07:04.543629 16611 rpcz_store.cc:276] 0709 13:07:02.475326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.470132 (+1994806us) service_pool.cc:224] Handling call
0709 13:07:04.543356 (+ 73224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.544266 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.482739 16617 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:04.544997 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1794) took 1346 ms. Trace:
I20260709 13:07:04.545234 16617 rpcz_store.cc:276] 0709 13:07:03.198855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.459209 (+1260354us) service_pool.cc:224] Handling call
0709 13:07:04.544958 (+ 85749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.545830 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1796) took 1346 ms. Trace:
I20260709 13:07:04.546092 16619 rpcz_store.cc:276] 0709 13:07:03.199585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.334918 (+1135333us) service_pool.cc:224] Handling call
0709 13:07:04.545789 (+210871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.471589 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.537837 18904 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.541863 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1635) took 1272 ms. Trace:
I20260709 13:07:04.549177 16618 rpcz_store.cc:276] 0709 13:07:03.269920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.460746 (+1190826us) service_pool.cc:224] Handling call
0709 13:07:04.541807 (+ 81061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.550730 16462 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:04.551836 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1800) took 1343 ms. Trace:
I20260709 13:07:04.552181 16611 rpcz_store.cc:276] 0709 13:07:03.201043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.544096 (+1343053us) service_pool.cc:224] Handling call
0709 13:07:04.544734 (+   638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.555181 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1804) took 1275 ms. Trace:
I20260709 13:07:04.561940 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1398) took 1148 ms. Trace:
I20260709 13:07:04.562780 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.563488 16462 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.562417 16543 rpcz_store.cc:276] 0709 13:07:03.413765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.414762 (+   997us) service_pool.cc:224] Handling call
0709 13:07:03.426785 (+ 12023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.427081 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:04.291574 (+864493us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.561601 (+270027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.561648 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:04.561706 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.561765 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.561874 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5895,"thread_start_us":219077,"threads_started":1}
I20260709 13:07:04.563824 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:04.555584 16613 rpcz_store.cc:276] 0709 13:07:03.283202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.343230 (+1060028us) service_pool.cc:224] Handling call
0709 13:07:04.555127 (+211897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.524185 18889 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.565065 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.573401 18889 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.565912 16543 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.565972 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.569252 18967 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.576170 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.458858 18807 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.578159 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.579752 18722 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.580480 18795 raft_consensus.cc:2764] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:04.581367 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1621) took 1445 ms. Trace:
I20260709 13:07:04.578706 16618 raft_consensus.cc:2410] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:04.582317 16462 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:04.583084 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.581880 16461 rpcz_store.cc:276] 0709 13:07:03.136254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.137541 (+  1287us) service_pool.cc:224] Handling call
0709 13:07:03.155391 (+ 17850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.313196 (+1157805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.581068 (+267872us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003570d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:04.581291 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2537109376}
I20260709 13:07:04.584146 16613 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:04.584736 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:04.587213 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 254818us
I20260709 13:07:04.561882 18911 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:04.557289 18543 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:04.581868 18907 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.000s
W20260709 13:07:04.648137 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 63521.5us
I20260709 13:07:04.691833 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:04.619925 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.683759 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.621658 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.598006 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1617) took 1647 ms. Trace:
I20260709 13:07:04.699941 16618 rpcz_store.cc:276] 0709 13:07:02.950695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.553657 (+1602962us) service_pool.cc:224] Handling call
0709 13:07:04.597933 (+ 44276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:04.626660 16542 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:04.611491 16470 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:04.650504 16461 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.620353 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.653344 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:04.631958 19021 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:04.622205 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:04.640630 18962 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.000s
W20260709 13:07:04.588629 18954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.015s	sys 0.015s
W20260709 13:07:04.704365 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.703948 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50690.7us
I20260709 13:07:04.721131 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.721916 16614 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:04.721978 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:04.635460 18939 consensus_meta.cc:287] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.077s	user 0.002s	sys 0.008s
I20260709 13:07:04.697180 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.709832 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.711618 16612 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:04.690158 18646 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.714283 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:04.725937 17126 raft_consensus.cc:2368] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:04.586947 18898 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.727151 18851 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.625738 18807 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.727599 18851 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:04.722889 18939 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.727983 18851 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.729135 18787 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.729393 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.729605 18939 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.589310 18896 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:04.701586 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.723778 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.589506 18961 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:04.724052 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1620) took 1772 ms (client timeout 1710 ms). Trace:
I20260709 13:07:04.636114 19002 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:04.703456 18886 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.005s
I20260709 13:07:04.724524 16468 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:04.695508 18976 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.712314 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.646091 18805 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.619493 18597 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.743076 18597 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:04.743966 18597 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.745529 17123 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:04.745399 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:04.726533 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:04.730026 16538 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:04.730656 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:04.695984 18991 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:04.699254 18924 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.732035 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.725898 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.734570 18562 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:04.735687 16612 rpcz_store.cc:269] 0709 13:07:02.951551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.080469 (+128918us) service_pool.cc:224] Handling call
0709 13:07:04.622060 (+1541591us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:04.723962 (+101902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7240064}
I20260709 13:07:04.761101 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:04.724704 18954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.018s	sys 0.015s
I20260709 13:07:04.738477 16613 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:04.644953 18905 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.774994 18905 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.775815 16541 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:04.734728 18646 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:04.778738 18646 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.756932 18945 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:04.784624 16467 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:07:04.720274 18817 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.740155 18976 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.736048 18961 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.753505 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:04.754372 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:04.733659 18912 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.753561 19002 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:07:04.736407 18898 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:04.770231 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.791951 16538 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:04.799405 16612 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:04.770758 18490 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:04.764097 18795 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:04.704597 18907 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.772907 18805 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:04.773097 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.795083 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.765144 18654 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:04.772626 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:04.800700 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:04.845268 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44680.3us
I20260709 13:07:04.804095 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.847059 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:04.735319 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:04.798324 18961 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.808389 18646 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:04.810176 18907 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:04.810652 16539 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:04.789976 18817 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:04.813108 18923 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:04.764940 18904 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:04.814008 18976 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:04.765362 18924 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.804641 18908 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:04.816557 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:04.816272 16618 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:04.817533 18888 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.740127 18911 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.816174 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.818684 17120 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:04.801030 18898 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.832479 19002 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:04.759481 18991 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:04.834322 18654 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:04.835103 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:04.836716 18906 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:04.838425 16544 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:05.017976 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.040263 16614 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:05.040115 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 325353us
I20260709 13:07:04.899968 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:05.003206 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.047542 16542 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.017061 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.045674 16538 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:04.920293 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:05.048629 16611 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:05.047447 17090 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:04.922210 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.067624 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.015726 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:05.070254 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:05.081000 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.048513 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:05.048893 16616 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:05.088074 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1616) took 2137 ms. Trace:
I20260709 13:07:05.088543 16616 rpcz_store.cc:276] 0709 13:07:02.950466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.919911 (+1969445us) service_pool.cc:224] Handling call
0709 13:07:05.087976 (+168065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.089700 16616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:07:05.090392 16616 raft_consensus.cc:606] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:07:05.090790 16616 raft_consensus.cc:614] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:05.091339 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50106 (request call id 9) took 1803 ms. Trace:
I20260709 13:07:05.091693 16616 rpcz_store.cc:276] 0709 13:07:03.287518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.089517 (+1801999us) service_pool.cc:224] Handling call
0709 13:07:05.091236 (+  1719us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:04.941002 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.849184 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:04.848186 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.046111 17124 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:05.055334 18898 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.101929 19037 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:05.105044 19037 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:05.106130 19037 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.107139 18851 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.108155 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.108610 18924 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.008307 18562 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.045439 18906 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:05.108785 16545 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:04.964823 18939 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.105094 18889 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:05.118983 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70544.6us
I20260709 13:07:05.102262 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.119565 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:05.119998 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1624) took 2167 ms. Trace:
I20260709 13:07:05.110606 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:05.120528 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 347953us
I20260709 13:07:05.120316 16614 rpcz_store.cc:276] 0709 13:07:02.952645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.100819 (+2148174us) service_pool.cc:224] Handling call
0709 13:07:05.119931 (+ 19112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.121556 16617 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:05.109634 16613 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:05.112007 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48505.5us
W20260709 13:07:05.112594 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 96988.9us
I20260709 13:07:05.123154 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.123518 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.123718 17126 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:05.123874 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:05.104367 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 255256us
W20260709 13:07:05.114022 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.040352 18654 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:05.039741 19002 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:04.922008 18945 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.032927 18884 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.145949 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:05.125752 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.147146 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:05.120467 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:04.881855 18795 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:05.148980 18795 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.148802 18898 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.149282 19038 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.149371 18795 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.149830 19038 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.150249 19038 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.151618 18898 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:05.152227 18898 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:05.055507 18817 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:05.156165 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.130010 16614 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.157235 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1618) took 2206 ms. Trace:
I20260709 13:07:05.157593 16614 rpcz_store.cc:276] 0709 13:07:02.951014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.121862 (+2170848us) service_pool.cc:224] Handling call
0709 13:07:05.129783 (+  7921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.156979 (+ 27196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.157171 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.160723 18898 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.161368 18898 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.046599 18646 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:05.169315 18957 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.169436 18646 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.169808 18957 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.171810 18957 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.174352 19033 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.174876 19033 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.118242 18805 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.136133 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1634) took 1941 ms. Trace:
I20260709 13:07:05.100313 18797 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:05.177158 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.177337 18797 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:05.178232 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.178328 18797 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.109275 18910 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.179418 18910 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.109308 18562 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.132761 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:05.127488 18889 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.181337 18889 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.181406 18910 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.182049 18910 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.182173 18562 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.182518 18910 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:05.182775 18562 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.183274 18562 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:05.183378 18910 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.184087 18562 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.142050 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.142797 16434 leader_election.cc:400] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:04.844010 18948 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.109095 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1568) took 1171 ms. Trace:
I20260709 13:07:05.195636 16462 rpcz_store.cc:276] 0709 13:07:03.937547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.583381 (+645834us) service_pool.cc:224] Handling call
0709 13:07:04.660341 (+ 76960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.696049 (+ 35708us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:04.724232 (+ 28183us) log.cc:844] Serialized 14 byte log entry
0709 13:07:05.016205 (+291973us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.016829 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.017005 (+   176us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.017061 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.017156 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.108897 (+ 91741us) raft_consensus.cc:1685] finished
0709 13:07:05.108915 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.109031 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35128,"prepare.queue_time_us":29045,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":239396,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":53272,"thread_start_us":91133,"threads_started":1,"wal-append.queue_time_us":368700}
I20260709 13:07:05.197813 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:05.057751 18904 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.166422 18991 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.134176 18939 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.167487 18490 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.178972 16545 raft_consensus.cc:2410] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:05.138532 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.138355 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.059058 18888 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.137218 19014 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:07:05.185045 16617 rpcz_store.cc:276] 0709 13:07:03.195156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.080537 (+1885381us) service_pool.cc:224] Handling call
0709 13:07:05.136030 (+ 55493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.186437 16614 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.109165 18851 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.140432 18906 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.187252 16434 leader_election.cc:403] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.193740 16538 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:05.187213 16465 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
W20260709 13:07:05.186461 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59863.6us
I20260709 13:07:05.200814 16542 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:05.215395 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.176594 18646 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.229429 18948 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.229984 16463 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.231557 16611 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:05.175360 18654 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.244297 18961 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.332237 16545 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.332881 18961 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:05.237023 19002 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.333837 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:05.334440 17124 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:05.359030 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:05.359663 16617 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.360563 16436 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:05.184986 18890 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:05.231884 17120 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:05.283246 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.336910 18888 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:05.257124 16613 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:05.337713 18646 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:05.339439 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 523726us
W20260709 13:07:05.342409 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 199736us
I20260709 13:07:05.349890 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:05.369801 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.323724 18991 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.391634 18991 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.392123 18991 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.392279 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.370883 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:05.373121 18954 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.374195 18654 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.381430 18957 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:05.396404 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:05.396726 18957 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.357002 18896 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8.
I20260709 13:07:05.398744 18896 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.399226 18896 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:05.387195 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:05.407334 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.388902 17123 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.389482 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 557) took 2294 ms. Trace:
I20260709 13:07:05.402603 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:05.399659 18896 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.231710 18904 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:05.409158 17122 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.409546 16582 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.411007 16537 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.407981 17125 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:05.323336 18898 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.355756 18948 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.425217 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 304808us
I20260709 13:07:05.425871 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1626) took 1566 ms. Trace:
I20260709 13:07:05.426235 16467 rpcz_store.cc:276] 0709 13:07:03.859528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.860452 (+   924us) service_pool.cc:224] Handling call
0709 13:07:03.962954 (+102502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.790518 (+827564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.425614 (+635096us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002a7bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:05.425798 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888895872}
I20260709 13:07:05.363224 18890 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.428191 16585 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.424353 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.436378 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.436755 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:05.437335 16467 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.356179 18490 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:05.435087 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.416582 18654 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.366423 18939 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.430334 18890 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:05.458422 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.459466 17123 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:05.367902 18817 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.445020 17122 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:05.463316 16617 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:05.458505 18797 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.440835 18646 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.442440 19002 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.496409 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.497076 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.497980 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.499231 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.475922 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.430004 18948 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.501017 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.502422 16467 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:05.502592 16545 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:05.430197 19038 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.510321 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.466094 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.466970 18654 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:05.513780 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.462818 19044 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:05.469204 18939 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:05.533119 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1413) took 1875 ms. Trace:
I20260709 13:07:05.494029 18646 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:05.533524 16536 rpcz_store.cc:276] 0709 13:07:03.657540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.056201 (+398661us) service_pool.cc:224] Handling call
0709 13:07:05.532955 (+1476754us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001aac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:05.533053 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348835712}
I20260709 13:07:05.515018 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.534835 16545 raft_consensus.cc:2376] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3. Re-sending same reply.
I20260709 13:07:05.535676 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:05.535858 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 77758.1us
I20260709 13:07:05.500538 16617 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:05.536581 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:05.536939 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:05.512167 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:05.514564 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:05.521100 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.537715 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:05.538198 16538 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.537894 16467 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.464563 19045 raft_consensus.cc:2764] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:05.545466 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:05.546005 16545 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.550376 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:05.551074 16617 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.534116 16434 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:05.559023 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.559530 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:05.501801 18851 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:07:05.558553 18908 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.575984 18908 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.502128 18797 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.533977 19044 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:05.580116 16545 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:05.585363 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1869) took 1253 ms. Trace:
I20260709 13:07:05.585897 16537 rpcz_store.cc:276] 0709 13:07:04.332024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.627362 (+295338us) service_pool.cc:224] Handling call
0709 13:07:04.627689 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.414979 (+787290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.585143 (+170164us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400380c54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:05.585306 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800817920}
W20260709 13:07:05.586472 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 225956us
I20260709 13:07:05.587431 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:05.536334 18646 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:05.589330 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.585383 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.593811 16617 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:05.587065 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:05.511436 18991 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.562451 19034 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:07:05.597730 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52107.4us
I20260709 13:07:05.561398 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:05.602399 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.572793 18898 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:05.611032 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.607999 16467 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:05.598796 16545 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:07:05.558746 18939 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:05.612326 16545 pending_rounds.cc:85] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 5
I20260709 13:07:05.613933 16545 pending_rounds.cc:107] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 7.6
W20260709 13:07:05.612694 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 121099us
I20260709 13:07:05.614286 16545 raft_consensus.cc:2889] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.618412 16585 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.633867 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:05.635239 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:05.573119 19047 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:07:05.599925 19034 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.610386 19056 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.532907 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 346) took 1033 ms. Trace:
I20260709 13:07:05.611353 18898 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:05.711887 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.545218 18898 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.186515 19033 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:06.533006 16538 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.993s	user 0.004s	sys 0.003s
W20260709 13:07:06.490896 18851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.025s	sys 0.046s
I20260709 13:07:06.546316 16538 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:05.597807 18910 raft_consensus.cc:2764] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:06.547160 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.898710 18597 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.654616 18904 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.689079 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.544078 19034 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.548156 18904 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.549311 17127 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.547181 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1880) took 1049 ms. Trace:
I20260709 13:07:05.781796 18490 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:06.550961 16538 rpcz_store.cc:276] 0709 13:07:05.497937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.520808 (+ 22871us) service_pool.cc:224] Handling call
0709 13:07:06.547127 (+1026319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.730562 18962 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.840s
I20260709 13:07:06.025797 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:05.813623 18889 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260709 13:07:05.598989 19037 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:06.180423 18884 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.552876 18889 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.662600 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:06.041215 18976 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:06.553996 18976 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:06.554185 17119 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:05.906395 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 288030us
I20260709 13:07:05.704733 18945 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:06.555419 18945 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:05.701768 19054 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.544524 19056 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:05.637427 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.556314 18945 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:06.546841 18851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.028s	sys 0.047s
I20260709 13:07:06.557492 18945 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.557086 19056 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.558667 19049 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:06.559120 19049 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:06.559907 19049 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.594832 19044 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.172034 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.560982 19049 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.561457 16466 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:06.041970 16613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1818) took 1487 ms (client timeout 1898 ms). Trace:
W20260709 13:07:06.563136 16613 rpcz_store.cc:269] 0709 13:07:04.554732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.767139 (+212407us) service_pool.cc:224] Handling call
0709 13:07:06.041762 (+1274623us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002350d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.041913 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697032960}
I20260709 13:07:06.564492 16613 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:05.654189 19051 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:07:06.565099 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1803) took 3292 ms. Trace:
I20260709 13:07:06.189596 18906 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.969059 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1816) took 1598 ms. Trace:
I20260709 13:07:06.566380 16611 rpcz_store.cc:276] 0709 13:07:04.370281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.067801 (+697520us) service_pool.cc:224] Handling call
0709 13:07:05.968838 (+901037us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54003e7454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:05.968981 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357506304}
I20260709 13:07:06.328083 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1574) took 2196 ms. Trace:
I20260709 13:07:06.543670 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1793) took 3345 ms. Trace:
I20260709 13:07:06.567819 16461 rpcz_store.cc:276] 0709 13:07:04.131343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.734683 (+603340us) service_pool.cc:224] Handling call
0709 13:07:04.738420 (+  3737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.807197 (+ 68777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.807227 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.846988 (+ 39761us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.062982 (+215994us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:05.063025 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.299534 (+1236509us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54002a76d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:06.299598 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.299671 (+    73us) raft_consensus.cc:1685] finished
0709 13:07:06.299691 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.327989 (+ 28298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53872,"raft.queue_time_us":62018,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":225,"spinlock_wait_cycles":33081728,"thread_start_us":95353,"threads_started":1,"wal-append.queue_time_us":429254,"wal-append.run_cpu_time_us":1893,"wal-append.run_wall_time_us":1135616}
I20260709 13:07:06.568578 16617 rpcz_store.cc:276] 0709 13:07:03.198441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.645255 (+2446814us) service_pool.cc:224] Handling call
0709 13:07:05.681213 (+ 35958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.681471 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.681523 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.681581 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:05.681642 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.681720 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.543610 (+861890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.569860 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.570053 16617 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.570572 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1587) took 1516 ms. Trace:
I20260709 13:07:06.570644 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1806) took 3278 ms. Trace:
I20260709 13:07:05.412463 17121 rpcz_store.cc:276] 0709 13:07:03.094988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.095566 (+   578us) service_pool.cc:224] Handling call
0709 13:07:03.143443 (+ 47877us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.167009 (+ 23566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.167040 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.818221 (+1651181us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b1800116800. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a
0709 13:07:04.819677 (+  1456us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b2c0004caa8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:07:04.820212 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.137601 (+317389us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.152898 (+ 15297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.153022 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.389193 (+236171us) raft_consensus.cc:1685] finished
0709 13:07:05.389225 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.389401 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6306,"raft.queue_time_us":5684,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7299,"spinlock_wait_cycles":24712704,"thread_start_us":281303,"threads_started":1,"wal-append.queue_time_us":474601}
W20260709 13:07:06.177246 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1560) took 2242 ms (client timeout 1814 ms). Trace:
I20260709 13:07:05.648028 19061 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.572126 18805 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:05.841441 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1852) took 1697 ms. Trace:
I20260709 13:07:06.572958 18805 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:05.967849 18955 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.606s
I20260709 13:07:06.178828 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1633) took 2998 ms. Trace:
I20260709 13:07:06.574694 16614 rpcz_store.cc:276] 0709 13:07:03.180119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.158427 (+1978308us) service_pool.cc:224] Handling call
0709 13:07:05.158735 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.330597 (+171862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.178554 (+847957us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b540036ae54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:06.178767 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63331072}
I20260709 13:07:06.575153 18805 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:05.843591 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1860) took 1696 ms. Trace:
I20260709 13:07:06.545415 16545 rpcz_store.cc:276] 0709 13:07:05.499408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.633633 (+134225us) service_pool.cc:224] Handling call
0709 13:07:05.634255 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.634454 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.634479 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.634525 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.532602 (+898077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.532682 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.532844 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.576942 16570 heartbeater.cc:646] Failed to heartbeat to 127.14.246.126:40851 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.246.126:40851 timed out after 15.000s (SENT)
I20260709 13:07:06.577718 16545 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:06.577904 19054 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:06.578258 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 348) took 1078 ms. Trace:
I20260709 13:07:06.578364 18805 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:06.194167 18787 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:06.578922 18805 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.578855 19054 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.579831 18787 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.581127 18912 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.581876 18787 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:05.834686 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1557) took 1901 ms. Trace:
I20260709 13:07:06.584129 16463 rpcz_store.cc:276] 0709 13:07:03.933719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.529961 (+596242us) service_pool.cc:224] Handling call
0709 13:07:04.530227 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.335619 (+805392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.834347 (+498728us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002a94d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:05.834611 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608787200}
I20260709 13:07:05.940366 16619 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.571098 16617 rpcz_store.cc:276] 0709 13:07:03.292189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.569625 (+3277436us) service_pool.cc:224] Handling call
0709 13:07:06.569889 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.570441 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.570596 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.581602 18912 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.552547 16469 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.586220 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1795) took 3387 ms. Trace:
I20260709 13:07:06.195392 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.176725 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:06.586906 16508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.000s	sys 0.012s
I20260709 13:07:05.844444 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 282) took 1081 ms. Trace:
I20260709 13:07:06.587723 16468 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:06.042088 16616 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.661075 18797 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:06.175655 16618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1640) took 2241 ms (client timeout 2214 ms). Trace:
W20260709 13:07:06.571846 16470 rpcz_store.cc:269] 0709 13:07:03.934728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.057856 (+123128us) service_pool.cc:224] Handling call
0709 13:07:06.177019 (+2119163us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54003575d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.177136 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097385856}
W20260709 13:07:06.190092 16610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1606) took 3754 ms (client timeout 2045 ms). Trace:
W20260709 13:07:06.166616 16615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1797) took 2957 ms (client timeout 1627 ms). Trace:
W20260709 13:07:06.593531 16618 rpcz_store.cc:269] 0709 13:07:03.934619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.702395 (+767776us) service_pool.cc:224] Handling call
0709 13:07:06.175420 (+1473025us) spinlock_profiling.cc:243] Waited 80.8 ms on lock 0x7b54003f07d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.175554 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185916800}
W20260709 13:07:06.594194 16615 rpcz_store.cc:269] 0709 13:07:03.199985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.731673 (+531688us) service_pool.cc:224] Handling call
0709 13:07:06.156956 (+2425283us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54003e6f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.157095 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610907904}
I20260709 13:07:06.595263 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.595777 16615 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.596093 16463 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:07:06.157462 18795 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.007s	user 0.012s	sys 0.000s
I20260709 13:07:06.565418 16613 rpcz_store.cc:276] 0709 13:07:03.273145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.564050 (+3290905us) service_pool.cc:224] Handling call
0709 13:07:06.564327 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.564878 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.565049 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.604229 16617 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:05.637790 18654 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:06.533949 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.605468 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1808) took 2360 ms. Trace:
I20260709 13:07:06.174944 18924 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:06.535367 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.710176 19038 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:06.587706 16508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.000s	sys 0.012s
I20260709 13:07:06.578629 16545 rpcz_store.cc:276] 0709 13:07:05.499836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.577315 (+1077479us) service_pool.cc:224] Handling call
0709 13:07:06.577549 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.578047 (+   498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.578211 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.592042 18967 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.611516 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:06.614509 16545 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:06.591056 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.615223 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.591529 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.592267 16468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 283) took 1829 ms (client timeout 1942 ms). Trace:
W20260709 13:07:06.616080 16468 rpcz_store.cc:269] 0709 13:07:04.763065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.965269 (+202204us) service_pool.cc:224] Handling call
0709 13:07:06.195222 (+1229953us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:06.592207 (+396985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19588864}
I20260709 13:07:06.542287 18908 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:06.617112 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.617770 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1589) took 1016 ms. Trace:
I20260709 13:07:06.618060 16468 rpcz_store.cc:276] 0709 13:07:05.601016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.616882 (+1015866us) service_pool.cc:224] Handling call
0709 13:07:06.617719 (+   837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.618878 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.619489 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1595) took 1001 ms. Trace:
I20260709 13:07:06.619781 16468 rpcz_store.cc:276] 0709 13:07:05.618002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.618675 (+1000673us) service_pool.cc:224] Handling call
0709 13:07:06.619446 (+   771us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.176288 18646 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.002s
I20260709 13:07:06.550388 18904 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:06.170573 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1854) took 2026 ms. Trace:
I20260709 13:07:06.586885 16619 rpcz_store.cc:276] 0709 13:07:03.199190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.899495 (+2700305us) service_pool.cc:224] Handling call
0709 13:07:05.940123 (+ 40628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.585737 (+645614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.586162 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.597167 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.596642 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1811) took 2337 ms. Trace:
W20260709 13:07:06.593865 16610 rpcz_store.cc:269] 0709 13:07:02.435675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.639918 (+204243us) service_pool.cc:224] Handling call
0709 13:07:06.189859 (+3549941us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003dac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.190010 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2399486720}
W20260709 13:07:06.598897 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.037s	sys 0.041s
W20260709 13:07:05.676879 19052 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:07:06.599984 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.600720 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:06.601326 16435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.004s
I20260709 13:07:06.588141 16465 rpcz_store.cc:276] 0709 13:07:04.762835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.925562 (+162727us) service_pool.cc:224] Handling call
0709 13:07:05.844241 (+918679us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b540030b6d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:05.844366 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79012736}
I20260709 13:07:05.662570 18991 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:06.605837 16617 rpcz_store.cc:276] 0709 13:07:04.244708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.589328 (+2344620us) service_pool.cc:224] Handling call
0709 13:07:06.603901 (+ 14573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.605181 (+  1280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.605419 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.603024 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.576594 16541 rpcz_store.cc:276] 0709 13:07:04.146702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.490982 (+344280us) service_pool.cc:224] Handling call
0709 13:07:05.843337 (+1352355us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000ab9d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:05.843515 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535545600}
I20260709 13:07:06.603924 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:05.783411 18760 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.659060 18996 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:06.590114 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.009s	sys 0.010s
I20260709 13:07:06.608687 16618 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:06.608870 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.571015 16461 rpcz_store.cc:276] 0709 13:07:05.054585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.569614 (+1515029us) service_pool.cc:224] Handling call
0709 13:07:06.570511 (+   897us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.612586 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.573061 16544 rpcz_store.cc:276] 0709 13:07:04.144053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.471322 (+327269us) service_pool.cc:224] Handling call
0709 13:07:05.841129 (+1369807us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54003e8d54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:05.841336 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635257600}
I20260709 13:07:05.959695 18817 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:06.575927 18884 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:06.622059 16545 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:06.595919 18930 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:06.554801 18976 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.739822 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.766980 16463 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:06.767307 17122 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:06.767951 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.009s	sys 0.018s
I20260709 13:07:06.766399 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:06.750468 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:06.785149 17124 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:06.786509 16538 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.767410 16539 rpcz_store.cc:276] 0709 13:07:04.144634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.523621 (+378987us) service_pool.cc:224] Handling call
0709 13:07:04.524033 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.040115 (+516082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.170340 (+1130225us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b540031ae54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:06.170514 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658741504}
W20260709 13:07:06.744737 16582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.861s (SENT) [suppressed 27 similar messages]
W20260709 13:07:06.789168 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44475.6us
I20260709 13:07:06.768270 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.790236 16465 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.769652 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:06.796531 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1594) took 1184 ms. Trace:
I20260709 13:07:06.796869 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.631816 16466 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:06.797914 16466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 278) took 2036 ms (client timeout 1871 ms). Trace:
W20260709 13:07:06.659921 18562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.007s	sys 0.011s
W20260709 13:07:06.769074 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.767576 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:06.768738 16470 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:06.605935 18962 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.771394 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1809) took 2518 ms. Trace:
I20260709 13:07:06.773438 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.608114 18924 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:06.776152 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.773941 16615 rpcz_store.cc:276] 0709 13:07:04.258869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.595308 (+2336439us) service_pool.cc:224] Handling call
0709 13:07:06.595556 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.596265 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.596586 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.608690 19061 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:06.782825 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1588) took 1182 ms. Trace:
I20260709 13:07:06.814612 16463 rpcz_store.cc:276] 0709 13:07:05.600682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.596955 (+996273us) service_pool.cc:224] Handling call
0709 13:07:06.782738 (+185783us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:06.768992 16435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.017s	sys 0.010s
W20260709 13:07:06.806924 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.816414 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.767666 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.047s	sys 0.067s
I20260709 13:07:06.807327 16541 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:06.816982 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 1.15615e+06us
W20260709 13:07:06.807678 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 280) took 2045 ms (client timeout 2415 ms). Trace:
I20260709 13:07:06.817835 16583 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:06.817878 16470 rpcz_store.cc:269] 0709 13:07:04.762376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.602737 (+1840361us) service_pool.cc:224] Handling call
0709 13:07:06.807593 (+204856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.794579 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:06.795266 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:06.782941 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:06.798303 16466 rpcz_store.cc:269] 0709 13:07:04.761948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.925565 (+163617us) service_pool.cc:224] Handling call
0709 13:07:06.171888 (+1246323us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8eee 0000000000375939 00007ffa3c44c1e0 00007ffa3c5150c4 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:06.797851 (+625963us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19580032}
I20260709 13:07:06.777722 19065 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.781569 19003 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.827730 19003 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.829101 18884 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.829934 19003 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:06.831305 18490 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.831812 18490 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.705974 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1812) took 2424 ms. Trace:
W20260709 13:07:06.833735 17120 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.196s	user 0.009s	sys 0.000s
I20260709 13:07:06.834196 17120 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:06.833904 16613 rpcz_store.cc:276] 0709 13:07:04.281242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.602526 (+2321284us) service_pool.cc:224] Handling call
0709 13:07:06.625123 (+ 22597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.705518 (+ 80395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.705563 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.705634 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:06.705677 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.705745 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.705900 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79376,"raft.queue_time_us":81336,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":33336}
I20260709 13:07:06.834830 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 465) took 1339 ms. Trace:
I20260709 13:07:06.835179 17120 rpcz_store.cc:276] 0709 13:07:05.495146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.501475 (+  6329us) service_pool.cc:224] Handling call
0709 13:07:06.834774 (+1333299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.835857 16613 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:06.784011 18930 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.838384 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 385) took 2098 ms. Trace:
I20260709 13:07:06.838797 16613 rpcz_store.cc:276] 0709 13:07:04.739619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.835246 (+2095627us) service_pool.cc:224] Handling call
0709 13:07:06.835554 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.838115 (+  2561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.838328 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.689481 18805 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:06.803056 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.858623 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.860188 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:06.709540 18948 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:06.819010 16465 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:06.862401 16465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1581) took 1810 ms (client timeout 2254 ms). Trace:
W20260709 13:07:06.862763 16465 rpcz_store.cc:269] 0709 13:07:05.051940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.768065 (+1716125us) service_pool.cc:224] Handling call
0709 13:07:06.862346 (+ 94281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.813555 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.625988 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:06.808655 16618 rpcz_store.cc:276] 0709 13:07:04.253145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.594675 (+2341530us) service_pool.cc:224] Handling call
0709 13:07:06.608527 (+ 13852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.771156 (+162629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.771338 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.808493 16545 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:06.604059 18795 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.875268 18795 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:06.820453 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.876958 18805 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:06.877395 18805 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:06.877744 18805 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.815449 18962 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:06.878372 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 349) took 1378 ms. Trace:
I20260709 13:07:06.878744 16538 rpcz_store.cc:276] 0709 13:07:05.500038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.877627 (+1377589us) service_pool.cc:224] Handling call
0709 13:07:06.877907 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.878076 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.878101 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.878139 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.878180 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.878231 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.878325 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.878935 18962 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.880210 18962 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:06.880832 16462 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:06.806604 18562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.010s	sys 0.019s
I20260709 13:07:06.822257 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.887231 16541 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:06.826452 19069 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.826895 19065 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:05.658744 18939 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.796929 16468 rpcz_store.cc:276] 0709 13:07:05.611997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.620308 (+1008311us) service_pool.cc:224] Handling call
0709 13:07:06.796465 (+176157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.847216 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.847950 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.901589 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1590) took 1300 ms. Trace:
I20260709 13:07:06.902061 16463 rpcz_store.cc:276] 0709 13:07:05.601285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.847719 (+1246434us) service_pool.cc:224] Handling call
0709 13:07:06.901512 (+ 53793us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.626510 18797 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.851352 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.863981 16544 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:06.905462 16466 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:06.905927 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1593) took 1297 ms. Trace:
I20260709 13:07:06.906039 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.804788 19066 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.826488 19070 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.659099 18646 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.814175 18976 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.659493 18967 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.821652 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.881824 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.935738 16465 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:06.776134 18760 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.833762 18490 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:06.941553 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 285) took 1331 ms. Trace:
I20260709 13:07:06.942066 16461 rpcz_store.cc:276] 0709 13:07:05.610466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.802857 (+1192391us) service_pool.cc:224] Handling call
0709 13:07:06.941471 (+138614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.943638 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 277) took 2181 ms. Trace:
I20260709 13:07:06.944131 16465 rpcz_store.cc:276] 0709 13:07:04.761739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.881604 (+2119865us) service_pool.cc:224] Handling call
0709 13:07:06.943566 (+ 61962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.945245 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.947197 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:06.885305 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 67529.7us
I20260709 13:07:06.886078 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.949101 16539 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:06.856571 18991 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:07:06.853768 19003 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:06.888408 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.962096 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.891134 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:06.964566 16543 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.799798 18904 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:07:06.889191 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:06.847333 18817 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:06.943230 19002 consensus_meta.cc:287] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.425s	user 0.008s	sys 0.003s
I20260709 13:07:06.886731 19038 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:07:06.909956 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.910320 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1591) took 1308 ms. Trace:
I20260709 13:07:06.972888 16470 rpcz_store.cc:276] 0709 13:07:05.601533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.846959 (+1245426us) service_pool.cc:224] Handling call
0709 13:07:06.910251 (+ 63292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.911058 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1612) took 4361 ms. Trace:
I20260709 13:07:06.973804 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.974407 16470 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:06.916980 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:06.975399 16463 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.884825 18948 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.884261 16469 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:06.950312 16539 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:06.782714 19064 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:06.953528 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:07:06.881594 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.006s	sys 0.015s
I20260709 13:07:06.965999 16543 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:07.003384 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.367s	user 0.006s	sys 0.015s
W20260709 13:07:07.003732 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.36841e+06us
I20260709 13:07:06.864948 19044 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.906262 16466 rpcz_store.cc:276] 0709 13:07:05.608907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.851069 (+1242162us) service_pool.cc:224] Handling call
0709 13:07:06.905880 (+ 54811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.968305 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:06.968461 16611 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:06.969822 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:06.907433 16544 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:07.054147 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 352) took 1518 ms. Trace:
I20260709 13:07:07.054565 16544 rpcz_store.cc:276] 0709 13:07:05.535868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.906885 (+1371017us) service_pool.cc:224] Handling call
0709 13:07:06.907152 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.053864 (+146712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.054087 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.970779 16537 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:07.055603 16537 pending_rounds.cc:85] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 3
I20260709 13:07:07.055938 16537 pending_rounds.cc:107] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:07.056223 16537 raft_consensus.cc:2889] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.971948 16536 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:06.973501 16616 rpcz_store.cc:276] 0709 13:07:02.549879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.092677 (+2542798us) service_pool.cc:224] Handling call
0709 13:07:06.041906 (+949229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.588648 (+546742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.910800 (+322152us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54002350d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:06.910981 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173306240}
I20260709 13:07:06.989192 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 353) took 1354 ms. Trace:
I20260709 13:07:07.057435 16539 rpcz_store.cc:276] 0709 13:07:05.635060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.949781 (+1314721us) service_pool.cc:224] Handling call
0709 13:07:06.950028 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.988945 (+ 38917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.989142 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.059046 16539 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:06.990569 16469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1583) took 1935 ms (client timeout 2011 ms). Trace:
W20260709 13:07:07.060902 16469 rpcz_store.cc:269] 0709 13:07:05.053524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.025450 (+971926us) service_pool.cc:224] Handling call
0709 13:07:06.988741 (+963291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.002417 16614 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:07.008728 16462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1585) took 1954 ms (client timeout 1530 ms). Trace:
W20260709 13:07:07.062999 16462 rpcz_store.cc:269] 0709 13:07:05.054031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.197493 (+143462us) service_pool.cc:224] Handling call
0709 13:07:07.008452 (+1810959us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54002a6cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:07.008633 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3868457344}
W20260709 13:07:07.021179 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.066442 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1577) took 2842 ms. Trace:
I20260709 13:07:06.937520 18797 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:07.051069 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 262999us
W20260709 13:07:07.067785 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.060449 16539 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:07:07.009928 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 56520.7us
I20260709 13:07:06.908231 18924 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:07.068845 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47956.5us
W20260709 13:07:07.077517 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 282264us
I20260709 13:07:06.937748 19066 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.969316 18817 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.972208 19045 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.174s
I20260709 13:07:06.919209 19069 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:06.940884 19070 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:06.975104 19061 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:07.066874 16468 rpcz_store.cc:276] 0709 13:07:04.224445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.988763 (+2764318us) service_pool.cc:224] Handling call
0709 13:07:07.065972 (+ 77209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.066146 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.066170 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.066209 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:07.066248 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.066301 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.066392 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.310559 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.185480 16544 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.159780 16470 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:07.438625 16539 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:07.439182 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1578) took 3189 ms. Trace:
W20260709 13:07:07.429646 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.439715 16470 rpcz_store.cc:276] 0709 13:07:04.253765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.051777 (+2798012us) service_pool.cc:224] Handling call
0709 13:07:07.159490 (+107713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.438896 (+279406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.439127 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.320365 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1886) took 1821 ms. Trace:
W20260709 13:07:07.316351 16536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1884) took 1817 ms (client timeout 2014 ms). Trace:
W20260709 13:07:07.441128 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 658193us
W20260709 13:07:07.441629 16536 rpcz_store.cc:269] 0709 13:07:05.498778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.534421 (+ 35643us) service_pool.cc:224] Handling call
0709 13:07:07.316134 (+1781713us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54001df954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:07.316269 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3247920000}
I20260709 13:07:06.988699 18991 consensus_queue.cc:1243] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:07.181291 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:06.974262 18490 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.389622 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 380) took 2671 ms. Trace:
W20260709 13:07:07.002879 19063 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
I20260709 13:07:07.318885 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1805) took 4032 ms. Trace:
W20260709 13:07:07.506232 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63886.9us
I20260709 13:07:07.530117 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:07.440727 16537 rpcz_store.cc:276] 0709 13:07:05.499203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.595878 (+ 96675us) service_pool.cc:224] Handling call
0709 13:07:05.841663 (+245785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.056740 (+1215077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.319520 (+262780us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003e8d54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:07.320147 (+   627us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003e8d50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:07.320295 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3160192128}
I20260709 13:07:07.317924 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1807) took 3980 ms. Trace:
W20260709 13:07:07.506551 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.472472 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.537022 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.536353 16611 rpcz_store.cc:276] 0709 13:07:03.286820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.567145 (+3280325us) service_pool.cc:224] Handling call
0709 13:07:06.567403 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.053113 (+485710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.318609 (+265496us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54000a05d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:07.318814 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921799552}
W20260709 13:07:07.537609 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.407115 19034 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.858s	user 0.008s	sys 0.000s
W20260709 13:07:07.542454 16619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.004s	sys 0.010s
W20260709 13:07:07.465407 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.542802 16619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.004s	sys 0.010s
W20260709 13:07:07.509905 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.543825 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:07.078481 16542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.010s
W20260709 13:07:07.545670 16542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.013s	sys 0.019s
I20260709 13:07:07.546023 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:07.546653 16616 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.547484 16465 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.200950 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:07.145027 16511 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.008s
W20260709 13:07:07.118549 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 229420us
I20260709 13:07:07.528707 19054 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.311008 19068 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:07.183650 16618 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.503585 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:07.521337 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.019s
I20260709 13:07:07.003553 18912 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:07.522689 16470 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:07.523198 18597 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.975s	user 0.007s	sys 0.001s
I20260709 13:07:07.523501 16468 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 2. Current term is 3. Ops: []
W20260709 13:07:07.516629 19099 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.051s	user 0.000s	sys 0.006s
I20260709 13:07:07.528630 16610 rpcz_store.cc:276] 0709 13:07:04.718726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.776354 (+2057628us) service_pool.cc:224] Handling call
0709 13:07:06.776602 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.776832 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:06.889000 (+112168us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.389152 (+500152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.389221 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.389296 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.389383 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.389545 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":96046,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":10334,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10420,"thread_start_us":589595,"threads_started":2,"wal-append.queue_time_us":553724}
I20260709 13:07:07.442996 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:07.532111 19074 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
W20260709 13:07:07.538379 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.214995 16463 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:06.990471 18906 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:07.538522 16536 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:07.055685 18809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.029s
W20260709 13:07:07.141070 19071 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:07:07.538873 16614 rpcz_store.cc:276] 0709 13:07:03.337991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.575605 (+3237614us) service_pool.cc:224] Handling call
0709 13:07:06.575879 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.062650 (+486771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.317619 (+254969us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540033ac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:07.317851 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":950469376}
W20260709 13:07:07.214587 19037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.009s	sys 0.007s
W20260709 13:07:07.258692 19056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.009s	sys 0.011s
W20260709 13:07:07.506384 18898 consensus_meta.cc:287] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.960s	user 0.004s	sys 0.006s
I20260709 13:07:07.325629 19033 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:07.323312 18889 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:06.988579 19002 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.550s
I20260709 13:07:07.624029 16465 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:07.630125 19057 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.547647 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:07.555307 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 350) took 2055 ms. Trace:
I20260709 13:07:07.554064 16461 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:07.051877 18908 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.638805 19077 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.640240 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 383) took 2914 ms. Trace:
W20260709 13:07:07.286193 19059 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 13:07:07.068085 18996 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.446648 16367 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 4, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:07.643911 16368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 270) took 16929 ms (client timeout 15000 ms). Trace:
I20260709 13:07:07.653548 18967 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:07.541280 18991 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:07.661845 18896 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 2.232s	user 0.011s	sys 0.000s
I20260709 13:07:07.662006 19066 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:07.653563 19044 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:07.663045 18760 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:07.066727 19064 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:07.668434 19069 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:07.670786 18797 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:07.459579 19085 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.160194 19067 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:07.676276 16511 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.013s	sys 0.025s
I20260709 13:07:07.635890 16617 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:07.528184 19047 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.514935 16539 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:07.644510 18976 consensus_meta.cc:287] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.001s
I20260709 13:07:07.270349 18930 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:07.142362 16466 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:07.533687 18490 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:07.533322 19038 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.176s
I20260709 13:07:07.676895 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:07.968338 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 275) took 3207 ms. Trace:
I20260709 13:07:07.968792 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1643) took 1085 ms. Trace:
I20260709 13:07:07.684113 16616 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:07:07.968397 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1891) took 1107 ms. Trace:
I20260709 13:07:07.970067 16539 rpcz_store.cc:276] 0709 13:07:06.861161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.440568 (+579407us) service_pool.cc:224] Handling call
0709 13:07:07.514717 (+ 74149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.968170 (+453453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.968346 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.946622 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.970423 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.42599e+06us
W20260709 13:07:07.850657 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.969939 16615 rpcz_store.cc:276] 0709 13:07:04.726404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.808458 (+2082054us) service_pool.cc:224] Handling call
0709 13:07:06.813767 (+  5309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.852548 (+ 38781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.852595 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.853202 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.159472 (+306270us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.159509 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.159586 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:07.639983 (+480397us) raft_consensus.cc:1685] finished
0709 13:07:07.640019 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.640171 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43882,"raft.queue_time_us":38366,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7915,"thread_start_us":260210,"threads_started":1,"wal-append.queue_time_us":772859}
I20260709 13:07:07.969256 16617 rpcz_store.cc:276] 0709 13:07:06.883049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.079602 (+196553us) service_pool.cc:224] Handling call
0709 13:07:07.968721 (+889119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.921739 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.974503 16469 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:07.975250 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1580) took 2923 ms. Trace:
I20260709 13:07:07.970505 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1586) took 2916 ms. Trace:
I20260709 13:07:07.975513 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1636) took 1133 ms. Trace:
I20260709 13:07:07.971839 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 284) took 2361 ms. Trace:
I20260709 13:07:07.976933 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1652) took 1088 ms. Trace:
I20260709 13:07:08.017181 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 276) took 3255 ms. Trace:
I20260709 13:07:07.676069 18646 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:07.737784 18945 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.029196 18924 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.040231 18945 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.040923 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1598) took 1456 ms. Trace:
I20260709 13:07:08.041693 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:08.016815 19085 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.042434 18945 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:07.968459 19086 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.043381 19086 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.044013 17123 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [4.6-7.7]
W20260709 13:07:07.969859 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.968865 16466 rpcz_store.cc:276] 0709 13:07:04.761265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.052754 (+2291489us) service_pool.cc:224] Handling call
0709 13:07:07.142097 (+ 89343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.968038 (+825941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.968273 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.988898 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:07.901244 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 365403us
W20260709 13:07:08.048552 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.016791 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.038568 16463 rpcz_store.cc:276] 0709 13:07:06.841914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.916633 (+ 74719us) service_pool.cc:224] Handling call
0709 13:07:07.975438 (+1058805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.021688 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.047351 16468 rpcz_store.cc:276] 0709 13:07:05.054309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.523012 (+2468703us) service_pool.cc:224] Handling call
0709 13:07:07.523311 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.970264 (+446953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.970454 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.053503 16615 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:08.038813 16470 rpcz_store.cc:276] 0709 13:07:05.610167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.440841 (+1830674us) service_pool.cc:224] Handling call
0709 13:07:07.522376 (+ 81535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.971596 (+449220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.971784 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.049228 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1892) took 1187 ms. Trace:
I20260709 13:07:07.785952 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 347) took 2286 ms. Trace:
W20260709 13:07:08.026893 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 583889us
W20260709 13:07:08.048707 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 501134us
I20260709 13:07:08.054709 16536 rpcz_store.cc:276] 0709 13:07:06.861380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.442447 (+581067us) service_pool.cc:224] Handling call
0709 13:07:07.538360 (+ 95913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.048983 (+510623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.049172 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.888005 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.027886 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.039642 16469 rpcz_store.cc:276] 0709 13:07:04.761530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.061931 (+2300401us) service_pool.cc:224] Handling call
0709 13:07:07.974302 (+912371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.975007 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.016957 (+ 41950us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54003b8650. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:08.017110 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097322880}
W20260709 13:07:08.049117 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.971855 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.020s	sys 0.025s
W20260709 13:07:08.057430 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 1.11782e+06us
I20260709 13:07:08.039389 16538 rpcz_store.cc:276] 0709 13:07:05.500274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.879736 (+1379462us) service_pool.cc:224] Handling call
0709 13:07:06.879974 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.880152 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:06.922246 (+ 42094us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.554833 (+632587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.554904 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.554989 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.555076 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.555236 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":565064,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":446587,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":536480,"threads_started":3,"wal-append.queue_time_us":524007}
I20260709 13:07:07.636382 16611 raft_consensus.cc:2368] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:08.058351 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.058777 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1646) took 1175 ms. Trace:
I20260709 13:07:08.058944 16466 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:08.038411 18809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.015s	sys 0.040s
I20260709 13:07:08.063586 16367 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:07:07.739393 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:08.064450 19038 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:08.065256 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.065405 16367 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 4, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.066244 18646 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.066799 18646 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:07.951220 19065 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:08.066932 18490 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.017042 18896 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.068138 18490 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.068871 16464 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:08.053807 18991 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:08.069806 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.070070 18991 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.056835 16610 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:08.071144 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1830) took 1004 ms. Trace:
I20260709 13:07:08.071491 16610 rpcz_store.cc:276] 0709 13:07:07.066703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.027554 (+960851us) service_pool.cc:224] Handling call
0709 13:07:08.071077 (+ 43523us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:07.838847 18805 consensus_meta.cc:287] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.961s	user 0.010s	sys 0.002s
I20260709 13:07:08.072523 18805 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.073200 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:08.073446 18817 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.073791 17119 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:07.703437 18962 consensus_meta.cc:287] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.823s	user 0.006s	sys 0.003s
I20260709 13:07:08.059240 16611 rpcz_store.cc:276] 0709 13:07:06.883769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.537764 (+653995us) service_pool.cc:224] Handling call
0709 13:07:08.058694 (+520930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.053761 18797 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.059410 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:08.060241 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:08.055510 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 551926us
I20260709 13:07:08.060822 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:08.050146 16616 rpcz_store.cc:276] 0709 13:07:06.888882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.527892 (+639010us) service_pool.cc:224] Handling call
0709 13:07:07.976863 (+448971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.723444 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:08.016571 16613 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:07:07.968895 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 292027us
I20260709 13:07:08.047976 18906 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:08.057729 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.066012 19038 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:08.075773 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:08.347888 16611 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:08.315685 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1409) took 4865 ms (client timeout 1861 ms). Trace:
I20260709 13:07:08.272377 16466 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:08.348647 16540 rpcz_store.cc:269] 0709 13:07:03.423337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.463876 (+ 40539us) service_pool.cc:224] Handling call
0709 13:07:08.243855 (+4779979us) spinlock_profiling.cc:243] Waited 4.33 s on lock 0x7b54002058d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:08.288696 (+ 44841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9960556288}
I20260709 13:07:08.349604 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.350311 16466 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.350636 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.080814 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.351405 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1642) took 1468 ms. Trace:
I20260709 13:07:08.351657 16617 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:08.351768 16616 rpcz_store.cc:276] 0709 13:07:06.882796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.350402 (+1467606us) service_pool.cc:224] Handling call
0709 13:07:08.351351 (+   949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.352344 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1831) took 1285 ms. Trace:
I20260709 13:07:08.301644 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:08.079873 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.975786 16461 rpcz_store.cc:276] 0709 13:07:05.051644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.182472 (+2130828us) service_pool.cc:224] Handling call
0709 13:07:07.541662 (+359190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.974926 (+433264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.975177 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.352725 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.352700 16617 rpcz_store.cc:276] 0709 13:07:07.067037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.020458 (+953421us) service_pool.cc:224] Handling call
0709 13:07:08.352237 (+331779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.355381 16463 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:08.356202 16469 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:08.218293 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 388) took 3454 ms. Trace:
I20260709 13:07:08.089509 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.358202 16613 pending_rounds.cc:85] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:07:08.358074 16618 rpcz_store.cc:276] 0709 13:07:04.763664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.867420 (+2103756us) service_pool.cc:224] Handling call
0709 13:07:06.900635 (+ 33215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.050525 (+1149890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.218058 (+167533us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540025c954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:08.218229 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650220288}
I20260709 13:07:08.358897 16613 pending_rounds.cc:107] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:08.359246 16613 raft_consensus.cc:2889] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.230089 16462 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:08.313184 16545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.004s	sys 0.015s
I20260709 13:07:08.355062 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:08.371125 16545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.004s	sys 0.018s
W20260709 13:07:08.243829 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 270454us
I20260709 13:07:08.017499 19047 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:08.354322 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.066988 16367 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 6, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.055063 16542 rpcz_store.cc:276] 0709 13:07:05.499643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.577032 (+1077389us) service_pool.cc:224] Handling call
0709 13:07:06.577299 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.577486 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:07.546010 (+968524us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.785457 (+239447us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.785530 (+    73us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:07.785612 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.785705 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.785872 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9474,"prepare.queue_time_us":824034,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":34090,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":56135,"thread_start_us":1159090,"threads_started":2}
W20260709 13:07:08.365073 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 304318us
I20260709 13:07:08.046372 18911 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.382874 16585 leader_election.cc:336] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.530s (SENT)
I20260709 13:07:08.380753 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.383625 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.384737 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.385124 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.359544 16611 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:08.390911 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1832) took 1323 ms. Trace:
I20260709 13:07:08.391065 16469 raft_consensus.cc:2376] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6. Re-sending same reply.
I20260709 13:07:08.391444 16611 rpcz_store.cc:276] 0709 13:07:07.067276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.075486 (+1008210us) service_pool.cc:224] Handling call
0709 13:07:08.390829 (+315343us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.229594 16464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 279) took 3467 ms (client timeout 1977 ms). Trace:
I20260709 13:07:08.041462 16465 rpcz_store.cc:276] 0709 13:07:06.584373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.961857 (+377484us) service_pool.cc:224] Handling call
0709 13:07:08.040724 (+1078867us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54002a71d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:08.040861 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1321994624}
I20260709 13:07:08.394575 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1596) took 1810 ms. Trace:
I20260709 13:07:08.068904 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:08.361981 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1826) took 1297 ms. Trace:
W20260709 13:07:08.392760 16464 rpcz_store.cc:269] 0709 13:07:04.762171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.007751 (+245580us) service_pool.cc:224] Handling call
0709 13:07:06.176529 (+1168778us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:08.229274 (+2052745us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003b9a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:08.229479 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3409021184}
I20260709 13:07:08.353739 16468 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:07:08.117452 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.569149 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.569593 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.570168 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.571187 16611 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:07.838376 18890 consensus_meta.cc:287] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 2.354s	user 0.006s	sys 0.007s
I20260709 13:07:08.571772 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1828) took 1505 ms. Trace:
I20260709 13:07:08.370369 16610 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:08.572204 16611 rpcz_store.cc:276] 0709 13:07:07.066196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.392472 (+1326276us) service_pool.cc:224] Handling call
0709 13:07:08.571704 (+179232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.572466 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1647) took 1688 ms. Trace:
I20260709 13:07:08.572829 16610 rpcz_store.cc:276] 0709 13:07:06.884010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.072152 (+1188142us) service_pool.cc:224] Handling call
0709 13:07:08.572416 (+500264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.573729 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:08.054563 19037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.017s	sys 0.019s
I20260709 13:07:08.576185 19037 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:07.787732 18957 consensus_meta.cc:287] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 2.390s	user 0.011s	sys 0.003s
I20260709 13:07:08.373610 19002 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:07.989552 18562 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.989514 18961 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.385876 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:08.386108 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:08.221179 18797 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:08.383437 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:08.387079 18911 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.611522 18797 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.613511 19086 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.387884 19061 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:08.378213 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 351) took 2864 ms. Trace:
I20260709 13:07:08.049044 19033 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:08.050709 19057 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:08.389081 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.044658 19085 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:08.435742 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.061863 18898 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.062002 19054 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.364370 18906 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.165688 19068 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.375206 19103 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:08.016793 19077 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:08.530481 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 479093us
I20260709 13:07:08.369617 18948 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.218490 18646 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:07.608704 19034 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.217870 18889 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.250s
I20260709 13:07:08.201051 18945 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.076148 18939 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.465036 18976 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.046913 18996 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.380928 19014 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:07:08.708014 19047 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:08.054430 19056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.016s	sys 0.022s
I20260709 13:07:08.382718 19065 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.600960 19002 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.716004 19057 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.602504 18957 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.615432 19106 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.721110 19106 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.721851 19002 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.580277 18912 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.616906 18562 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.598869 18890 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.722796 18912 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.609216 18961 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.723856 19106 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.629256 18896 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.686849 19061 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:08.724848 18961 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.710251 18939 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.636229 19070 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.725490 18939 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.726377 18898 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.725762 19061 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.684957 18817 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:08.729800 19103 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:08.730225 19103 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:08.715365 19054 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.731364 19057 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.717610 18945 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:08.719264 18490 consensus_meta.cc:287] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.003s
I20260709 13:07:08.775379 16367 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 4, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:07.970942 16368 rpcz_store.cc:269] 0709 13:06:50.719182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.725368 (+  6186us) service_pool.cc:224] Handling call
0709 13:07:07.643674 (+16918306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:58.327150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:58.328173 (+  1023us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:58.328244 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:06:58.328286 (+    42us) tablet.cc:662] Decoding operations
0709 13:06:58.331434 (+  3148us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:58.331569 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:58.331637 (+    68us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:58.456317 (+124680us) tablet.cc:701] Row locks acquired
0709 13:06:58.456368 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:06:58.456576 (+   208us) write_op.cc:270] Start()
0709 13:06:58.456740 (+   164us) write_op.cc:276] Timestamp: P: 1783602418456511 usec, L: 0
0709 13:06:58.456794 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:06:58.559423 (+102629us) log.cc:844] Serialized 8310 byte log entry
0709 13:06:59.526493 (+967070us) op_driver.cc:464] REPLICATION: finished
0709 13:07:00.262081 (+735588us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa343f30ac 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3af33ef0
0709 13:07:00.400566 (+138485us) write_op.cc:301] APPLY: starting
0709 13:07:00.428545 (+ 27979us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:00.550076 (+121531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:00.550124 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:00.897580 (+347456us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:00.898016 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:07:00.898069 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:00.898502 (+   433us) log.cc:844] Serialized 145 byte log entry
0709 13:07:01.303714 (+405212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.364053 (+ 60339us) write_op.cc:454] Released schema lock
0709 13:07:01.508366 (+144313us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:01.608039 (+ 99673us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.608082 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144894,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":851454,"apply.run_cpu_time_us":19908,"apply.run_wall_time_us":1218305,"num_ops":21,"prepare.queue_time_us":451046,"prepare.run_cpu_time_us":64490,"prepare.run_wall_time_us":547311,"raft.queue_time_us":300239,"raft.run_cpu_time_us":29312,"raft.run_wall_time_us":844255,"replication_time_us":1069473,"spinlock_wait_cycles":501136640,"thread_start_us":2197064,"threads_started":5,"wal-append.queue_time_us":891989,"wal-append.run_cpu_time_us":62965,"wal-append.run_wall_time_us":2453925}]]}
I20260709 13:07:08.381944 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:08.382687 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:08.825809 16461 raft_consensus.cc:2376] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4. Re-sending same reply.
W20260709 13:07:08.524809 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.376868 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.827181 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.828138 19114 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:08.787384 16541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.266s	user 0.014s	sys 0.040s
W20260709 13:07:08.829007 16541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.015s	sys 0.040s
I20260709 13:07:08.829145 19114 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.830202 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1439) took 2246 ms. Trace:
I20260709 13:07:08.830683 16541 rpcz_store.cc:276] 0709 13:07:06.583333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.963063 (+379730us) service_pool.cc:224] Handling call
0709 13:07:06.963359 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.963530 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:07.219403 (+255873us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.829524 (+1610121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.829621 (+    97us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.829745 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.829848 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.830100 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":482082,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":140704,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":100,"spinlock_wait_cycles":9344,"thread_start_us":1864798,"threads_started":3,"wal-append.queue_time_us":425471,"wal-append.run_cpu_time_us":7608,"wal-append.run_wall_time_us":1040123}
I20260709 13:07:08.469033 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1614) took 5439 ms. Trace:
I20260709 13:07:08.397033 16615 rpcz_store.cc:276] 0709 13:07:07.065128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.021317 (+956189us) service_pool.cc:224] Handling call
0709 13:07:08.361906 (+340589us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.834381 19068 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.393025 16469 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:08.788530 16618 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:08.566576 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 485922us
I20260709 13:07:08.832456 19114 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.581923 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1579) took 3530 ms. Trace:
I20260709 13:07:08.375892 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:08.848317 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1601) took 1201 ms. Trace:
I20260709 13:07:08.848707 16463 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:08.849591 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 291) took 1346 ms. Trace:
I20260709 13:07:08.850077 16463 rpcz_store.cc:276] 0709 13:07:07.502638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.375621 (+872983us) service_pool.cc:224] Handling call
0709 13:07:08.849486 (+473865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.852303 18805 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.395100 16465 rpcz_store.cc:276] 0709 13:07:06.583852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.393600 (+1809748us) service_pool.cc:224] Handling call
0709 13:07:08.393947 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.394132 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.394158 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.394204 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.394262 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.394348 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.394474 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.410091 16466 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:08.468191 16511 connection.cc:256] RPC call timeout handler was delayed by -3.8722230399999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 13:07:08.859876 16511 leader_election.cc:336] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.107s (SENT)
I20260709 13:07:08.860857 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:08.861486 17124 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.618294 16545 rpcz_store.cc:276] 0709 13:07:05.514272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.882381 (+1368109us) service_pool.cc:224] Handling call
0709 13:07:06.882617 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.882817 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:07.078266 (+195449us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.377857 (+1299591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.377910 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:08.377970 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.378035 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.378158 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":562628,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":323449,"raft.run_cpu_time_us":45,"raft.run_wall_time_us":45,"thread_start_us":1452065,"threads_started":3,"wal-append.queue_time_us":558675}
W20260709 13:07:08.623673 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 234644us
I20260709 13:07:08.863471 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:08.864873 17127 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:08.865397 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.866322 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:08.867317 17123 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:08.848727 16461 rpcz_store.cc:276] 0709 13:07:07.639841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.354560 (+714719us) service_pool.cc:224] Handling call
0709 13:07:08.840150 (+485590us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.458158 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.869315 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:08.869966 16461 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:07:08.615872 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 233004us
I20260709 13:07:08.871757 16461 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:08.871789 19106 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.872629 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1632) took 2032 ms. Trace:
I20260709 13:07:08.599746 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 387) took 3851 ms. Trace:
W20260709 13:07:08.875226 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.874671 16613 rpcz_store.cc:276] 0709 13:07:04.748714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.839667 (+2090953us) service_pool.cc:224] Handling call
0709 13:07:06.865896 (+ 26229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.360413 (+1494517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.582819 (+222406us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540025d354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:08.599665 (+ 16846us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645349760}
I20260709 13:07:08.627902 16611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:07:08.793653 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 354) took 2208 ms. Trace:
I20260709 13:07:08.876842 16611 raft_consensus.cc:606] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.877223 18562 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.798031 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.833112 16612 rpcz_store.cc:276] 0709 13:07:02.949916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.096369 (+2146453us) service_pool.cc:224] Handling call
0709 13:07:05.097064 (+   695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.369374 (+272310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.369403 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.428158 (+ 58755us) log.cc:844] Serialized 26 byte log entry
0709 13:07:05.599953 (+171795us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:05.600005 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.600093 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.388747 (+2788654us) raft_consensus.cc:1685] finished
0709 13:07:08.388782 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.388890 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28771,"raft.queue_time_us":133391,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":4352,"thread_start_us":338198,"threads_started":2,"wal-append.queue_time_us":1392760}
W20260709 13:07:08.878433 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.878564 16613 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:07:08.879145 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.467905 16614 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:08.879429 16612 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:08.606160 16617 raft_consensus.cc:2410] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:08.724743 18912 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:08.739207 18924 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.696s	user 0.008s	sys 0.000s
I20260709 13:07:08.880712 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1650) took 1995 ms. Trace:
I20260709 13:07:08.737699 18945 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.881319 16617 rpcz_store.cc:276] 0709 13:07:06.884732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.355628 (+1470896us) service_pool.cc:224] Handling call
0709 13:07:08.880427 (+524799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.578378 16610 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:08.882853 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1648) took 1998 ms. Trace:
I20260709 13:07:08.736377 19077 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:08.693856 19037 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.708881 19033 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.856156 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 292) took 1353 ms. Trace:
I20260709 13:07:08.885107 16466 rpcz_store.cc:276] 0709 13:07:07.502864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.349346 (+846482us) service_pool.cc:224] Handling call
0709 13:07:08.855973 (+506627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.886323 19033 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:08.886521 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:08.886812 16466 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:08.887604 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1638) took 2045 ms. Trace:
W20260709 13:07:08.716815 19097 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:07:08.887727 19002 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:08.887984 16466 rpcz_store.cc:276] 0709 13:07:06.842468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.886060 (+2043592us) service_pool.cc:224] Handling call
0709 13:07:08.886498 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.887273 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.887536 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.813275 18889 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.820806 16367 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 6, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.820864 17126 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:08.826229 17121 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:08.833549 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.361191 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:08.876933 16543 rpcz_store.cc:276] 0709 13:07:06.584598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.003865 (+419267us) service_pool.cc:224] Handling call
0709 13:07:07.004180 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.004487 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.004510 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.065861 (+ 61351us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.016184 (+950323us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:08.016229 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.016301 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.793034 (+776733us) raft_consensus.cc:1685] finished
0709 13:07:08.793070 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.793389 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":520740,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":448779,"threads_started":1,"wal-append.queue_time_us":1112222}
W20260709 13:07:08.901960 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 540664us
I20260709 13:07:08.903013 18562 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.843591 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 286) took 3232 ms. Trace:
I20260709 13:07:08.845268 18490 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:08.872920 19106 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:08.873838 18817 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.877399 16611 raft_consensus.cc:614] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:08.877730 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:08.879652 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.880280 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 392) took 3505 ms. Trace:
I20260709 13:07:08.907994 16612 rpcz_store.cc:276] 0709 13:07:05.374450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.878619 (+3504169us) service_pool.cc:224] Handling call
0709 13:07:08.879111 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.879961 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.880183 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.908818 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50106 (request call id 10) took 1379 ms. Trace:
W20260709 13:07:08.909128 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49663.6us
I20260709 13:07:08.909458 16611 rpcz_store.cc:276] 0709 13:07:07.529722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.607996 (+1078274us) service_pool.cc:224] Handling call
0709 13:07:08.908662 (+300666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.728511 19065 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:08.912024 16611 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.731079 19103 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.912820 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 396) took 2124 ms. Trace:
I20260709 13:07:08.913290 16611 rpcz_store.cc:276] 0709 13:07:06.788075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.911096 (+2123021us) service_pool.cc:224] Handling call
0709 13:07:08.911648 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.912480 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.912732 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.914253 19103 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.915340 16611 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:08.916149 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 397) took 2127 ms. Trace:
I20260709 13:07:08.916559 16611 rpcz_store.cc:276] 0709 13:07:06.788340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.914272 (+2125932us) service_pool.cc:224] Handling call
0709 13:07:08.914788 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.915853 (+  1065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.916086 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.917321 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 535286us
I20260709 13:07:08.715622 18911 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.918485 16611 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:08.919252 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1827) took 1853 ms. Trace:
I20260709 13:07:08.919862 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:08.920259 18817 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.922729 19047 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:08.826136 19118 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:07:08.923542 19047 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.924589 19106 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.927464 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:08.883378 16610 rpcz_store.cc:276] 0709 13:07:06.884252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.573484 (+1689232us) service_pool.cc:224] Handling call
0709 13:07:08.882598 (+309114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.912163 19065 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.852474 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:08.884085 16461 rpcz_store.cc:276] 0709 13:07:06.840686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.870708 (+2030022us) service_pool.cc:224] Handling call
0709 13:07:08.871195 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.872343 (+  1148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.872552 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.846266 16462 rpcz_store.cc:276] 0709 13:07:05.051361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.078960 (+2027599us) service_pool.cc:224] Handling call
0709 13:07:08.229834 (+1150874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.360530 (+130696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.581644 (+221114us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003b9a50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:08.581839 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645882752}
I20260709 13:07:08.904412 16469 rpcz_store.cc:276] 0709 13:07:05.610736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.392477 (+2781741us) service_pool.cc:224] Handling call
0709 13:07:08.392733 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.836092 (+443359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.843183 (+  7091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.905648 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:08.909847 16612 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.919687 16611 rpcz_store.cc:276] 0709 13:07:07.065928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.917387 (+1851459us) service_pool.cc:224] Handling call
0709 13:07:08.917900 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.918945 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.919192 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.923372 18817 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:08.879455 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1820) took 3691 ms. Trace:
I20260709 13:07:08.929745 16613 rpcz_store.cc:276] 0709 13:07:05.188237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.875964 (+3687727us) service_pool.cc:224] Handling call
0709 13:07:08.876525 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.879099 (+  2574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.879352 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.927343 19047 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:08.883482 16617 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:08.854492 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:08.889236 19002 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.932525 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 395) took 3522 ms. Trace:
I20260709 13:07:08.933000 16612 rpcz_store.cc:276] 0709 13:07:05.407695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.908808 (+3501113us) service_pool.cc:224] Handling call
0709 13:07:08.909511 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.930213 (+ 20702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.930389 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.934031 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 393) took 3556 ms. Trace:
I20260709 13:07:08.906615 19114 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.936578 16617 rpcz_store.cc:276] 0709 13:07:05.375271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.882325 (+3507054us) service_pool.cc:224] Handling call
0709 13:07:08.882864 (+   539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.930843 (+ 47979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.931686 (+   843us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.931850 16511 connection.cc:256] RPC call timeout handler was delayed by -3.4914810779999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
I20260709 13:07:08.931308 19002 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.941020 18805 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:08.941202 19070 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:08.941512 18805 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.941767 19070 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:08.942025 18805 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:08.943356 16463 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:08.943064 19070 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.943964 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1600) took 1307 ms. Trace:
I20260709 13:07:08.944921 19054 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:07:08.941381 16610 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:08.946010 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1829) took 1879 ms. Trace:
I20260709 13:07:08.944329 16463 rpcz_store.cc:276] 0709 13:07:07.639522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.939614 (+1300092us) service_pool.cc:224] Handling call
0709 13:07:08.943022 (+  3408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.943674 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.943878 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.947417 16511 connection.cc:256] RPC call timeout handler was delayed by -3.462681077999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260709 13:07:08.946398 16610 rpcz_store.cc:276] 0709 13:07:07.066462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.928202 (+1861740us) service_pool.cc:224] Handling call
0709 13:07:08.934811 (+  6609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.945755 (+ 10944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.945952 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:08.889274 18889 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.949427 16465 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:08.946547 16469 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:08.952389 18957 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:08.940348 19002 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.953514 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 288) took 1494 ms. Trace:
I20260709 13:07:08.953944 16469 rpcz_store.cc:276] 0709 13:07:07.455644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.935903 (+1480259us) service_pool.cc:224] Handling call
0709 13:07:08.946072 (+ 10169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.949798 (+  3726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.949923 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:08.938695 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 220595us
I20260709 13:07:08.944469 19070 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:08.950431 16511 connection.cc:256] RPC call timeout handler was delayed by -3.4041810779999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
I20260709 13:07:08.963109 18889 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.963359 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 381) took 4244 ms. Trace:
I20260709 13:07:08.957147 16467 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:08.955667 19047 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:08.969065 17123 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:08.969527 18906 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:08.970321 18957 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:08.970774 18957 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:08.971653 16616 raft_consensus.cc:2368] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 8.
I20260709 13:07:08.971858 18957 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:08.973574 16465 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:08.963764 16619 rpcz_store.cc:276] 0709 13:07:04.719057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.797460 (+2078403us) service_pool.cc:224] Handling call
0709 13:07:06.797764 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.881973 (+ 84209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:06.905354 (+ 23381us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.284976 (+379622us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18003fa180. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:07.545761 (+260785us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.547400 (+  1639us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.547536 (+   136us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.547568 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.547627 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.962691 (+1415064us) raft_consensus.cc:1685] finished
0709 13:07:08.962901 (+   210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.963163 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97478,"prepare.queue_time_us":30699,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":94639,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":64958,"spinlock_wait_cycles":32807808,"thread_start_us":575514,"threads_started":1,"wal-append.queue_time_us":1456073}
I20260709 13:07:08.981618 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1603) took 1341 ms. Trace:
I20260709 13:07:08.982005 16462 rpcz_store.cc:276] 0709 13:07:07.640305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.938227 (+1297922us) service_pool.cc:224] Handling call
0709 13:07:08.948534 (+ 10307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.981242 (+ 32708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.981271 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.981331 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:08.981381 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.981440 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.981546 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21689}
I20260709 13:07:08.963181 19064 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:08.985548 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.987002 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82579.1us
I20260709 13:07:08.994591 18890 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:08.995885 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 472) took 1008 ms. Trace:
W20260709 13:07:08.998694 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.001176 16466 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:09.001540 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 389) took 4212 ms. Trace:
I20260709 13:07:09.001819 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1639) took 2159 ms. Trace:
I20260709 13:07:09.001935 16618 rpcz_store.cc:276] 0709 13:07:04.789442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.609945 (+3820503us) service_pool.cc:224] Handling call
0709 13:07:08.610277 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.841476 (+231199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.001267 (+159791us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003da254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:09.001466 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408307456}
I20260709 13:07:09.002278 16466 rpcz_store.cc:276] 0709 13:07:06.842765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.898791 (+2056026us) service_pool.cc:224] Handling call
0709 13:07:08.954357 (+ 55566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.001585 (+ 47228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.001748 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.006309 18562 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:09.006902 18996 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.007925 18957 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:09.012127 16614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1645) took 2128 ms (client timeout 2060 ms). Trace:
W20260709 13:07:09.012578 16614 rpcz_store.cc:269] 0709 13:07:06.883535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.970893 (+1087358us) service_pool.cc:224] Handling call
0709 13:07:09.011746 (+1040853us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003db654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:09.011913 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954631424}
W20260709 13:07:09.014744 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48952.6us
I20260709 13:07:09.014932 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 515) took 1479 ms. Trace:
I20260709 13:07:09.015324 17121 rpcz_store.cc:276] 0709 13:07:07.535513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.551772 (+ 16259us) service_pool.cc:224] Handling call
0709 13:07:09.014680 (+1462908us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54004ac754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:09.014858 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694364416}
I20260709 13:07:09.015900 18490 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:08.988456 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:09.031951 16511 connection.cc:256] RPC call timeout handler was delayed by -3.3069810780000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
I20260709 13:07:08.996301 17122 rpcz_store.cc:276] 0709 13:07:07.987339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.987484 (+   145us) service_pool.cc:224] Handling call
0709 13:07:07.987918 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.687647 (+699729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.687703 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.687762 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:08.687830 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.995366 (+307536us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54007b57d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:08.995437 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.995698 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608504192}
I20260709 13:07:09.037160 18809 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.037947 18809 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:09.038589 18889 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.038774 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.039356 18809 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.050385 16511 connection.cc:256] RPC call timeout handler was delayed by -3.3069810780000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
I20260709 13:07:09.051733 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.051841 19117 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:09.052433 17122 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.046972 19077 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:07:09.053776 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1584) took 4000 ms (client timeout 2006 ms). Trace:
W20260709 13:07:09.054277 16467 rpcz_store.cc:269] 0709 13:07:05.053793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.612395 (+558602us) service_pool.cc:224] Handling call
0709 13:07:09.053496 (+3441101us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54003e4254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:09.053669 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5126217088}
I20260709 13:07:09.054783 18797 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.046506 19037 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:07:09.055270 18797 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.046626 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:09.056633 18797 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:09.057561 19104 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.590s	user 0.000s	sys 0.005s
I20260709 13:07:09.058097 18797 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:09.041827 16616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1649) took 2157 ms (client timeout 2670 ms). Trace:
W20260709 13:07:09.061358 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73214.2us
I20260709 13:07:09.062429 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:09.065065 18817 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.065774 18817 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:09.067080 18817 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.067618 19034 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.044032 18912 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.068496 18912 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.069097 19047 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.069291 19067 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.069653 19047 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:09.070053 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 475) took 1065 ms. Trace:
I20260709 13:07:09.070182 19047 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.070477 17126 rpcz_store.cc:276] 0709 13:07:08.004928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.040403 (+ 35475us) service_pool.cc:224] Handling call
0709 13:07:08.040810 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.899965 (+859155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.069757 (+169792us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54006be254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:09.069982 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1740907264}
I20260709 13:07:09.072677 16461 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:09.073967 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.074745 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 289) took 1618 ms. Trace:
I20260709 13:07:09.075039 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.046733 18911 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:07:09.079246 18906 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.079787 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.080404 18906 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.045223 19108 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.081431 19067 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:09.060976 16616 rpcz_store.cc:269] 0709 13:07:06.884493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.352487 (+1467994us) service_pool.cc:224] Handling call
0709 13:07:09.041550 (+689063us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540025dd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:09.041743 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414769024}
I20260709 13:07:09.082142 19067 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.082671 19067 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.083402 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:09.083792 17119 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.009s	user 0.013s	sys 0.005s
I20260709 13:07:09.084332 17119 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.084831 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.081522 19108 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.085136 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.085565 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.086652 18889 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.086843 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:09.087033 16585 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.814s (SENT)
I20260709 13:07:09.085184 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.087272 19117 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:09.102120 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.087589 18906 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:09.088430 19101 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.110407 16585 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:09.090857 18805 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.092233 16583 leader_election.cc:336] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.579s (SENT)
I20260709 13:07:09.092425 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:09.069751 18912 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.075287 16461 rpcz_store.cc:276] 0709 13:07:07.502056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.938971 (+1436915us) service_pool.cc:224] Handling call
0709 13:07:09.072454 (+133483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.073230 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.074433 (+  1203us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003e4250. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:09.074644 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249141120}
I20260709 13:07:09.064484 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:09.097797 16511 connection.cc:256] RPC call timeout handler was delayed by -2.9858091759999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4002s for a response
I20260709 13:07:09.097500 17124 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:09.040745 18809 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.107990 17122 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:09.103205 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 470) took 1114 ms. Trace:
I20260709 13:07:09.123883 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:09.102380 19117 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:09.126240 17119 rpcz_store.cc:276] 0709 13:07:07.986380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.989470 (+  3090us) service_pool.cc:224] Handling call
0709 13:07:09.096680 (+1107210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.125217 19064 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.123870 17121 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 4: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:09.138980 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1597) took 2513 ms. Trace:
I20260709 13:07:09.133102 19037 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:07:09.139585 16468 rpcz_store.cc:276] 0709 13:07:06.584130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.568390 (+1984260us) service_pool.cc:224] Handling call
0709 13:07:08.568778 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.568992 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:08.821828 (+252836us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.954918 (+133090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.958473 (+  3555us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:09.022347 (+ 63874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.035770 (+ 13423us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.097400 (+ 61630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2739,"prepare.queue_time_us":289390,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":19273,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":205,"thread_start_us":328551,"threads_started":2,"wal-append.queue_time_us":115918}
W20260709 13:07:09.142417 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.109803 19101 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:09.143956 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6939950219999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
W20260709 13:07:09.150262 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6939950219999673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2029s for a response
I20260709 13:07:09.152554 19037 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.153100 19037 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:09.154206 19037 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.155848 19037 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.159014 19064 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:09.161064 18948 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:09.161528 18948 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.162779 18948 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.167415 18948 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:09.169795 19120 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:07:09.171098 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.172884 18906 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.176010 18939 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.154871 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.136355 18490 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:07:09.181562 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 117331us
I20260709 13:07:09.184746 18924 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:09.184891 19057 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.185592 19057 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.186033 19057 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.186645 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 94559.6us
I20260709 13:07:09.188243 19061 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:09.188897 19034 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:07:09.120909 18889 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.192368 18889 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:09.199429 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 112460us
I20260709 13:07:09.199982 19054 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.210394 19054 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:09.210918 19054 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.205451 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.213286 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.206296 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 176221us
I20260709 13:07:09.215718 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:09.217893 18805 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.221130 18912 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.225385 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.225772 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.225286 19117 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.226298 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.226823 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.207782 19101 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.209983 19123 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:07:09.252007 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6777950219999411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
W20260709 13:07:09.254155 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69423.1us
W20260709 13:07:09.255108 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6777950219999411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:07:09.226892 19117 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.259903 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6642950219999193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
W20260709 13:07:09.260273 16511 connection.cc:256] RPC call timeout handler was delayed by -2.5607950219999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:07:09.258155 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:09.266669 16511 connection.cc:256] RPC call timeout handler was delayed by -2.5274950219999255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:07:09.273540 16615 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.275782 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 390) took 4483 ms. Trace:
I20260709 13:07:09.276422 19047 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.279285 19047 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:09.276234 16615 rpcz_store.cc:276] 0709 13:07:04.792028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.834676 (+4042648us) service_pool.cc:224] Handling call
0709 13:07:08.835553 (+   877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.274065 (+438512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.275517 (+  1452us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003e7454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:09.275717 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979298048}
I20260709 13:07:09.296012 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.298532 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.300321 18945 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.300807 18945 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.301851 18945 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.302002 19057 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.303200 18945 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.304139 19057 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:09.308890 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78806.8us
W20260709 13:07:09.311290 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.311183 19054 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.313324 17119 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:09.313663 19108 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.315119 19108 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:09.316200 19108 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:09.316612 19108 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:09.321563 19108 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.322841 16511 connection.cc:256] RPC call timeout handler was delayed by -2.5274950219999255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
I20260709 13:07:09.323123 19108 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:09.323314 16511 connection.cc:256] RPC call timeout handler was delayed by -2.4561009840000452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:07:09.323731 16511 connection.cc:256] RPC call timeout handler was delayed by -2.4356950220000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2316s for a response
W20260709 13:07:09.324057 16511 connection.cc:256] RPC call timeout handler was delayed by -2.3895009840000512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:07:09.324385 16511 connection.cc:256] RPC call timeout handler was delayed by -2.2995009840000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:07:09.324709 16511 connection.cc:256] RPC call timeout handler was delayed by -2.234995022000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2539s for a response
W20260709 13:07:09.325058 16511 connection.cc:256] RPC call timeout handler was delayed by -2.2023009839999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:07:09.325349 16511 connection.cc:256] RPC call timeout handler was delayed by -2.2023009839999759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:07:09.325623 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1861009839999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:07:09.325913 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1861009839999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
W20260709 13:07:09.326221 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1420009839999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:07:09.326527 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1420009839999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 13:07:09.326821 16511 connection.cc:256] RPC call timeout handler was delayed by -2.0538009839999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:07:09.327102 16511 connection.cc:256] RPC call timeout handler was delayed by -2.0538009839999631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:07:09.327378 16511 connection.cc:256] RPC call timeout handler was delayed by -1.771200983999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
W20260709 13:07:09.327682 16511 connection.cc:256] RPC call timeout handler was delayed by -1.6227009839999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2539s for a response
W20260709 13:07:09.327975 16511 connection.cc:256] RPC call timeout handler was delayed by -1.504800983999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.267s for a response
W20260709 13:07:09.328294 16511 connection.cc:256] RPC call timeout handler was delayed by -1.3674810779999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4308s for a response
I20260709 13:07:09.329905 18805 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:09.330101 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 114500us
I20260709 13:07:09.332715 16434 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:09.333542 19101 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.334254 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:09.335322 18490 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:09.335841 18490 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.336498 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.337998 18490 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.338547 18490 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.338881 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.339131 18490 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.339798 16461 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.341084 19064 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.341151 18948 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:09.341683 19064 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.341958 18948 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.343353 18948 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.343961 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.344806 16468 raft_consensus.cc:2376] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7. Re-sending same reply.
I20260709 13:07:09.342101 19064 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.343317 18490 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:09.353030 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 98982.1us
I20260709 13:07:09.353649 18957 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.354343 18957 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.354892 18957 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.356093 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.361792 16461 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:07:09.363708 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.364360 16461 raft_consensus.cc:1217] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-7.7]   Dedup: 4.6->[7.7-7.7]
I20260709 13:07:09.365108 16461 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [4.6-7.7]
I20260709 13:07:09.365185 18939 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.353777 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:09.328583 16511 connection.cc:256] RPC call timeout handler was delayed by -1.2942009839999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2904s for a response
W20260709 13:07:09.368292 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80807us
I20260709 13:07:09.332566 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:09.372272 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1604) took 1731 ms. Trace:
I20260709 13:07:09.372869 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:09.377362 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 127785us
W20260709 13:07:09.378623 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.373303 16463 rpcz_store.cc:276] 0709 13:07:07.640522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.949390 (+1308868us) service_pool.cc:224] Handling call
0709 13:07:08.951404 (+  2014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:08.951887 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:08.953622 (+  1735us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.371935 (+418313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:09.371994 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:09.372055 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.372124 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:09.372222 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2202,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"thread_start_us":413982,"threads_started":1}
I20260709 13:07:09.352574 19067 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.391490 16544 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:09.391641 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.392334 16463 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:09.400707 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.376068 18939 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.403607 18805 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:09.404531 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:09.405972 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.418236 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64546.4us
I20260709 13:07:09.419039 16463 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:09.425774 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.375820 19002 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.420632 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.425149 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.444983 16616 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:07:09.371973 19106 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:07:09.451448 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.428712 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:09.443308 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:09.461346 17093 connection.cc:256] RPC call timeout handler was delayed by -1.0117588489998752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:07:09.462247 19003 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:09.462885 19003 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.464416 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 131892us
I20260709 13:07:09.459326 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:09.469389 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.470443 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:09.471019 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.429304 18805 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:09.472087 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.429870 18797 raft_consensus.cc:2764] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:09.446816 19054 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:09.467679 19033 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.581s	user 0.005s	sys 0.010s
I20260709 13:07:09.479244 18805 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.481129 18911 raft_consensus.cc:2764] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:07:09.419171 19047 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:07:09.485255 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:09.486327 16613 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:09.487668 17126 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:09.488310 18490 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.488734 18490 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.489100 18490 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.489996 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.493166 16615 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:09.494912 17122 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.498494 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:09.499226 16541 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.502197 18817 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:09.513263 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.514225 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.515369 16463 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:09.516163 16545 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:09.516726 17119 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:09.518698 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.519345 16544 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:09.519766 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.520197 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.520390 16540 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.520705 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.521386 16544 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:09.521555 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:09.522197 16536 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.525545 19061 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.526052 19061 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:09.527329 19061 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.528913 19061 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.532814 19054 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.533905 19064 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.537283 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:09.520392 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:09.533257 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 76975.3us
W20260709 13:07:09.545362 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 61014us
I20260709 13:07:09.545871 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:09.553591 19133 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:07:09.555783 19135 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:09.553889 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.537283 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.557525 17118 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:09.558569 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:09.560221 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.560715 18797 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:09.561774 19003 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.562279 18797 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.536613 19064 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.565172 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.565438 18490 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.556631 16542 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:09.560406 18948 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.567901 18490 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.545058 16543 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.575985 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.565197 16585 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.600535 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.601454 17122 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.615641 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.617334 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.621459 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:09.623687 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.568542 18490 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:07:09.631927 16467 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.637807 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.634781 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:09.648872 19131 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:09.645215 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.646600 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.634341 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:09.650596 16610 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:09.661851 16463 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:09.653776 16611 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:09.637414 18817 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.654959 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.634156 19067 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:09.670605 16616 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:09.674463 17122 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:09.645346 19065 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.640442 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.677637 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.682027 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.632084 18562 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:09.682256 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:09.683491 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 57642.1us
I20260709 13:07:09.683730 16613 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:09.675709 19065 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.694482 16467 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:09.691860 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:09.697333 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71293.7us
I20260709 13:07:09.701270 16619 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:07:09.703998 19138 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:09.706373 18976 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.706988 18976 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:09.708045 18976 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:09.693356 19002 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:09.702333 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:09.710635 17122 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:09.716351 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.697479 19065 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.717342 16613 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
W20260709 13:07:09.745914 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.746495 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.746826 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.721541 19139 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:07:09.760396 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.758874 17093 leader_election.cc:336] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.809s (SENT)
I20260709 13:07:09.762017 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:09.699168 18817 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.768728 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:09.774307 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.774962 16536 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.776799 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:09.778492 19145 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:09.778676 19077 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:09.780491 19003 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:09.781673 19003 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.782085 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:09.782795 19003 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:09.783176 19003 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:09.783715 18911 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:09.779277 18490 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.784830 18490 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.777153 18957 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.787209 18490 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.784139 18911 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:09.788996 18911 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:09.790923 18911 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:09.779668 19137 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:07:09.788033 18957 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.792567 18817 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:09.794955 16434 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:09.793095 16610 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:07:09.798662 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.804101 19057 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.804642 19057 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.804944 18490 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:09.805156 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.805742 18809 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:09.805656 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:09.806315 18809 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.806540 18805 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.806825 18809 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:09.807318 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:09.807240 18805 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:09.808183 19143 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:07:09.779898 19002 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.808979 19070 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:09.809229 19002 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:09.809643 19054 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.809784 19002 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.810148 19108 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:09.810240 19054 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.810722 19108 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.811175 19108 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:09.811249 16468 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:09.811756 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.812310 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.812609 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.823115 16463 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:09.763284 18939 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:07:09.827061 16541 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:09.827572 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.828358 16461 raft_consensus.cc:2376] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 6. Re-sending same reply.
I20260709 13:07:09.778499 19103 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:09.805068 19057 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:09.805577 18490 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:09.830765 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:09.837643 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 86239.9us
I20260709 13:07:09.834506 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:09.835234 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.843904 19160 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:09.834188 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.853672 19070 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:09.855309 19070 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.860261 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51892.2us
I20260709 13:07:09.784127 19003 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:09.871925 19152 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.872052 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.872617 19152 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.872727 19064 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.873090 19152 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.872361 19003 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.833949 18957 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.870848 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.834262 19103 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.887109 16469 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:09.888273 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:09.868187 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.895867 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.895941 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.902627 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:09.903867 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.905539 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:09.893113 18945 consensus_meta.cc:287] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.589s	user 0.015s	sys 0.000s
W20260709 13:07:09.907058 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.908310 16618 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:07:09.908209 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:09.910123 16469 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:09.892871 19103 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:09.912096 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.909931 16618 pending_rounds.cc:85] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
W20260709 13:07:09.912536 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 81868.5us
I20260709 13:07:09.914979 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.916354 16616 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:09.917670 16462 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.884904 19047 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:09.920384 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:09.919296 16465 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:09.920800 16470 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:09.921082 16612 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:09.913798 16618 pending_rounds.cc:107] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:09.921496 16618 raft_consensus.cc:2889] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.911753 19061 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:09.900511 18957 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:09.925604 19140 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:07:09.929235 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:09.922544 17121 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:09.941563 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:09.948182 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:09.912406 18817 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:09.926066 18805 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:09.965647 16613 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:09.965516 16464 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:09.955950 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:09.974288 19154 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:09.974810 17122 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:09.950390 19101 consensus_meta.cc:287] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.616s	user 0.012s	sys 0.000s
I20260709 13:07:09.980417 16613 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:09.938508 19064 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.980540 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:09.938627 19061 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:10.004758 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 53298us
I20260709 13:07:09.925933 19077 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:07:10.011391 16470 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:10.012494 16465 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:07:10.014690 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.964159 19117 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:09.986122 19064 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.022910 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:09.957302 18945 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:07:09.928269 18490 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.004922 19054 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.029932 19054 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:10.030356 19054 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.030710 19054 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.033049 19162 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:10.037500 19112 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:10.015440 18939 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.028474 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.987846 19161 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:07:10.024437 19108 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.024413 19064 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:10.056515 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 108419us
I20260709 13:07:10.066179 19108 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.067212 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:10.069130 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:10.070513 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:10.071379 16612 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:10.071535 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.080804 16582 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:10.081881 18939 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.083923 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.084077 18939 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:10.085358 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:10.086727 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.101998 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:10.076464 17118 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:07:10.051949 19101 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:07:10.114634 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 187954us
I20260709 13:07:10.061311 19112 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:07:10.118938 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:10.124524 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.050454 19061 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.071677 19106 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:07:10.179817 19177 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:10.180651 19177 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.183429 19177 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.136423 19068 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:10.202306 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 115659us
W20260709 13:07:10.203787 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 91727.6us
I20260709 13:07:10.204790 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:10.218433 19171 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.219002 19171 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.219331 19171 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.219587 18809 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.221360 19175 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.223059 19065 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:10.256657 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.259953 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:10.260850 16461 raft_consensus.cc:2376] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 8. Re-sending same reply.
I20260709 13:07:10.262364 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:10.263227 16461 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:10.263870 19064 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.265424 16610 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:10.267060 19064 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.268216 16610 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:10.270956 16610 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:10.290649 19159 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.291383 19159 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.293659 19057 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:10.298122 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46679.1us
I20260709 13:07:10.298808 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:10.205170 19168 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.202217 18957 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:10.303298 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 98621us
I20260709 13:07:10.306433 16613 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:10.272804 19068 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.306408 18809 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.307863 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:10.307423 16610 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:07:10.371119 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63324.3us
I20260709 13:07:10.232259 19152 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.303337 19057 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:10.350555 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:10.360615 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61847.7us
I20260709 13:07:10.313272 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.372678 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:10.359942 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 191695us
I20260709 13:07:10.306308 19002 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.318470 19175 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.381330 19065 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:10.381414 19167 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:07:10.382632 19172 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:07:10.379736 19112 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.375274 19068 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:10.396137 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 82969.4us
I20260709 13:07:10.393923 19159 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:10.397873 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:10.380045 18945 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.404179 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.389029 19175 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:10.406322 19112 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.407635 19178 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.407938 18924 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:10.414258 18924 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:10.411975 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:10.415107 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.419407 18924 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.420315 19152 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:10.421010 19180 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:07:10.420506 18924 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:10.413772 19175 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.418370 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:10.406440 18957 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:10.429440 19188 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:10.467356 19103 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.548s	user 0.002s	sys 0.007s
I20260709 13:07:10.457525 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:10.465049 17121 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:10.424564 19178 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:10.464262 17118 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:10.483261 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58510.9us
I20260709 13:07:10.479341 16541 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:10.479866 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:10.485653 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.485956 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 106949us
I20260709 13:07:10.463650 19068 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.485828 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 71858.7us
I20260709 13:07:10.485073 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 402) took 1067 ms. Trace:
I20260709 13:07:10.488924 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.489789 16538 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:10.463068 19159 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:10.492933 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.493270 16543 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:10.495153 16536 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:10.489074 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.493571 16545 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:10.482183 19067 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:10.500682 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.499161 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:10.486825 19180 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.496717 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:10.502120 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.502956 16539 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:10.501371 16544 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:10.488876 19152 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.500833 16540 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:10.507794 16541 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:10.508692 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.509830 19033 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.510242 19033 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:10.511193 19033 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.513238 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.512507 19033 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.514098 16509 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:10.515921 16543 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:10.482725 19103 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.519008 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.519174 19070 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.519634 19170 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.519657 16537 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:10.520969 19181 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.521209 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.495297 19064 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:07:10.516701 19152 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.495502 18805 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:07:10.523671 19152 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:10.524068 16541 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:10.512928 19067 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.487534 16614 rpcz_store.cc:276] 0709 13:07:09.408401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.418666 (+ 10265us) service_pool.cc:224] Handling call
0709 13:07:09.451401 (+ 32735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:09.476690 (+ 25289us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:09.595547 (+118857us) log.cc:844] Serialized 14 byte log entry
0709 13:07:10.187329 (+591782us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b1800458e60. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:07:10.475406 (+288077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:10.475455 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:10.475498 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.475558 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.475669 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153166,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1501,"raft.queue_time_us":18520,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4748,"spinlock_wait_cycles":5755776,"thread_start_us":377927,"threads_started":2}
I20260709 13:07:10.529095 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:10.530187 19186 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:10.531677 19176 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:10.532186 19176 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:10.533681 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.520229 19170 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.534418 19170 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.536489 19176 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.537580 19176 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.532820 19162 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.491259 19171 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.542500 19171 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:10.491426 19054 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.544579 19054 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.546337 19164 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:10.546752 19164 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:10.546921 19067 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:10.547495 19067 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.493530 19068 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.548215 16468 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:10.548017 19067 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.550127 19067 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:10.550598 19068 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.551648 17126 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.499835 19178 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:10.552940 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:10.553503 16465 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:10.553869 19178 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.557756 17119 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:10.558094 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:10.559113 16468 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:10.559696 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:10.563352 19148 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.774s	user 0.000s	sys 0.003s
I20260709 13:07:10.559041 17122 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.493427 19188 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:07:10.547636 19164 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:10.544610 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:10.568647 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.590654 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 103318us
W20260709 13:07:10.592873 19190 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:07:10.593035 19002 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.587144 18945 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:10.594318 19157 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:10.596693 19157 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:10.597116 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 110323us
I20260709 13:07:10.597844 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:10.598611 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.599144 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:10.599215 16540 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:10.600301 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.600567 19175 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:10.600894 16540 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:10.602159 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:10.603161 19175 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:10.603334 16539 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:10.603595 16540 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:07:10.604656 16539 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:10.608165 16540 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:10.540652 19112 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.700915 16537 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:10.613971 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.057667 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.063642 16468 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:10.775719 16465 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:10.638130 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:11.066843 16461 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:10.714246 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:10.691537 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 92467.6us
I20260709 13:07:11.074064 16542 raft_consensus.cc:2410] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:10.801208 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 407) took 1252 ms. Trace:
I20260709 13:07:11.062579 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:11.031490 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.075488 16539 raft_consensus.cc:2410] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:10.632627 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:11.078104 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.079375 16540 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 4: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:10.642309 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.632567 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.086390 16544 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.758761 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:11.087440 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.087570 16545 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:11.084029 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:11.086395 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.088951 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 456412us
W20260709 13:07:11.026553 19150 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:07:11.089668 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:10.591756 19171 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.091516 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:10.612701 19164 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.091888 16536 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:11.074561 16615 rpcz_store.cc:276] 0709 13:07:09.548469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.548616 (+   147us) service_pool.cc:224] Handling call
0709 13:07:09.565500 (+ 16884us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:09.565921 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:09.565957 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:09.566577 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 13:07:09.602259 (+ 35682us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:09.661959 (+ 59700us) log.cc:844] Serialized 14 byte log entry
0709 13:07:09.662181 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:09.662346 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:10.562595 (+900249us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:10.784426 (+221831us) raft_consensus.cc:1685] finished
0709 13:07:10.800737 (+ 16311us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:10.801126 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46849,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":24344,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"spinlock_wait_cycles":10996608,"thread_start_us":94596,"threads_started":2,"wal-append.queue_time_us":180707}
I20260709 13:07:10.783493 19152 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.092881 16542 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.092182 19002 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.093624 18490 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:11.094098 19191 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:07:10.666406 19162 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.826119 19179 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.114006 16536 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.095945 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.096418 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:10.632375 19037 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.056406 18976 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:10.757800 18957 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.685401 19101 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.099711 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.119493 16541 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.700856 19176 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.758174 19054 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.012236 19103 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:10.606251 18817 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.485s
I20260709 13:07:11.125346 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.103703 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.126477 16540 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:11.086027 19047 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.592032 18924 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.507s
I20260709 13:07:11.108295 16545 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:10.666648 18890 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.435s
I20260709 13:07:11.105355 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:11.091521 19067 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:11.099285 19068 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.117239 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:11.095024 19171 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.121143 19112 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.130453 16470 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:11.134953 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:11.133561 18976 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.142998 18809 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:11.128139 19176 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.128311 18957 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.164424 16465 raft_consensus.cc:2376] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 8. Re-sending same reply.
I20260709 13:07:11.107309 19152 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.119663 19179 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:11.129446 16463 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:11.167356 16545 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:11.167616 16539 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.129133 19054 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.145491 19103 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.153908 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.172190 16541 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:11.147704 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 298) took 1344 ms. Trace:
I20260709 13:07:11.121424 19162 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.147114 19171 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.153702 18562 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.149643 19064 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.172669 16464 rpcz_store.cc:276] 0709 13:07:09.803435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.813296 (+  9861us) service_pool.cc:224] Handling call
0709 13:07:11.147519 (+1334223us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b54000b3e54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:11.147633 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214076544}
I20260709 13:07:11.174414 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:11.179803 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.182338 16539 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.183856 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.169369 19077 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:11.147940 19067 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.148587 19047 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.154170 19112 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.173875 18805 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:11.198872 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 257281us
I20260709 13:07:11.171801 19182 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:07:11.195492 19178 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:07:11.169876 18809 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:11.206310 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 74297.3us
I20260709 13:07:11.210242 16540 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:11.179788 18945 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:11.212693 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.189618 19077 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:11.213454 19176 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:11.178220 19103 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.185247 19064 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:11.218564 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 294) took 1416 ms (client timeout 1871 ms). Trace:
W20260709 13:07:11.224483 16467 rpcz_store.cc:269] 0709 13:07:09.802354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.811509 (+  9155us) service_pool.cc:224] Handling call
0709 13:07:11.218299 (+1406790us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002a85d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:11.218483 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522578304}
I20260709 13:07:11.215451 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 3.
I20260709 13:07:11.214876 16544 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:11.228128 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:11.186864 18562 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.234342 16540 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:11.235198 16467 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.239423 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:11.240269 16612 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.248610 16540 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:11.253124 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:11.253906 16613 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:11.255820 16616 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:11.256516 16539 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:11.258719 16536 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:11.259076 16536 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:11.259804 16536 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:11.260815 16536 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:11.262072 18906 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:11.264525 19002 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:11.265231 19002 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.227234 19176 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.270728 16614 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:11.274961 16536 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:11.275419 16536 pending_rounds.cc:85] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 4
I20260709 13:07:11.275705 16536 pending_rounds.cc:107] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:11.276002 16536 raft_consensus.cc:2889] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.276865 16540 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:07:11.278080 19194 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:11.278477 19037 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:11.195847 19179 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.281183 19179 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.284536 19162 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.285231 18957 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:11.210359 18805 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.298115 16542 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:11.298250 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.298875 16540 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.298872 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.299633 16539 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:11.300666 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.301533 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.303741 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:11.306244 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.306860 16536 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:11.314280 16539 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:11.315886 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:11.316104 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.320343 16613 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:11.321209 16616 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:11.322980 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.324046 16541 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:11.325078 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.327356 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.328737 16463 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:11.328094 16543 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:11.285621 19152 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.338858 16619 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:11.347028 16538 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:11.355358 16540 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:11.285640 19068 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:11.269829 18906 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.329602 18957 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.388630 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:11.390698 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 87047.3us
I20260709 13:07:11.317281 19176 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.353686 18945 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.399740 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.400794 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:11.412191 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:11.413331 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:11.414608 16611 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:11.392946 19054 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:11.388232 19152 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:11.388446 19202 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:07:11.340925 19077 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:11.440044 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 324484us
W20260709 13:07:11.444439 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.411051 19047 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:11.399117 18957 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.469023 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.427992 18809 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.408180 18945 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.435842 19067 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.476392 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:11.481504 17119 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:11.433050 18976 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.442015 19112 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:11.486071 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 258004us
W20260709 13:07:11.486658 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.477790 19077 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:11.475860 19047 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:11.496855 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 321160us
I20260709 13:07:11.502156 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:11.502929 16543 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:11.485772 19033 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.000s
W20260709 13:07:11.531700 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 386460us
I20260709 13:07:11.496165 16509 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:11.489162 19101 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:11.486526 19068 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.549578 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 53489.1us
I20260709 13:07:11.538514 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:11.484757 19103 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:11.540199 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 114707us
I20260709 13:07:11.553301 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:11.545496 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:11.549011 17092 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.246.126:40851, user_credentials={real_user=slave}} blocked reactor thread for 49453.6us
I20260709 13:07:11.495083 19064 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.483553 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:11.539713 19170 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.005s	user 0.012s	sys 0.000s
I20260709 13:07:11.498108 19067 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.482151 19204 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:07:11.476965 19037 consensus_queue.cc:1175] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 7 status { last_received { term: 7 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 7 index: 7 } }
W20260709 13:07:11.596580 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51168.3us
I20260709 13:07:11.497483 19188 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:07:11.598929 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:11.597236 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.537860 18562 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:11.602197 19196 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.461s	user 0.007s	sys 0.006s
I20260709 13:07:11.603982 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1632) took 1675 ms. Trace:
I20260709 13:07:11.604388 16462 rpcz_store.cc:276] 0709 13:07:09.928455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.928612 (+   157us) service_pool.cc:224] Handling call
0709 13:07:09.950119 (+ 21507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.077895 (+127776us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:10.077942 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.553360 (+475418us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2c00000f48. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:07:10.553809 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.673123 (+119314us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.673175 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.673268 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.497749 (+824481us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:11.603778 (+106029us) raft_consensus.cc:1685] finished
0709 13:07:11.603799 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:11.603925 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15920,"raft.queue_time_us":70298,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":22115968,"thread_start_us":209332,"threads_started":2,"wal-append.queue_time_us":587223}
W20260709 13:07:11.606418 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.500190 18976 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:07:11.579237 18924 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:11.630462 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 101578us
I20260709 13:07:11.607926 19064 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.553841 19054 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.582253 18805 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:11.580209 19178 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:11.578948 19047 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:07:11.594067 19170 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.578703 19068 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:11.595794 17118 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:11.675627 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.583348 19216 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.597864 18490 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:11.636041 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 195085us
W20260709 13:07:11.692927 16466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.004s	sys 0.023s
I20260709 13:07:11.554314 18809 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:11.617285 19067 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:11.717890 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:11.659722 19223 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:07:11.649219 19202 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:11.660452 18562 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:11.682514 19054 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:11.744055 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.654652 19176 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:11.731021 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.732245 19203 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:11.684486 18906 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.614720 19152 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:07:11.752041 19218 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:11.769790 19215 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:11.777484 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:11.778273 16614 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:11.779328 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:11.779904 16614 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:11.780637 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:11.782202 19054 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:11.783259 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:11.784211 16614 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:11.785012 18976 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:11.785408 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:11.786044 18976 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.786389 16614 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:11.714869 18809 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:11.731266 16612 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:11.687034 19064 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:11.755890 16464 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:11.731767 18490 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:11.781458 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 94982.6us
I20260709 13:07:11.781319 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:11.608186 19204 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:07:11.797147 16543 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:11.783157 19224 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.153s	user 0.004s	sys 0.000s
I20260709 13:07:11.786715 18976 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:11.817631 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.747563 19067 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.818084 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:11.715101 19101 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:11.820883 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.821470 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:11.822189 17126 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:11.762380 18957 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:11.818362 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:11.829566 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:11.817963 17118 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:11.752254 19232 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:07:11.796890 19202 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:11.834244 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:11.835469 19179 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.003s
I20260709 13:07:11.805861 18809 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:11.838822 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:11.839695 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.841091 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:11.912708 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.861006 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.834266 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:11.907408 16470 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:12.043219 16537 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:11.967629 16542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.013s	sys 0.006s
W20260709 13:07:11.969542 16465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.014s
I20260709 13:07:12.572824 16538 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.573158 18976 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:12.113143 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 559873us
I20260709 13:07:12.189603 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1648) took 1071 ms. Trace:
W20260709 13:07:12.094627 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 191926us
I20260709 13:07:12.115593 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:12.602731 16463 rpcz_store.cc:276] 0709 13:07:11.118655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.173255 (+ 54600us) service_pool.cc:224] Handling call
0709 13:07:12.189381 (+1016126us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003aeb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:12.189527 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331714816}
I20260709 13:07:12.603441 16464 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:12.383049 19213 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
W20260709 13:07:12.445942 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.595037 16465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.017s	sys 0.025s
I20260709 13:07:12.351105 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:12.595074 16540 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
W20260709 13:07:12.043654 16536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.001s	sys 0.022s
W20260709 13:07:12.295774 16583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.745s (SENT) [suppressed 19 similar messages]
W20260709 13:07:12.610387 16536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.082s	user 0.007s	sys 0.035s
W20260709 13:07:12.604081 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.612295 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.610510 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:12.610352 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 383) took 1027 ms. Trace:
W20260709 13:07:11.924759 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.010s	sys 0.014s
W20260709 13:07:12.594504 16542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.200s	user 0.016s	sys 0.025s
W20260709 13:07:12.615459 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.015s	sys 0.028s
W20260709 13:07:12.614271 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.611519 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1928) took 1283 ms. Trace:
W20260709 13:07:12.608928 19231 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.514s	user 0.001s	sys 0.001s
I20260709 13:07:12.613528 16540 rpcz_store.cc:276] 0709 13:07:11.582995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.838534 (+255539us) service_pool.cc:224] Handling call
0709 13:07:12.610215 (+771681us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.619066 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1925) took 1292 ms. Trace:
W20260709 13:07:12.114208 19171 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.923s	user 0.009s	sys 0.009s
W20260709 13:07:12.095261 19077 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.003s
W20260709 13:07:12.539211 19230 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
W20260709 13:07:12.619426 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.28955e+06us
W20260709 13:07:11.943804 19205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.017s	sys 0.000s
I20260709 13:07:11.924567 19219 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.014108 19208 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.169278 19195 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.028s	user 0.004s	sys 0.000s
I20260709 13:07:11.819845 18562 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:11.928293 18924 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:12.622046 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1864) took 1387 ms. Trace:
I20260709 13:07:12.619437 16538 rpcz_store.cc:276] 0709 13:07:11.327168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.517658 (+1190490us) service_pool.cc:224] Handling call
0709 13:07:12.572571 (+ 54913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.609579 (+ 37008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.619014 (+  9435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:12.390265 19235 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:07:12.616117 16537 rpcz_store.cc:276] 0709 13:07:11.328092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.833894 (+505802us) service_pool.cc:224] Handling call
0709 13:07:12.611458 (+777564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.623924 16434 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:12.629979 17119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.003s	sys 0.012s
I20260709 13:07:11.889448 19067 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:12.663663 17119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.006s	sys 0.014s
I20260709 13:07:11.841601 19047 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:12.420572 19064 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:12.669596 19047 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:12.669855 19064 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.670388 19064 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.670811 19064 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.670859 19047 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.114321 19221 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:12.673158 19221 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.589743 18490 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.676533 19221 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:12.043538 17120 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:12.433490 19068 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:12.002311 19152 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:12.620891 19179 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:12.685842 19179 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.622562 19210 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.652451 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:12.689082 19210 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.691681 19210 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.138352 19170 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.689486 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1659) took 1055 ms. Trace:
W20260709 13:07:12.660164 17122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.016s
W20260709 13:07:12.692965 17122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.016s
I20260709 13:07:12.692750 19170 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.692592 16463 rpcz_store.cc:276] 0709 13:07:11.633719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.622998 (+989279us) service_pool.cc:224] Handling call
0709 13:07:12.689405 (+ 66407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:12.693491 19170 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.696966 19170 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.697616 19170 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:12.698197 19170 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.702108 19152 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.699440 19179 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.706279 19152 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.706908 19170 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:12.708057 19170 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:12.659600 16610 rpcz_store.cc:276] 0709 13:07:11.234699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.234853 (+   154us) service_pool.cc:224] Handling call
0709 13:07:11.235171 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.432149 (+196978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.432194 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.438759 (+  6565us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.600927 (+162168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:11.600975 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.601036 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.034511 (+433475us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b4800150258. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:07:12.618377 (+583866us) raft_consensus.cc:1685] finished
0709 13:07:12.618398 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.621983 (+  3585us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40225,"raft.run_cpu_time_us":5319,"raft.run_wall_time_us":755887,"spinlock_wait_cycles":19582720,"thread_start_us":314591,"threads_started":2,"wal-append.queue_time_us":445514}
I20260709 13:07:12.652206 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:12.657048 19205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.017s	sys 0.021s
I20260709 13:07:12.799343 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 310) took 1681 ms. Trace:
I20260709 13:07:12.804685 16466 rpcz_store.cc:276] 0709 13:07:11.118120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.118440 (+   320us) service_pool.cc:224] Handling call
0709 13:07:11.126255 (+  7815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.135398 (+  9143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.135432 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.154068 (+ 18636us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.708208 (+554140us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:11.732813 (+ 24605us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.734394 (+  1581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.734478 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.799112 (+1064634us) raft_consensus.cc:1685] finished
0709 13:07:12.799131 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.799280 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1349,"prepare.queue_time_us":24056,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":5679,"raft.queue_time_us":6762,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":22247,"thread_start_us":516346,"threads_started":1,"wal-append.queue_time_us":754869}
I20260709 13:07:12.648631 18890 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.557641 19202 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.652230 19227 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.650614 19239 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:12.661731 19217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.005s	sys 0.033s
I20260709 13:07:12.710369 19101 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.831899 19254 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.832459 19254 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:12.832934 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1638) took 2287 ms. Trace:
I20260709 13:07:12.647791 19171 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:12.833297 16469 rpcz_store.cc:276] 0709 13:07:10.545580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.545948 (+   368us) service_pool.cc:224] Handling call
0709 13:07:10.546263 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:10.546583 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:10.546609 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:10.547059 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:07:10.613962 (+ 66903us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:10.614011 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:10.614096 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:11.750573 (+1136477us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:12.827067 (+1076494us) raft_consensus.cc:1685] finished
0709 13:07:12.827086 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.832869 (+  5783us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9781,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":605,"spinlock_wait_cycles":17290112,"thread_start_us":66468,"threads_started":1,"wal-append.queue_time_us":593943}
I20260709 13:07:12.648319 19246 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.182s
W20260709 13:07:12.871985 19200 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.504s	user 0.012s	sys 0.012s
W20260709 13:07:12.834273 19217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.005s	sys 0.033s
I20260709 13:07:12.659663 19219 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.662245 19208 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.885187 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 376) took 1561 ms. Trace:
I20260709 13:07:12.801643 18976 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:07:12.885823 16542 rpcz_store.cc:276] 0709 13:07:11.324193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.324325 (+   132us) service_pool.cc:224] Handling call
0709 13:07:11.345597 (+ 21272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.350054 (+  4457us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:12.615192 (+1265138us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.877293 (+262101us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.884715 (+  7422us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.884805 (+    90us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.884871 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.884957 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.885117 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31204,"prepare.queue_time_us":383817,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":979,"thread_start_us":1482561,"threads_started":2}
I20260709 13:07:12.867617 19239 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:12.800894 19245 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.181s
W20260709 13:07:12.881070 19249 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:07:12.903899 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.866161 19101 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.907341 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1865) took 1672 ms. Trace:
I20260709 13:07:12.803347 19064 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:12.935717 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.10147e+06us
W20260709 13:07:12.902654 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 252084us
W20260709 13:07:12.904973 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 609166us
I20260709 13:07:12.934930 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 377) took 1610 ms. Trace:
I20260709 13:07:12.938447 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:12.834481 18890 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:12.939189 16541 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:12.922426 16618 rpcz_store.cc:276] 0709 13:07:11.235071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.235214 (+   143us) service_pool.cc:224] Handling call
0709 13:07:11.253896 (+ 18682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.479898 (+226002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.479941 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.497554 (+ 17613us) log.cc:844] Serialized 52 byte log entry
0709 13:07:11.745685 (+248131us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:11.745745 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.745834 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:12.907048 (+1161214us) raft_consensus.cc:1685] finished
0709 13:07:12.907075 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.907267 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11627,"raft.queue_time_us":55872,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10616,"thread_start_us":391662,"threads_started":2,"wal-append.queue_time_us":497109}
W20260709 13:07:12.942643 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 318797us
I20260709 13:07:12.941291 16612 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:12.940438 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:12.946507 16537 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:12.899181 19103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.002s	sys 0.021s
I20260709 13:07:12.937546 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:12.837028 19227 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:12.944756 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 328617us
I20260709 13:07:12.971161 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:12.937747 16536 rpcz_store.cc:276] 0709 13:07:11.324606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.324723 (+   117us) service_pool.cc:224] Handling call
0709 13:07:11.325029 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.325226 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:11.513339 (+188113us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.934588 (+1421249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:12.934640 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:12.934693 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.934754 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:12.934874 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18807,"prepare.queue_time_us":395899,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":219655,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":1537826,"threads_started":3,"wal-append.queue_time_us":653422}
I20260709 13:07:12.975167 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:12.978351 19243 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:07:12.972895 19103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.002s	sys 0.021s
I20260709 13:07:12.979566 19068 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:12.900724 18562 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:12.987072 19179 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.011528 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:13.001412 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 163812us
I20260709 13:07:12.978927 19254 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:13.008314 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.017556 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:13.026094 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51026.2us
I20260709 13:07:13.027034 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.030014 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.032202 17127 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:12.986897 19210 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:07:13.034584 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.031350 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:13.038865 19273 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:13.089538 19265 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.089438 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58348.3us
I20260709 13:07:13.028525 19261 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.040710 19258 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:13.036154 19202 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:13.042061 19266 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.042232 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1658) took 1412 ms. Trace:
I20260709 13:07:13.104702 16467 rpcz_store.cc:276] 0709 13:07:11.629502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.629652 (+   150us) service_pool.cc:224] Handling call
0709 13:07:11.630016 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.647853 (+ 17837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.647889 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.653721 (+  5832us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.021123 (+367402us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:12.021174 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.021266 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.042015 (+1020749us) raft_consensus.cc:1685] finished
0709 13:07:13.042036 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.042178 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2378,"raft.queue_time_us":29697,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11549,"thread_start_us":366923,"threads_started":1,"wal-append.queue_time_us":1003747}
I20260709 13:07:13.106861 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1666) took 1092 ms. Trace:
I20260709 13:07:13.107165 16467 rpcz_store.cc:276] 0709 13:07:12.014941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.106170 (+1091229us) service_pool.cc:224] Handling call
0709 13:07:13.106441 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.106593 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.106616 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.106652 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.106685 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.106729 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.106814 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:13.108174 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:13.109236 19262 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:13.109688 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:13.110200 19241 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:13.109772 19262 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.110427 16616 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:13.110682 19218 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:13.111212 19218 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:13.111605 19253 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:13.006094 19239 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.043500 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:13.069763 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.006301 19068 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.087194 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.027051 19179 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.091007 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61748.8us
W20260709 13:07:13.098415 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.033643 19263 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.086977 19234 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:07:13.034369 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.103902 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:13.113435 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 538) took 1294 ms. Trace:
I20260709 13:07:13.115178 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1655) took 1489 ms. Trace:
I20260709 13:07:13.128620 16462 rpcz_store.cc:276] 0709 13:07:11.625565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.625726 (+   161us) service_pool.cc:224] Handling call
0709 13:07:11.631007 (+  5281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.631426 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:11.631462 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.631986 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.911712 (+279726us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:11.911768 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:11.911858 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.114915 (+1203057us) raft_consensus.cc:1685] finished
0709 13:07:13.114942 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.115101 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":405,"raft.queue_time_us":1103,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":18673,"thread_start_us":279302,"threads_started":1,"wal-append.queue_time_us":1083422}
I20260709 13:07:13.127192 16618 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:13.125309 19263 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.132701 19263 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.112840 19262 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.117883 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1665) took 1212 ms. Trace:
I20260709 13:07:13.118559 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1929) took 1790 ms. Trace:
I20260709 13:07:13.119269 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:07:13.120950 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 77611.9us
I20260709 13:07:13.090283 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:13.122491 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.091398 19265 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:13.112913 19255 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:07:13.102301 19171 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.165299 18890 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.134124 16469 rpcz_store.cc:276] 0709 13:07:11.906007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.865818 (+959811us) service_pool.cc:224] Handling call
0709 13:07:12.867895 (+  2077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.868375 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:12.999075 (+130700us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.117393 (+118318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.117583 (+   190us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.117630 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.117682 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.117741 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.117835 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167462,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":2306,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5236,"spinlock_wait_cycles":23352704,"thread_start_us":223234,"threads_started":2,"wal-append.queue_time_us":129795}
I20260709 13:07:13.139808 16540 rpcz_store.cc:276] 0709 13:07:11.328384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.617948 (+1289564us) service_pool.cc:224] Handling call
0709 13:07:12.618262 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.118224 (+499962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.118254 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.118293 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.118332 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.118404 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.118509 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664,"raft.queue_time_us":213244,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":473612,"threads_started":1}
I20260709 13:07:13.165468 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1867) took 1929 ms. Trace:
I20260709 13:07:13.156119 19276 raft_consensus.cc:2764] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:13.124289 19179 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.121677 19068 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.239120 17120 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.239156 19262 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.248111 19262 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:13.121908 19202 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:13.249547 19202 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.250180 19262 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.250981 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 532) took 1648 ms. Trace:
I20260709 13:07:13.251389 17119 rpcz_store.cc:276] 0709 13:07:11.603075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.604599 (+  1524us) service_pool.cc:224] Handling call
0709 13:07:11.605079 (+   480us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:11.605524 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.605562 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:11.606388 (+   826us) log.cc:844] Serialized 78 byte log entry
0709 13:07:12.665573 (+1059185us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.665603 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.665667 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.250764 (+585097us) raft_consensus.cc:1685] finished
0709 13:07:13.250784 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.250926 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123143,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":15672,"thread_start_us":928487,"threads_started":1,"wal-append.queue_time_us":1222161}
W20260709 13:07:13.167021 18809 consensus_meta.cc:287] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.053s	user 0.007s	sys 0.004s
I20260709 13:07:13.252871 18809 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.253444 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:13.253948 16543 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:13.254727 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:13.255621 19263 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.255846 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.256296 19263 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.256969 19256 raft_consensus.cc:2764] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:13.241460 16617 rpcz_store.cc:276] 0709 13:07:11.236154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.236285 (+   131us) service_pool.cc:224] Handling call
0709 13:07:11.236675 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:11.597185 (+360510us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:11.597212 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:11.612739 (+ 15527us) log.cc:844] Serialized 52 byte log entry
0709 13:07:12.038105 (+425366us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.038157 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.038252 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.165226 (+1126974us) raft_consensus.cc:1685] finished
0709 13:07:13.165247 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.165404 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31646,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":17813,"thread_start_us":784795,"threads_started":2,"wal-append.queue_time_us":1212140}
I20260709 13:07:13.258141 18809 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.127105 17123 rpcz_store.cc:276] 0709 13:07:11.819068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.819210 (+   142us) service_pool.cc:224] Handling call
0709 13:07:11.828366 (+  9156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.100864 (+272498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.113295 (+ 12431us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.143297 (+ 30002us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.665565 (+522268us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.665602 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.665667 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.113223 (+447556us) raft_consensus.cc:1685] finished
0709 13:07:13.113252 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.113378 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3947,"raft.queue_time_us":265786,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":31067,"thread_start_us":497555,"threads_started":1,"wal-append.queue_time_us":733539}
I20260709 13:07:13.164186 19227 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:13.134460 19251 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:13.229666 19258 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.259634 19258 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.260440 18945 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.261554 19273 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.261861 19258 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.261996 19219 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.262465 19211 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:13.263656 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 534) took 1495 ms. Trace:
I20260709 13:07:13.306416 17122 rpcz_store.cc:276] 0709 13:07:11.768032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.768142 (+   110us) service_pool.cc:224] Handling call
0709 13:07:11.768543 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.035715 (+267172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.042038 (+  6323us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.075045 (+ 33007us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.693402 (+618357us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.693443 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.693549 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.263467 (+569918us) raft_consensus.cc:1685] finished
0709 13:07:13.263485 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.263598 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31109,"raft.queue_time_us":20347,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":20259,"thread_start_us":542894,"threads_started":1,"wal-append.queue_time_us":766056}
I20260709 13:07:13.263777 19152 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.240175 19266 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.240474 19265 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:13.243070 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 120638us
I20260709 13:07:13.327567 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.329591 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.331533 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:13.332993 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 240801us
I20260709 13:07:13.284607 19227 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.340785 16511 leader_election.cc:400] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:13.348502 16511 leader_election.cc:403] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.325984 19152 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:13.308233 19211 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:13.308637 19064 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.103530 19261 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.334100 19219 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.350390 19273 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.337131 19258 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:13.394413 19276 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:13.365110 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:13.395905 18890 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:13.396268 16542 raft_consensus.cc:2376] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7. Re-sending same reply.
I20260709 13:07:13.396445 18890 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.397527 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.398216 16542 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:13.399181 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.366362 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.371261 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.420950 16538 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:13.421526 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.421783 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.422168 16536 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
W20260709 13:07:13.372634 19067 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.002s
I20260709 13:07:13.374341 19218 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.377439 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.341127 19275 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.380954 19227 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.382328 19261 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:13.382776 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56662us
I20260709 13:07:13.335809 19266 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.383177 19211 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.450538 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:13.462267 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1877) took 1665 ms. Trace:
W20260709 13:07:13.445782 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.447019 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1650) took 2318 ms. Trace:
I20260709 13:07:13.466930 16612 rpcz_store.cc:276] 0709 13:07:11.797273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.797530 (+   257us) service_pool.cc:224] Handling call
0709 13:07:12.042200 (+244670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.946301 (+904101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.461996 (+515695us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54000d66d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:13.462201 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059822976}
W20260709 13:07:13.384052 19238 log.cc:927] Time spent T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.845s	user 0.001s	sys 0.005s
W20260709 13:07:13.383906 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.386673 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1664) took 1590 ms. Trace:
I20260709 13:07:13.422336 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:13.332573 19068 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.468286 16466 rpcz_store.cc:276] 0709 13:07:11.796683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.807668 (+1010985us) service_pool.cc:224] Handling call
0709 13:07:13.386027 (+578359us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:07:13.386205 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:13.386369 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.386397 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:13.386435 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:13.386471 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.386521 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.386620 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10319616}
I20260709 13:07:13.455389 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1656) took 1828 ms. Trace:
I20260709 13:07:13.365767 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.405542 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:13.470194 16540 raft_consensus.cc:2410] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:13.384658 19152 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.415493 17120 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:13.466755 16539 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.481091 16582 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:13.452854 16543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 380) took 2126 ms (client timeout 2146 ms). Trace:
W20260709 13:07:13.482127 16543 rpcz_store.cc:269] 0709 13:07:11.326206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.816830 (+490624us) service_pool.cc:224] Handling call
0709 13:07:13.452579 (+1635749us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400380754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:13.452738 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785159936}
I20260709 13:07:13.482584 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.485978 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.486680 16536 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:13.467649 16461 rpcz_store.cc:276] 0709 13:07:11.129104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.176108 (+ 47004us) service_pool.cc:224] Handling call
0709 13:07:11.179878 (+  3770us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.350427 (+170549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.350472 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.351143 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.766758 (+415615us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:11.766798 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.373949 (+1607151us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:13.373997 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.374045 (+    48us) raft_consensus.cc:1685] finished
0709 13:07:13.390591 (+ 16546us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.446932 (+ 56341us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104529,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12403,"spinlock_wait_cycles":2583808,"thread_start_us":499149,"threads_started":2,"wal-append.queue_time_us":550958}
I20260709 13:07:13.489096 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.469275 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:13.389315 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.489902 16538 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:13.489946 16542 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:13.444309 18976 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.463449 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.492100 16541 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:13.492861 16539 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:13.466394 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:13.410609 19179 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.444296 18924 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:13.445087 19171 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:13.472997 19205 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.516963 19205 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:13.517357 19205 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.517429 19218 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.518379 18890 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.519048 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:13.520221 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:13.462566 19208 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.520813 16462 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:13.521277 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.520929 19171 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.467953 19258 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:13.493793 19211 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:13.474493 19188 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.522447 19188 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.522956 19171 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.513262 19175 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:13.475382 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:13.475862 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.509562 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:13.476015 19248 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.825s	user 0.002s	sys 0.000s
I20260709 13:07:13.476548 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.446620 19273 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:13.478821 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:13.469753 16468 rpcz_store.cc:276] 0709 13:07:11.626563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.626727 (+   164us) service_pool.cc:224] Handling call
0709 13:07:11.627070 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.781245 (+154175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.781277 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.781758 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.051467 (+269709us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.051544 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.454970 (+1403426us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003b9f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:13.455023 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.455072 (+    49us) raft_consensus.cc:1685] finished
0709 13:07:13.455087 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.455315 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1568,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":353783040,"thread_start_us":206307,"threads_started":1,"wal-append.queue_time_us":757860}
I20260709 13:07:13.550530 16537 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:07:13.473742 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:13.470260 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64841us
I20260709 13:07:13.496762 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:13.494215 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:13.553201 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59068.1us
I20260709 13:07:13.553869 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.521739 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:13.522357 19258 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.473762 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.476048 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.556173 16469 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:13.493322 16585 connection.cc:256] RPC call timeout handler was delayed by -1.0100539329999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 13:07:13.557600 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.558418 17122 raft_consensus.cc:2410] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:13.558991 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.559727 16543 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
W20260709 13:07:13.560647 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.555743 16466 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:13.498476 19261 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:13.524585 17121 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:13.532213 17125 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:13.513161 19219 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:13.478374 19067 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.563694 18890 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.591519 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.596375 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:13.390828 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 50354.9us
I20260709 13:07:13.563830 19218 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.532884 18924 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.602406 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:13.619079 16367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 170) took 17138 ms (client timeout 15000 ms). Trace:
I20260709 13:07:13.602276 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.532363 19175 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:13.602512 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:13.682116 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 200167us
I20260709 13:07:13.439483 19265 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.630177 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1871) took 2043 ms. Trace:
I20260709 13:07:13.563274 19208 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.688644 16611 rpcz_store.cc:276] 0709 13:07:11.587172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.587570 (+   398us) service_pool.cc:224] Handling call
0709 13:07:11.587942 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.595774 (+  7832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.595803 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.627107 (+ 31304us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.593523 (+966416us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.593569 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.593644 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.475381 (+881737us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:13.619513 (+144132us) raft_consensus.cc:1685] finished
0709 13:07:13.619532 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.630110 (+ 10578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7481,"raft.queue_time_us":26813,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14710,"spinlock_wait_cycles":14030208,"thread_start_us":306038,"threads_started":1,"wal-append.queue_time_us":926759}
I20260709 13:07:13.691169 19229 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.648906 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84018.7us
I20260709 13:07:13.648955 16540 raft_consensus.cc:2376] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9. Re-sending same reply.
I20260709 13:07:13.620196 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.693392 16543 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:13.557013 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:13.652647 17093 leader_election.cc:336] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.871s (SENT)
I20260709 13:07:13.643867 16509 leader_election.cc:400] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:13.694458 16509 leader_election.cc:403] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:07:13.682376 17123 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:13.610740 19236 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.473s	user 0.004s	sys 0.018s
I20260709 13:07:13.498751 18976 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:13.694697 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 137751us
W20260709 13:07:13.695659 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 51977.3us
I20260709 13:07:13.695446 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.642813 19067 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.653283 19261 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:13.699157 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:13.703948 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:13.705719 17119 raft_consensus.cc:2368] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:13.707960 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.708235 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:13.708760 16540 raft_consensus.cc:2410] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:13.619748 19219 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.692859 19208 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:13.713259 19239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.032s	sys 0.049s
I20260709 13:07:13.678463 18890 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.699882 19162 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:13.720201 19239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.032s	sys 0.049s
I20260709 13:07:13.705121 19276 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:13.709347 19218 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.727108 19227 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.727733 18924 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.728116 19259 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.715083 19208 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.691754 19229 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.729772 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:13.677964 16367 rpcz_store.cc:269] 0709 13:06:56.480688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.480990 (+   302us) service_pool.cc:224] Handling call
0709 13:07:13.618918 (+17137928us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:09.391749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:09.392433 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:09.392485 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:07:09.392502 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:09.403627 (+ 11125us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:09.403705 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:09.403734 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:07:09.404431 (+   697us) tablet.cc:701] Row locks acquired
0709 13:07:09.404479 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:07:09.404661 (+   182us) write_op.cc:270] Start()
0709 13:07:09.404864 (+   203us) write_op.cc:276] Timestamp: P: 1783602429404595 usec, L: 0
0709 13:07:09.404891 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:09.464390 (+ 59499us) log.cc:844] Serialized 2574 byte log entry
0709 13:07:09.852303 (+387913us) op_driver.cc:464] REPLICATION: finished
0709 13:07:09.943021 (+ 90718us) write_op.cc:301] APPLY: starting
0709 13:07:09.943147 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:09.943394 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:09.943553 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:09.971326 (+ 27773us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:09.971734 (+   408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:07:09.971813 (+    79us) write_op.cc:312] APPLY: finished
0709 13:07:09.972249 (+   436us) log.cc:844] Serialized 53 byte log entry
0709 13:07:09.972478 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.972629 (+   151us) write_op.cc:454] Released schema lock
0709 13:07:09.972702 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:09.973359 (+   657us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.973404 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":824170,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":90358,"apply.run_cpu_time_us":4305,"apply.run_wall_time_us":30252,"num_ops":6,"prepare.queue_time_us":302835,"prepare.run_cpu_time_us":29972,"prepare.run_wall_time_us":254746,"raft.queue_time_us":60951,"raft.run_cpu_time_us":24521,"raft.run_wall_time_us":54861,"replication_time_us":447233,"thread_start_us":414354,"threads_started":4,"wal-append.queue_time_us":218046,"wal-append.run_cpu_time_us":19542,"wal-append.run_wall_time_us":1350931}]]}
I20260709 13:07:13.729303 19218 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.728586 19259 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:13.707792 19205 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.756075 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:13.757647 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108344us
I20260709 13:07:13.743431 19068 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.766880 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:13.768875 19277 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.770502 19219 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:13.770968 19261 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:13.774091 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.706597 19273 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.796663 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1476) took 2525 ms. Trace:
I20260709 13:07:13.751791 19218 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:13.803440 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 86273.2us
I20260709 13:07:13.757110 19259 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.804809 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:13.805550 17126 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:13.714550 19266 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.740398 19188 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.768657 19229 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:13.800581 16544 rpcz_store.cc:276] 0709 13:07:11.247740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.255762 (+  8022us) service_pool.cc:224] Handling call
0709 13:07:11.256055 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.302744 (+ 46689us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:11.595228 (+292484us) log.cc:844] Serialized 14 byte log entry
0709 13:07:11.801381 (+206153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.811483 (+ 10102us) log.cc:844] Serialized 26 byte log entry
0709 13:07:11.832751 (+ 21268us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b180047a100. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410557 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:12.597105 (+764354us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:12.597347 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.939880 (+342533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.939991 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.610042 (+670051us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:13.772676 (+162634us) raft_consensus.cc:1685] finished
0709 13:07:13.772700 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.772839 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":425177,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3725,"raft.queue_time_us":128830,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":44674,"spinlock_wait_cycles":30071424,"thread_start_us":760988,"threads_started":3,"wal-append.queue_time_us":361890}
W20260709 13:07:13.816745 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60737.5us
I20260709 13:07:13.806358 19262 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.829372 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.828006 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:13.755321 19175 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:13.846875 16469 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:13.857084 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:13.869313 19289 raft_consensus.cc:2764] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:13.869769 19285 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:13.925202 19296 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:13.925936 19296 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:13.926416 19296 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:13.929427 19284 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:07:13.931241 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 164450us
I20260709 13:07:13.850478 19229 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:13.938397 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 133672us
W20260709 13:07:13.937769 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 96198.2us
I20260709 13:07:13.939486 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:13.957724 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:13.945806 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:13.936468 19265 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:13.945432 19229 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.977296 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:13.884809 19294 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.240s
I20260709 13:07:13.987989 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:13.989552 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:13.992815 16616 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.976257 19227 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:13.993486 19227 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.993820 19227 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:13.994622 19227 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.995720 19227 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.996218 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.997443 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:13.998013 17120 raft_consensus.cc:2376] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7. Re-sending same reply.
I20260709 13:07:13.998535 19218 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:13.998871 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:13.999689 17120 raft_consensus.cc:2410] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:14.002074 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:13.987922 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:13.988658 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:13.955158 18976 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:14.004179 16618 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:14.012221 19210 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.012758 19210 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:14.013178 19210 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.014130 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:14.014370 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:14.015167 17120 raft_consensus.cc:2410] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:14.016418 17120 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:14.017021 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:14.018416 19293 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:07:14.021517 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 382) took 2694 ms. Trace:
I20260709 13:07:14.021874 16545 rpcz_store.cc:276] 0709 13:07:11.326826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.839862 (+513036us) service_pool.cc:224] Handling call
0709 13:07:11.840253 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:11.840698 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:11.840730 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:11.902709 (+ 61979us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.449476 (+1546767us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b180031af20. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:13.478095 (+ 28619us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b180031af20. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:13.689738 (+211643us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.689778 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.689846 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.017793 (+327947us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:14.021324 (+  3531us) raft_consensus.cc:1685] finished
0709 13:07:14.021343 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.021460 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1411,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":21202,"spinlock_wait_cycles":34008064,"thread_start_us":211456,"threads_started":1,"wal-append.queue_time_us":1787003}
I20260709 13:07:14.023321 19210 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.025242 16509 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:14.029353 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.035874 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.036198 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:14.036856 16615 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.038081 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91561.4us
I20260709 13:07:13.986503 19229 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.989207 18945 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.049872 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:14.065019 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1657) took 2436 ms. Trace:
I20260709 13:07:13.991689 18890 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:14.077224 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:14.078708 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:14.078846 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 68963.8us
I20260709 13:07:14.079903 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:14.065611 16470 rpcz_store.cc:276] 0709 13:07:11.628380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.628539 (+   159us) service_pool.cc:224] Handling call
0709 13:07:11.630583 (+  2044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.596106 (+965523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.064674 (+1468568us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000b2f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:14.064935 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635498880}
W20260709 13:07:14.296489 17123 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
I20260709 13:07:14.297192 17123 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:14.078207 17126 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:14.315089 17121 raft_consensus.cc:2393] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:14.026101 19210 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:14.321523 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 366360us
I20260709 13:07:14.346238 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.059628 19077 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.035944 19304 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:14.331722 19258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.004s	sys 0.005s
W20260709 13:07:14.378639 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 353430us
I20260709 13:07:14.426095 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:14.380168 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:14.357553 18945 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.397099 19262 raft_consensus.cc:2764] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:14.405313 19299 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:07:14.312182 19068 raft_consensus.cc:2764] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:07:14.320839 19267 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:14.427381 19258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.004s	sys 0.005s
W20260709 13:07:14.440371 19286 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.635s	user 0.001s	sys 0.000s
I20260709 13:07:14.431113 16615 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:14.436915 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 90751.4us
I20260709 13:07:14.319329 19218 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:14.444437 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.341559 18890 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.453143 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 385526us
I20260709 13:07:14.454752 19266 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.379328 19077 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.428989 16616 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
W20260709 13:07:14.440584 19253 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:07:14.379647 19277 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:14.433478 19210 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:14.442994 19219 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:14.434109 18945 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:14.359628 19205 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:14.485659 19301 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:07:14.485285 18890 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:14.489645 19302 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.488s	user 0.000s	sys 0.001s
I20260709 13:07:14.493409 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.501396 16511 leader_election.cc:400] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 8.
I20260709 13:07:14.491640 19266 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.504362 19077 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:14.523607 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 443763us
I20260709 13:07:14.527856 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:14.530532 18890 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:14.533043 19258 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.538007 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.539479 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:14.543038 19295 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.857s	user 0.006s	sys 0.007s
I20260709 13:07:14.546609 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:14.547318 19208 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.004s
W20260709 13:07:14.547406 17127 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 498) took 1515 ms (client timeout 1852 ms). Trace:
I20260709 13:07:14.547780 19208 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.548933 16610 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.550603 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1493) took 1202 ms. Trace:
I20260709 13:07:14.550954 16544 rpcz_store.cc:276] 0709 13:07:13.348730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.824522 (+475792us) service_pool.cc:224] Handling call
0709 13:07:13.824917 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.961659 (+136742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.961693 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.975438 (+ 13745us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.433160 (+457722us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:14.433202 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.433271 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.550401 (+117130us) raft_consensus.cc:1685] finished
0709 13:07:14.550421 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.550552 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":123091,"raft.queue_time_us":119414,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":13756,"thread_start_us":388310,"threads_started":2,"wal-append.queue_time_us":477453}
I20260709 13:07:14.554426 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1494) took 1201 ms. Trace:
I20260709 13:07:14.555114 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1490) took 1209 ms. Trace:
I20260709 13:07:14.554951 16537 rpcz_store.cc:276] 0709 13:07:13.352958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.858049 (+505091us) service_pool.cc:224] Handling call
0709 13:07:13.858458 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.961075 (+102617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.961109 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.975747 (+ 14638us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.439942 (+464195us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:14.439994 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.440086 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.554141 (+114055us) raft_consensus.cc:1685] finished
0709 13:07:14.554172 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.554352 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109007,"raft.queue_time_us":119360,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":53826,"thread_start_us":433123,"threads_started":2,"wal-append.queue_time_us":533919}
W20260709 13:07:14.557183 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 63859.2us
I20260709 13:07:14.558141 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 594) took 1083 ms. Trace:
I20260709 13:07:14.557776 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:14.558815 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.558866 16537 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.555672 16543 rpcz_store.cc:276] 0709 13:07:13.345931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.709077 (+363146us) service_pool.cc:224] Handling call
0709 13:07:13.718862 (+  9785us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:13.719531 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.719559 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:13.726159 (+  6600us) log.cc:844] Serialized 52 byte log entry
0709 13:07:13.807109 (+ 80950us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:13.807144 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.807220 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.554931 (+747711us) raft_consensus.cc:1685] finished
0709 13:07:14.554950 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.555064 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306,"raft.queue_time_us":2563,"spinlock_wait_cycles":9597184,"thread_start_us":55865,"threads_started":1,"wal-append.queue_time_us":143811}
I20260709 13:07:14.552551 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:14.517401 18945 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.558506 17119 rpcz_store.cc:276] 0709 13:07:13.474454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.475636 (+  1182us) service_pool.cc:224] Handling call
0709 13:07:14.557961 (+1082325us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b540058ff54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:14.558071 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416725248}
W20260709 13:07:14.561563 17122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.040s
W20260709 13:07:14.562091 17122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.020s	sys 0.041s
I20260709 13:07:14.562463 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:14.547838 17127 rpcz_store.cc:269] 0709 13:07:13.032078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.032856 (+   778us) service_pool.cc:224] Handling call
0709 13:07:14.546469 (+1513613us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:14.547334 (+   865us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3001216}
I20260709 13:07:14.526273 19266 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.577229 19297 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:14.578150 19162 consensus_meta.cc:287] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.852s	user 0.007s	sys 0.003s
I20260709 13:07:14.579133 16509 leader_election.cc:400] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:14.579461 16509 leader_election.cc:403] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.512086 19210 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.566944 19276 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.579886 19162 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:14.570850 19294 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.570261 19267 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:14.570498 19304 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:14.589686 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1491) took 1243 ms. Trace:
I20260709 13:07:14.591089 16540 rpcz_store.cc:276] 0709 13:07:13.346224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.709265 (+363041us) service_pool.cc:224] Handling call
0709 13:07:13.718062 (+  8797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.721792 (+  3730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.721819 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.737341 (+ 15522us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.825002 (+ 87661us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:13.825038 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.825100 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.589418 (+764318us) raft_consensus.cc:1685] finished
0709 13:07:14.589444 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.589610 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1045,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7420,"thread_start_us":65772,"threads_started":1,"wal-append.queue_time_us":241971}
I20260709 13:07:14.593783 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:14.587103 16537 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:14.581529 19296 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.005s
I20260709 13:07:14.570052 19262 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:07:14.571677 19232 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:14.588078 19305 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.600247 19227 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.004s
I20260709 13:07:14.613675 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:14.588357 19267 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:14.614780 16540 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.601138 19162 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:14.639696 16540 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:14.641341 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:14.643319 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75283.5us
I20260709 13:07:14.644547 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:14.648624 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:14.625655 19267 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:14.733703 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:14.612206 19294 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:07:14.632994 19162 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:14.789022 19162 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:14.791361 19268 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.751s	user 0.001s	sys 0.001s
W20260709 13:07:14.749567 19321 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:07:14.608279 19296 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:14.793437 19322 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:14.793653 19296 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:14.794353 16617 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:14.794907 19208 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:14.757512 19262 raft_consensus.cc:2764] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:07:14.793686 19179 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:14.795359 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:14.703104 19320 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:07:14.796017 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1497) took 1411 ms. Trace:
I20260709 13:07:14.767824 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:14.794914 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1663) took 3024 ms. Trace:
I20260709 13:07:14.797163 16537 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:14.750713 19328 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.749853 19294 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:14.798584 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:14.791297 16436 connection.cc:256] RPC call timeout handler was delayed by -2.2576561810000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:07:14.794847 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:14.796482 19229 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.669s	user 0.010s	sys 0.000s
I20260709 13:07:14.797226 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:14.800578 19229 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.801169 16618 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:14.787925 19101 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:14.798033 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:14.803084 16612 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:14.796361 16545 rpcz_store.cc:276] 0709 13:07:13.384428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.023579 (+639151us) service_pool.cc:224] Handling call
0709 13:07:14.023910 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.059710 (+ 35800us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:07:14.059739 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.311647 (+251908us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.598765 (+287118us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:14.598827 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.598921 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.795838 (+196917us) raft_consensus.cc:1685] finished
0709 13:07:14.795855 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.795968 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35422,"raft.queue_time_us":53599,"spinlock_wait_cycles":28024192,"thread_start_us":185259,"threads_started":1,"wal-append.queue_time_us":394574}
I20260709 13:07:14.804191 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:14.782835 19152 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:14.775604 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.797245 16463 rpcz_store.cc:276] 0709 13:07:11.770586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.694197 (+923611us) service_pool.cc:224] Handling call
0709 13:07:12.694514 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.694902 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.694931 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.695384 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.991208 (+295824us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:12.991254 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.991328 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.791056 (+1799728us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b240009fc08. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444f09d 00007ffa3708110e 00007ffa3709888c 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221
0709 13:07:14.794647 (+  3591us) raft_consensus.cc:1685] finished
0709 13:07:14.794668 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.794857 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1342,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":28087040,"thread_start_us":295436,"threads_started":1,"wal-append.queue_time_us":344252}
I20260709 13:07:14.796641 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:14.807325 16615 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:14.773463 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:14.811302 19259 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.995s	user 0.011s	sys 0.000s
I20260709 13:07:14.811887 19259 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:14.814623 19259 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:14.831506 16436 connection.cc:256] RPC call timeout handler was delayed by -1.8291173259999596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:07:14.832233 16436 connection.cc:256] RPC call timeout handler was delayed by -1.8192173259999436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:07:14.832731 16436 connection.cc:256] RPC call timeout handler was delayed by -1.7499173259999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
W20260709 13:07:14.833200 16436 connection.cc:256] RPC call timeout handler was delayed by -1.5916073529999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:07:14.833627 16436 connection.cc:256] RPC call timeout handler was delayed by -1.1019173259999206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23370000000000002s for a response
I20260709 13:07:14.833540 19077 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.835363 17123 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:14.838397 19320 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.839356 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.840158 16469 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:14.839924 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.842113 16468 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:14.849608 16540 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:14.860702 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.861362 16469 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:14.862123 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.862643 16469 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:14.863412 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.864243 16469 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:14.877697 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.878677 16464 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:14.881567 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.881745 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.882499 16466 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:14.883035 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:14.883126 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:14.883695 16464 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.883888 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:14.884618 16540 raft_consensus.cc:2393] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:14.802641 19229 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:14.911923 16462 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:14.911964 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.913658 16466 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:14.914069 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.880292 19328 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:14.918877 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.926131 16466 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:07:14.873343 19275 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.388s	user 0.022s	sys 0.001s
I20260709 13:07:14.920933 18945 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:14.927398 19210 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:14.928560 18945 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:14.929672 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 295441us
I20260709 13:07:14.923314 19202 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.924193 16464 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:14.886078 19077 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:14.913386 19276 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.925491 16470 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:14.930783 16466 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:14.936362 16466 pending_rounds.cc:85] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 3
I20260709 13:07:14.932175 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 389) took 1451 ms. Trace:
I20260709 13:07:14.934083 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:14.937676 16468 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:14.933529 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:14.937162 16540 rpcz_store.cc:276] 0709 13:07:13.480601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.916026 (+1435425us) service_pool.cc:224] Handling call
0709 13:07:14.931695 (+ 15669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.931864 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.931889 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.931931 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:14.931971 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.932021 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.932122 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:14.938796 16464 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:14.935304 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 290787us
I20260709 13:07:14.934662 16436 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:14.940444 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:14.839103 19320 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.936661 16466 pending_rounds.cc:107] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:07:14.944940 16466 raft_consensus.cc:2889] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.943857 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:14.943624 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:14.947368 16462 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:14.887960 19266 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:14.942837 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:14.933378 19275 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.964555 16462 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:14.965193 16462 pending_rounds.cc:85] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:07:14.965405 16462 pending_rounds.cc:107] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:14.965616 16462 raft_consensus.cc:2889] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:14.964533 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:14.967226 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:14.942299 19294 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.953599 19179 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:14.946346 19305 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:14.934302 19162 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:14.941872 18945 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:07:14.964205 19296 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:14.931612 19328 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:14.936700 19202 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:14.975106 19294 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:15.004724 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.978503 19179 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.005870 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.008486 16545 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:15.008752 16462 raft_consensus.cc:2410] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:15.001762 16537 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:15.008145 19294 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.009445 19179 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.012495 19331 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.050645 19332 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.051465 19332 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.051874 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1500) took 1666 ms. Trace:
I20260709 13:07:15.054226 16544 rpcz_store.cc:276] 0709 13:07:13.385239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.560568 (+1175329us) service_pool.cc:224] Handling call
0709 13:07:14.560868 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.580211 (+ 19343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.580240 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.583055 (+  2815us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.863641 (+280586us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:14.863680 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.863741 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.051679 (+187938us) raft_consensus.cc:1685] finished
0709 13:07:15.051697 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.051816 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14636,"raft.queue_time_us":21230,"spinlock_wait_cycles":2014592,"thread_start_us":257978,"threads_started":1,"wal-append.queue_time_us":375487}
W20260709 13:07:15.057368 19330 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:15.058981 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1498) took 1674 ms. Trace:
I20260709 13:07:15.059451 16543 rpcz_store.cc:276] 0709 13:07:13.384708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.559817 (+1175109us) service_pool.cc:224] Handling call
0709 13:07:14.575321 (+ 15504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.575834 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.575875 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.576421 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:07:14.879741 (+303320us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:14.879792 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.879855 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.058697 (+178842us) raft_consensus.cc:1685] finished
0709 13:07:15.058727 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.058908 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4567,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2043,"thread_start_us":264553,"threads_started":1,"wal-append.queue_time_us":360596}
I20260709 13:07:15.062683 16542 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.063932 16542 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:15.065446 19327 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:15.066633 19336 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.067329 19336 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.067642 19336 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:15.067945 19336 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.056311 19320 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:15.075520 19202 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:15.077943 19328 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.081285 16464 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.082276 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.082842 16464 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:15.083542 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.084025 16464 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:15.084739 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.085729 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.086138 19266 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:15.088676 19267 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.091533 19267 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.092391 16461 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:15.092245 19336 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.093914 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.094321 19336 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.094988 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:15.098007 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 133679us
I20260709 13:07:15.099162 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:15.086318 19291 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.401s	user 0.037s	sys 0.015s
I20260709 13:07:15.112057 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.109395 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:15.109397 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:15.114023 17125 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.115985 16463 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:15.108596 19267 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.121690 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.117436 19289 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:15.157332 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 191392us
I20260709 13:07:15.113927 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:15.179674 16463 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:15.171025 16468 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:15.084707 19294 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.184823 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1653) took 4043 ms. Trace:
I20260709 13:07:15.194118 16463 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:15.195981 16463 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:15.168318 19204 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.168587 19267 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:15.201087 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 87255us
I20260709 13:07:15.201267 16462 raft_consensus.cc:2368] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:15.183763 19188 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:15.203698 19289 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:15.197058 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.482686 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:15.322592 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 177825us
I20260709 13:07:15.193389 16465 rpcz_store.cc:276] 0709 13:07:11.141459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.182431 (+ 40972us) service_pool.cc:224] Handling call
0709 13:07:11.189018 (+  6587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:11.189196 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:11.437067 (+247871us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.383549 (+1946482us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:14.996998 (+1613449us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b180034e940. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a
0709 13:07:15.183024 (+186026us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.183092 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.183157 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.184646 (+  1489us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.184755 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11670,"prepare.queue_time_us":91808,"prepare.run_cpu_time_us":20,"prepare.run_wall_time_us":21,"raft.queue_time_us":81342,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":22374144,"thread_start_us":1557230,"threads_started":3,"wal-append.queue_time_us":928434,"wal-append.run_cpu_time_us":7617,"wal-append.run_wall_time_us":2103457}
I20260709 13:07:15.502969 16583 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:15.503388 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.510386 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.287882 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.513006 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.505173 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:15.514690 16468 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:15.515417 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:15.285925 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.513789 16470 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:15.253922 17125 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:15.515872 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.509603 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:15.503887 19246 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.698s	user 0.019s	sys 0.024s
I20260709 13:07:15.207887 19162 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.495563 19332 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.521574 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:15.525594 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:15.554733 16611 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:15.555148 16615 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:15.518442 16463 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.543534 16468 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:15.192749 19210 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:15.297838 19033 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.215021 19313 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.753s	user 0.002s	sys 0.000s
I20260709 13:07:15.523974 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:15.508668 19047 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.540364 16467 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.523662 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.525760 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:15.571295 16612 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:15.517257 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.524914 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.517961 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:15.519749 19296 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:15.213533 19179 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:15.561547 19246 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.758s	user 0.021s	sys 0.027s
W20260709 13:07:15.568005 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 44128us
W20260709 13:07:15.507560 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.202870 19204 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.571229 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.572502 16465 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:15.542903 18490 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:15.577653 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59766.2us
I20260709 13:07:15.591917 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:15.526055 19294 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.520450 18817 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:15.525367 19112 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:15.583738 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.577596 16466 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:15.459820 19207 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.561226 19337 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:15.587988 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.592991 16470 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:15.594439 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:15.526765 19343 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:07:15.611663 18817 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.617329 19112 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.612634 19266 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:15.623212 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.643517 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.655949 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.597925 19162 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:15.676683 16467 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
W20260709 13:07:15.707507 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 113159us
I20260709 13:07:15.708628 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:15.705938 16465 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.520414 19267 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.650533 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.569008 19033 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.630275 18817 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.622231 19337 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:15.638767 19204 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:15.639810 19266 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:15.632712 19112 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.629951 19344 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.716244 18490 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:15.758636 19344 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:15.756547 16463 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:15.763677 19289 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.764226 18490 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:15.765240 18490 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.716988 18945 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:15.647421 19207 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.756410 19337 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.639128 19296 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.716938 19162 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.764263 19289 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:15.762100 19344 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:15.813589 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1492) took 2467 ms. Trace:
I20260709 13:07:15.814157 16539 rpcz_store.cc:276] 0709 13:07:13.346511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.753770 (+407259us) service_pool.cc:224] Handling call
0709 13:07:13.754188 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.209263 (+1455075us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b1800479ec0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa374f5060 00007ffa374f5bfb 00007ffa3750064b
0709 13:07:15.209387 (+   124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.209418 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.209865 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.600581 (+390716us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:15.600629 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.600698 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.810492 (+209794us) raft_consensus.cc:1685] finished
0709 13:07:15.810521 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.813499 (+  2978us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22743,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3947,"spinlock_wait_cycles":18115840,"thread_start_us":428732,"threads_started":2,"wal-append.queue_time_us":554827}
I20260709 13:07:15.820726 16468 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:15.828893 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 425) took 1853 ms. Trace:
I20260709 13:07:15.830013 16610 rpcz_store.cc:276] 0709 13:07:13.975476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.975636 (+   160us) service_pool.cc:224] Handling call
0709 13:07:13.975911 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.549312 (+573401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.828562 (+1279250us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54003af554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:15.828821 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317260032}
I20260709 13:07:15.824584 19266 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.836887 19210 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:15.837463 19355 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:15.852180 16539 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:15.853596 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:15.853667 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:15.854661 16536 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:15.857081 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:15.857802 16542 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:15.864452 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:15.863399 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:15.865572 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:15.866031 17125 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:15.866925 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:15.876132 16544 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:15.879869 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:15.845356 19112 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:15.887306 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:15.889094 17121 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:15.892007 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:15.863137 19305 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.899564 19304 raft_consensus.cc:2764] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:15.900408 19304 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.899972 19305 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.901381 19207 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:15.902663 17120 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:15.902871 19305 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.903623 19305 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.863377 19332 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.905740 19332 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.907930 19332 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.902930 19033 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.893455 19112 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:15.911034 19162 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.892635 17125 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:15.912063 19112 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.914448 17090 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:15.912397 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:15.922175 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:15.923462 17119 raft_consensus.cc:2376] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9. Re-sending same reply.
I20260709 13:07:15.874923 19289 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:15.925333 19289 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.927682 19282 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:15.928274 19282 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:15.891801 19179 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:15.931838 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1510) took 1364 ms. Trace:
I20260709 13:07:15.932372 16543 rpcz_store.cc:276] 0709 13:07:14.567554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.062693 (+495139us) service_pool.cc:224] Handling call
0709 13:07:15.063094 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.096079 (+ 32985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.096107 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.109816 (+ 13709us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.562348 (+452532us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:15.930055 (+367707us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.930934 (+   879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.931017 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.931059 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:15.931071 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.931775 (+   704us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32522,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11946,"thread_start_us":706700,"threads_started":2,"wal-append.queue_time_us":602623}
I20260709 13:07:15.934177 17120 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:15.915475 19304 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:15.941164 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 232627us
I20260709 13:07:15.942365 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:15.938068 19304 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.964890 16469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.014s
W20260709 13:07:15.965282 16469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.000s	sys 0.014s
I20260709 13:07:15.943876 19179 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:15.983718 16582 connection.cc:256] RPC call timeout handler was delayed by -1.0828987509999024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:07:15.984038 16614 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:15.984730 16614 pending_rounds.cc:85] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:07:15.985071 16614 pending_rounds.cc:107] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:07:15.985414 16614 raft_consensus.cc:2889] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:15.998265 16468 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.999281 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:15.999815 16466 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:15.999940 16465 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.000254 16466 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:15.999969 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:16.001098 16468 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:15.980273 19179 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.001156 16466 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.010082 16466 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.013000 19188 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.013614 19188 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.015878 19188 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:16.018918 16466 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:15.978850 19266 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:16.031702 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:16.033290 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.009s	sys 0.006s
W20260709 13:07:16.053882 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.009s	sys 0.006s
I20260709 13:07:16.035590 19202 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.030063 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:16.041646 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 199389us
I20260709 13:07:15.988015 19320 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:15.991496 19273 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.026093 19179 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.054749 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 880476us
I20260709 13:07:16.069952 16463 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:16.046677 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 179826us
I20260709 13:07:16.049301 16468 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.003364 18945 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.057499 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:15.941468 19282 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.053911 16462 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:16.067408 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.078896 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:16.079185 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.076372 19328 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:16.088289 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:16.091048 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.087951 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:16.095666 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.110726 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.108726 19337 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.111914 19361 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:16.095592 19308 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.078220 19320 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:16.112530 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 181949us
I20260709 13:07:16.073776 19202 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:16.119040 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62807.2us
I20260709 13:07:16.075390 19266 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.082497 19273 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.081983 18945 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.098563 19371 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:16.126791 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:16.131309 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.137794 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:16.138618 16466 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:16.086946 18817 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.148546 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:16.151005 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.060426 16465 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:16.122651 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:16.165442 19267 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.168232 19202 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:16.123449 19361 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:07:16.169613 19361 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:16.170059 19361 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:16.170812 19362 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:07:16.171046 19361 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.171830 19364 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:16.172289 19364 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:16.172412 19361 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.173237 19372 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:07:16.173303 19364 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.174618 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.187036 16610 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.176730 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:16.141889 19331 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.188604 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:16.165597 19363 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:16.181609 17121 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:16.185132 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.192392 16611 raft_consensus.cc:2393] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:16.177984 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.192759 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1681) took 1266 ms. Trace:
I20260709 13:07:16.193186 16461 rpcz_store.cc:276] 0709 13:07:14.926330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.926535 (+   205us) service_pool.cc:224] Handling call
0709 13:07:14.933017 (+  6482us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.092893 (+159876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.192525 (+1099632us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54000b3954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:16.192698 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365985024}
I20260709 13:07:16.196404 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.178828 19308 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:07:16.198676 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.202723 16610 raft_consensus.cc:2410] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:16.196583 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.204141 16616 raft_consensus.cc:2368] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:16.204972 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.205267 16619 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:16.195878 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:16.200835 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.201508 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.206636 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.206565 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.207603 16613 raft_consensus.cc:2410] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:07:16.199707 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:16.211308 16612 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:16.219069 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:16.223878 16511 leader_election.cc:400] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:16.224212 16511 leader_election.cc:403] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.230476 19239 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.231074 19239 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:16.203248 19344 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.217504 19364 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.232173 19239 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.235298 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.240185 16612 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.353000 16613 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
W20260709 13:07:16.211333 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.324165 16618 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:16.240608 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:16.236539 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1679) took 1323 ms. Trace:
W20260709 13:07:16.306993 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 184629us
I20260709 13:07:16.190591 19373 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.204849 19362 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:16.221819 19370 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:07:16.276077 19320 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:16.237300 19332 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:16.238893 19266 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:16.242384 19304 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.367326 19273 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:16.367684 19304 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:16.220944 19305 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 13:07:16.369243 19305 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.369601 19305 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:16.369640 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:16.370537 19305 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.371701 19305 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.351990 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.355787 16469 rpcz_store.cc:276] 0709 13:07:14.912726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.912897 (+   171us) service_pool.cc:224] Handling call
0709 13:07:14.913223 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.014759 (+101536us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:15.305410 (+290651us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.965707 (+660297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.965764 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:15.965804 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.236287 (+270483us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54001077d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:16.236346 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:16.236475 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17804,"prepare.queue_time_us":188921,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":91,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5150,"spinlock_wait_cycles":232954240,"thread_start_us":931770,"threads_started":2,"wal-append.queue_time_us":778817}
I20260709 13:07:16.220431 19365 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:16.217352 19162 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:16.368085 19308 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.262792 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:16.357829 16619 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:07:16.236725 18817 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:16.356256 19344 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:16.202332 19331 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.394507 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:16.394409 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 268854us
W20260709 13:07:16.462031 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67617.4us
I20260709 13:07:16.393678 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.452595 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.464999 16613 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.377997 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:16.301411 19385 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:16.277990 19179 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:07:16.490494 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:16.471753 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 209066us
W20260709 13:07:16.513034 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 50250.4us
W20260709 13:07:16.474071 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.302700 18945 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:16.515805 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 137873us
I20260709 13:07:16.530104 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:16.360335 19362 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:16.292471 19309 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.534273 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:16.535634 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:16.535782 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:16.377655 19207 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:16.537683 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.464716 19273 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.547840 16613 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:16.376065 19365 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.531669 19289 consensus_meta.cc:287] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.606s	user 0.004s	sys 0.007s
I20260709 13:07:16.511080 19304 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:16.560624 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:16.561563 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.514407 19202 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:16.512532 19162 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:16.536449 19362 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.615887 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55318.3us
I20260709 13:07:16.627249 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:16.534430 19360 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.536823 19332 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:16.593741 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 369973us
I20260709 13:07:16.636741 16469 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:16.643157 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:16.643977 16469 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:16.599771 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 192886us
I20260709 13:07:16.635648 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:16.638175 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:16.392292 19033 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.233s
I20260709 13:07:16.542517 19077 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.652244 16470 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:16.659679 17122 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:16.562762 19383 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.473078 19308 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.664014 19390 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.665555 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:16.625082 19365 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:16.671504 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:16.672487 16462 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:16.541999 19344 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.561604 18490 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.564348 19171 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:07:16.668555 18817 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.668711 19364 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:16.542368 19381 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 13:07:16.668483 19383 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.563958 19273 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:16.628136 19382 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:16.658759 19077 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.628317 19202 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:16.628352 19373 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:16.678566 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 142987us
I20260709 13:07:16.655560 19360 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.675566 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.671125 19374 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.649108 19392 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:16.562114 19207 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.695019 16469 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:16.558454 18945 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:07:16.698035 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 68479.1us
I20260709 13:07:16.698315 19403 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:16.666909 19395 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:16.626266 19304 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.708513 19407 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:16.711918 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.713052 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.677502 17120 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:16.729158 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.750703 16615 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:16.709288 19371 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.729318 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.718293 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.699687 19404 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.735146 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:16.729574 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.709496 19360 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.744940 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.746701 19282 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:16.747469 16612 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:16.718940 19273 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.678077 18490 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:16.754161 16617 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:16.693562 18817 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.693749 19077 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.760082 16610 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:16.749127 19389 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:07:16.762007 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.766281 16610 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.767851 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:16.780524 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.690868 19364 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.770277 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:16.788364 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53291.1us
I20260709 13:07:16.789149 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:16.718850 19402 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:16.791105 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.762051 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 426) took 2781 ms. Trace:
I20260709 13:07:16.791540 16614 rpcz_store.cc:276] 0709 13:07:13.981138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.995511 (+ 14373us) service_pool.cc:224] Handling call
0709 13:07:13.995785 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.990614 (+1994829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.761844 (+771230us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54003da254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:16.761996 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4547758848}
I20260709 13:07:16.747759 19383 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:16.778493 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.716379 19382 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:16.792656 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.769204 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:16.791121 16615 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.795840 16537 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:16.798084 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:16.691385 19400 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:07:16.801546 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.758796 18490 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.804847 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.679224 19390 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.805922 16538 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:16.805744 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.807081 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.676121 19162 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.806588 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:16.821319 16540 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:16.820916 16537 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:16.816715 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 72202.7us
I20260709 13:07:16.717186 19373 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.797879 19112 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.837235 16545 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:07:16.791359 19402 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:16.838959 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.733444 19202 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.758157 19403 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.754573 19332 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.853978 16543 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.854075 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.760857 19395 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.763022 18817 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.847396 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:16.869171 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:16.820901 19267 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.810725 19399 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:16.729815 19392 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.821165 19179 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:16.844269 16544 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.805495 19171 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:07:16.826537 19331 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:16.805397 19275 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:07:16.810403 19282 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:16.760690 19371 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.901839 16615 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:16.758744 19404 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:16.840488 19112 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.831856 16537 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:16.758960 19407 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:16.878633 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:16.882720 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:16.978446 16540 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.888242 16542 raft_consensus.cc:2410] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:07:16.943812 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:16.835886 19405 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:16.871176 19267 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.991437 16539 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.875193 19399 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:16.998971 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 65216.2us
I20260709 13:07:17.003243 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:17.003778 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 194531us
I20260709 13:07:16.998255 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:16.976687 19397 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.990986 19112 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.027009 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:17.027122 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 236813us
I20260709 13:07:17.020949 19399 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:17.026137 16583 leader_election.cc:336] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.852s (SENT)
I20260709 13:07:16.998301 19364 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.005044 19267 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.977104 19400 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:07:17.051525 16544 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:17.055691 16539 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
W20260709 13:07:17.056378 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.075488 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:17.081141 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.082465 16540 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:17.043035 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:17.100293 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:17.101142 16540 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.038581 19101 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.114877 19275 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:17.115442 19101 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.116138 19275 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:17.116736 19364 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.117230 19275 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.117763 19275 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:17.117413 19364 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.118568 19275 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.121188 19406 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.121219 19412 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:17.121701 19406 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:17.121860 19412 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:17.122722 19406 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.122736 19337 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.124342 19400 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:17.125316 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 99195.1us
I20260709 13:07:17.129158 19266 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:17.129732 19266 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:17.130720 16583 leader_election.cc:336] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 2.240s (SENT)
I20260709 13:07:17.131127 16583 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:17.131953 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 666890us
I20260709 13:07:17.029181 19179 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:17.122735 19412 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.133876 16582 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:17.135310 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:17.142172 16617 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:17.148109 16543 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:17.149791 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:17.131640 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:17.192021 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:17.197317 16544 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:17.196811 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:17.213681 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:17.212234 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108591us
I20260709 13:07:17.216210 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:17.217639 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:17.131729 19275 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:17.219043 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.102437 19204 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:07:17.036936 19397 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.186677 19331 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.195716 19171 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.241047 19207 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.248615 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:17.259732 19401 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:17.150571 19406 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.141891 19383 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:17.227766 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.143996 19308 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.208356 16540 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:16.977933 19382 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.261760 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:17.246276 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:17.286450 16542 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:17.323840 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:17.324494 16544 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:17.325541 16544 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.217226 19381 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.261933 19412 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.226621 19367 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.312976 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:17.328632 16540 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.330016 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:17.189684 19179 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:17.370268 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.261119 19425 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:17.286760 19273 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.288901 19152 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:17.384188 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:17.405488 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:17.380101 17121 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:07:17.408128 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.380035 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 306789us
I20260709 13:07:17.414157 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:17.301867 19304 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.297217 19401 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:17.421981 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:17.423095 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 206939us
I20260709 13:07:17.435660 16540 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:17.437685 16464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1656) took 2357 ms (client timeout 2013 ms). Trace:
W20260709 13:07:17.440572 16464 rpcz_store.cc:269] 0709 13:07:15.080429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.085529 (+  5100us) service_pool.cc:224] Handling call
0709 13:07:17.437482 (+2351953us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54003575d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:17.437615 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2319665408}
I20260709 13:07:17.440946 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:17.329802 19367 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.326067 19337 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.325765 19336 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.454439 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:17.455494 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:17.464221 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:17.466069 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:17.403330 19308 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:17.406533 19425 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:17.416530 19390 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.512872 16542 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:17.382519 19371 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.446811 18817 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:17.533241 19421 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:17.541402 19404 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.544843 19373 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.532166 16365 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 2 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:17.551867 19362 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.902s	user 0.004s	sys 0.005s
I20260709 13:07:17.551179 16365 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 3 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 5 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:17.417573 19383 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:17.454759 19207 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.456881 19430 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.510771 19381 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.459460 19367 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.552295 19362 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:17.584642 19399 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.445263 19419 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.481577 19204 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:17.584108 19171 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:17.607450 19362 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.610112 19399 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:17.637512 19399 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.639261 19047 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:17.650315 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 622164us
W20260709 13:07:17.577085 18490 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.001s
I20260709 13:07:17.517408 19425 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:17.618283 17123 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:17.657058 19402 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.571058 19431 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:17.665307 19275 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:17.600935 19411 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 13:07:17.587069 19381 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:17.608661 16365 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 1 to 3, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:17.673130 16511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.541s (SENT) [suppressed 13 similar messages]
W20260709 13:07:17.612345 19309 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.069s	user 0.004s	sys 0.008s
I20260709 13:07:17.528507 19403 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:17.566151 19371 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:17.680917 18490 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.578238 19397 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:17.691769 19305 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.314s	user 0.012s	sys 0.000s
I20260709 13:07:17.582494 19392 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.527429 19308 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.622812 19419 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:17.739756 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:17.777798 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 104700us
I20260709 13:07:17.676877 19204 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:17.725402 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 511723us
I20260709 13:07:17.881372 16365 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 2 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.622177 19383 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:17.839389 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 455236us
I20260709 13:07:17.668608 19101 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:17.857846 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.777263 19275 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:17.855999 19361 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.669s	user 0.009s	sys 0.003s
I20260709 13:07:17.883198 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:17.899582 16536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.007s	sys 0.007s
I20260709 13:07:17.886720 19152 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:17.885687 16619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.012s
I20260709 13:07:17.834021 19402 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.488587 19337 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.836288 19309 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:17.810786 19266 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.832340 19364 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.834301 19407 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:17.818300 19381 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.634748 19430 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:17.885730 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.022s	sys 0.068s
W20260709 13:07:17.939826 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.022s	sys 0.068s
W20260709 13:07:17.940430 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 743673us
W20260709 13:07:17.902731 16619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.001s	sys 0.012s
I20260709 13:07:17.879695 19371 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:17.906026 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1514) took 1144 ms. Trace:
I20260709 13:07:17.944897 16543 rpcz_store.cc:276] 0709 13:07:16.761338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.764276 (+  2938us) service_pool.cc:224] Handling call
0709 13:07:17.905854 (+1141578us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54002909d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:17.905970 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118779264}
I20260709 13:07:17.602824 19401 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.885636 19204 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.880895 19419 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.924404 16541 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:17.900079 16536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.007s	sys 0.007s
I20260709 13:07:17.925761 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:17.956959 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:17.903812 19304 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.962608 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:17.960217 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:17.961686 17119 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.009s	sys 0.009s
W20260709 13:07:17.903388 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 448242us
I20260709 13:07:17.960271 16537 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:17.943125 19422 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.513s	user 0.001s	sys 0.000s
W20260709 13:07:17.965020 17119 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.010s	sys 0.010s
I20260709 13:07:17.941176 19328 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.939888 19273 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:17.965760 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:17.971742 16461 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:17.962432 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:17.967540 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:17.956133 19360 consensus_meta.cc:287] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.194s	user 0.011s	sys 0.000s
I20260709 13:07:17.974299 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:17.974938 19406 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.000s
I20260709 13:07:17.975123 16462 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:17.976236 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:17.977210 16468 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:17.953320 19077 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.172s	user 0.010s	sys 0.002s
I20260709 13:07:17.978075 19077 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:17.980381 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.938289 19364 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:07:17.981215 19364 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:17.981571 19364 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:17.982591 19427 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 13:07:17.982448 19364 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.982925 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:17.983623 19364 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.984282 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1948) took 1171 ms. Trace:
I20260709 13:07:17.961633 19289 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:17.984939 19414 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:17.970933 19304 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.970956 16463 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:17.986459 19414 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.987380 16470 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:17.988087 16466 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:17.974793 19360 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:17.988688 19077 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:17.988981 19179 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:17.989651 19424 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
I20260709 13:07:17.957377 19344 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:07:17.990845 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:17.925288 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:17.951798 19152 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:18.019244 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.860s (SENT)
I20260709 13:07:18.093211 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:18.014976 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:18.039589 16509 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:18.092049 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 101270us
W20260709 13:07:18.097944 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 58380.5us
I20260709 13:07:18.097198 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:18.100147 17121 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:17.966883 19309 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:17.972133 19374 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:18.068434 19365 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.389s	user 0.009s	sys 0.006s
I20260709 13:07:17.967352 19361 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:18.025293 19289 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.012357 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.016s	sys 0.012s
W20260709 13:07:18.151276 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.016s	sys 0.015s
W20260709 13:07:18.152318 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 686267us
I20260709 13:07:18.025406 19403 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.154480 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:17.984692 16538 rpcz_store.cc:276] 0709 13:07:16.812826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.812990 (+   164us) service_pool.cc:224] Handling call
0709 13:07:16.837989 (+ 24999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.996163 (+158174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.996196 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.074318 (+ 78122us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.407315 (+332997us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.904153 (+496838us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.906546 (+  2393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.906623 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.984072 (+ 77449us) raft_consensus.cc:1685] finished
0709 13:07:17.984098 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.984224 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4727,"prepare.queue_time_us":607213,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3014,"raft.queue_time_us":254363,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":31869,"thread_start_us":788409,"threads_started":3,"wal-append.queue_time_us":749761}
I20260709 13:07:18.011536 19360 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:18.058250 19266 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.102227 19406 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:18.215670 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.019413 19179 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:18.058240 19438 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.214221 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.150077 19309 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:18.151036 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:18.238909 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.239837 16612 raft_consensus.cc:2410] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:18.241091 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:18.113095 19392 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:18.231851 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.232028 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:18.232920 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 220987us
I20260709 13:07:18.247656 16617 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
W20260709 13:07:18.247761 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0851603209998757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:07:18.248349 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0833603209998728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 13:07:17.992448 19328 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.172688 19361 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.235738 16614 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:18.238154 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.128880 18490 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:18.124650 19374 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.248859 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:18.250039 16611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.012s	sys 0.009s
I20260709 13:07:18.307641 16613 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:18.122788 19414 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 13:07:17.990376 19275 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.313056 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:18.254146 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:18.314297 17124 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:18.255066 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.307842 16611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.012s	sys 0.009s
W20260709 13:07:18.251498 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.011s	sys 0.024s
W20260709 13:07:18.315883 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.011s	sys 0.024s
W20260709 13:07:18.238030 19162 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.026s	sys 0.006s
I20260709 13:07:18.235383 19406 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.059047 19371 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:17.992111 19383 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.212911 19365 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:18.319554 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 224180us
W20260709 13:07:18.328397 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 313501us
I20260709 13:07:18.329236 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:18.245893 19392 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:18.330684 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.250533 19438 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:18.329062 16511 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.144s (SENT)
I20260709 13:07:18.334887 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:18.338048 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:18.324180 19162 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.026s	sys 0.006s
I20260709 13:07:18.310616 19361 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.231050 19289 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.237872 19403 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.317003 19337 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:18.327231 19406 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.354609 16618 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:18.326514 18490 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:18.251808 19179 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.325320 18817 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:18.363871 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.330915 19413 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:18.366874 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:18.351138 19412 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.973s	user 0.004s	sys 0.006s
I20260709 13:07:18.341734 19392 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.238399 19266 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:18.372120 19448 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:07:18.371824 19380 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:18.372980 19441 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:07:18.327137 19430 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:18.341323 19305 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.376820 16610 raft_consensus.cc:2368] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:18.344251 19442 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.379424 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:18.416527 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 109437us
I20260709 13:07:18.370225 19162 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.443156 19267 consensus_meta.cc:287] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.311s	user 0.011s	sys 0.000s
I20260709 13:07:18.377523 18817 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.443555 19162 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.325027 19437 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:07:18.378257 18490 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:18.437889 16545 raft_consensus.cc:606] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:18.470779 16545 raft_consensus.cc:614] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:18.380157 19344 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:18.491963 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.376569 19337 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:07:18.442436 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:18.444633 17124 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:18.411900 19458 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.482004 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.484800 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.488056 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.492045 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.441121 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:18.426549 19439 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:18.483198 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.383469 19413 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.403676 19309 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.492715 16466 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 3.
I20260709 13:07:18.438870 19305 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.787772 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.788633 16466 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
W20260709 13:07:18.789381 19456 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
I20260709 13:07:18.790082 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1956) took 1940 ms. Trace:
I20260709 13:07:18.790885 19458 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.790793 16544 rpcz_store.cc:276] 0709 13:07:16.849461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.326313 (+476852us) service_pool.cc:224] Handling call
0709 13:07:17.326565 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.326743 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.326767 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.405463 (+ 78696us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.857510 (+452047us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.857563 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.857652 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.789837 (+932185us) raft_consensus.cc:1685] finished
0709 13:07:18.789864 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.790011 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":400859,"threads_started":1,"wal-append.queue_time_us":590153}
I20260709 13:07:18.792711 19382 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.793426 19450 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.426s	user 0.000s	sys 0.000s
I20260709 13:07:18.793365 19382 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.610816 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 405) took 1305 ms. Trace:
I20260709 13:07:18.427130 19438 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.565375 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:18.798280 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 469190us
W20260709 13:07:18.799256 16511 leader_election.cc:336] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.146s (SENT)
I20260709 13:07:18.806432 16461 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:18.790185 19305 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:18.820637 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:18.821599 16466 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:18.616753 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:18.794924 16540 rpcz_store.cc:276] 0709 13:07:17.304924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.443441 (+138517us) service_pool.cc:224] Handling call
0709 13:07:17.443662 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.443942 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:17.961097 (+517155us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.610280 (+649183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.610359 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:18.610447 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.610547 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.610730 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26544,"prepare.queue_time_us":625766,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":103313,"raft.run_wall_time_us":16627,"spinlock_wait_cycles":36622080,"thread_start_us":1077727,"threads_started":3,"wal-append.queue_time_us":494601}
W20260709 13:07:18.852746 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.859395 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:18.664053 19444 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.429s	user 0.001s	sys 0.001s
W20260709 13:07:18.566116 19455 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:07:18.862234 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 63017.1us
W20260709 13:07:18.565120 19451 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:07:18.887156 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:18.890829 16511 leader_election.cc:336] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.883s (SENT)
I20260709 13:07:18.892493 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:18.894408 16508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.021s
W20260709 13:07:18.894790 16508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.008s	sys 0.021s
I20260709 13:07:18.473901 19461 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:18.664680 19462 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.785573 19289 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:18.801998 19414 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.634207 19466 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.923185 19466 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:18.924633 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1897) took 2175 ms. Trace:
I20260709 13:07:18.791630 19439 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.925268 16619 rpcz_store.cc:276] 0709 13:07:16.748696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.754252 (+  5556us) service_pool.cc:224] Handling call
0709 13:07:16.759478 (+  5226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.874616 (+115138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.874657 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.876424 (+  1767us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.941619 (+1065195us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.941667 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.941730 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.924353 (+982623us) raft_consensus.cc:1685] finished
0709 13:07:18.924382 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.924562 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8841,"raft.queue_time_us":50863,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9121,"thread_start_us":1053093,"threads_started":2,"wal-append.queue_time_us":1049997}
I20260709 13:07:18.868247 19337 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.927726 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.928095 19337 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.930569 19337 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:18.937208 18817 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:18.937458 19414 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:18.939445 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 408) took 1596 ms. Trace:
I20260709 13:07:18.940481 19460 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:18.941576 19453 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:07:18.924533 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:18.959192 17124 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:18.958290 16539 rpcz_store.cc:276] 0709 13:07:17.342763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.642412 (+299649us) service_pool.cc:224] Handling call
0709 13:07:17.642724 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.748069 (+105345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.748114 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.833529 (+ 85415us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.096048 (+262519us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:18.096107 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.096200 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:18.939161 (+842961us) raft_consensus.cc:1685] finished
0709 13:07:18.939187 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.939368 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68472,"raft.queue_time_us":105569,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":66378,"thread_start_us":195774,"threads_started":1,"wal-append.queue_time_us":353483}
I20260709 13:07:18.951028 16466 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:18.443570 19267 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:18.533327 19344 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:18.955070 19112 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.870s	user 0.005s	sys 0.005s
I20260709 13:07:18.913269 19438 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.989312 19414 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:18.966223 19460 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.990749 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1895) took 2242 ms. Trace:
I20260709 13:07:18.446103 19442 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:18.995725 19381 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.049s	user 0.009s	sys 0.000s
I20260709 13:07:18.996166 19210 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:18.998016 19364 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.014s	user 0.012s	sys 0.000s
W20260709 13:07:18.998171 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:19.000535 17125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.002s	sys 0.026s
I20260709 13:07:18.928524 16619 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:18.937285 19289 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.856853 19162 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:19.012295 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 121477us
W20260709 13:07:18.992650 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1955) took 2147 ms (client timeout 2175 ms). Trace:
W20260709 13:07:19.050716 16511 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.959s (SENT)
W20260709 13:07:19.050596 16537 rpcz_store.cc:269] 0709 13:07:16.845406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.246046 (+400640us) service_pool.cc:224] Handling call
0709 13:07:18.992500 (+1746454us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54003e9754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:18.992596 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423454976}
I20260709 13:07:19.015671 16611 rpcz_store.cc:276] 0709 13:07:16.748266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.756872 (+  8606us) service_pool.cc:224] Handling call
0709 13:07:16.757135 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.027729 (+270594us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:17.074695 (+ 46966us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.289245 (+214550us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.232620 (+943375us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b1800231700. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:18.324270 (+ 91650us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.325838 (+  1568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.325887 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:18.325950 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.990531 (+664581us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002355d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:18.990575 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.990691 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13104,"prepare.queue_time_us":56236,"prepare.run_cpu_time_us":136,"prepare.run_wall_time_us":9566,"raft.queue_time_us":444862,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":26525,"spinlock_wait_cycles":673640064,"thread_start_us":1238580,"threads_started":2,"wal-append.queue_time_us":446575}
I20260709 13:07:18.927476 19439 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.005028 19403 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:18.976015 19337 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.006296 19112 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.060002 19337 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.061805 19112 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.062111 19337 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.062548 19112 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.063067 17121 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:19.045374 17125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.002s	sys 0.026s
I20260709 13:07:18.999639 19426 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:19.064678 19207 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:19.064458 19426 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.056470 19289 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.066807 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.067056 19289 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.067399 19426 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:19.055687 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:19.055799 19364 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:19.067901 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.068795 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.068346 19364 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.069360 16619 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:07:19.070175 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.070422 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1896) took 2321 ms. Trace:
I20260709 13:07:19.070958 19364 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.071166 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.072202 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.070755 16616 rpcz_store.cc:276] 0709 13:07:16.748484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.752616 (+  4132us) service_pool.cc:224] Handling call
0709 13:07:16.760484 (+  7868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.874293 (+113809us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:16.901224 (+ 26931us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.745189 (+843965us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.835524 (+ 90335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.835600 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:17.835665 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.070210 (+1234545us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002350d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.070252 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.070358 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":115798,"prepare.queue_time_us":31997,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":7990,"raft.queue_time_us":282857,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":46951,"spinlock_wait_cycles":280469504,"thread_start_us":818595,"threads_started":2,"wal-append.queue_time_us":983506}
I20260709 13:07:19.075052 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:19.075738 19374 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.001s
I20260709 13:07:19.076160 19374 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.076292 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.077251 16616 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:19.077605 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.854055 19458 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.077973 19267 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:18.911821 18490 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.078215 16613 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:19.079136 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:19.079663 16613 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.080054 19344 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.062997 19112 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.052300 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:18.960546 19462 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.082093 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.084833 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.085194 16611 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:19.068501 16614 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:19.086431 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.087306 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.035200 19460 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.088272 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:19.089103 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 229756us
I20260709 13:07:19.040899 19210 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:19.091984 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:19.055104 19367 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.375s	user 0.004s	sys 0.007s
I20260709 13:07:19.042327 19179 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.098070 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:19.043670 19305 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:18.960327 19461 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.106628 19305 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.108090 19462 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.109411 19413 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.101785 19367 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.111143 19461 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:19.111646 19392 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.688s	user 0.000s	sys 0.006s
I20260709 13:07:19.111768 19367 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:19.112053 19402 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.204s	user 0.007s	sys 0.005s
I20260709 13:07:19.114310 19402 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.114671 19402 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:19.115015 19402 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:19.101930 19425 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.420s	user 0.002s	sys 0.010s
I20260709 13:07:19.112861 19328 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.112717 19210 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.123425 19210 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.124078 19304 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.044435 19381 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.122316 19425 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.131778 19425 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.132897 19392 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:19.141955 19428 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.200s	user 0.006s	sys 0.014s
I20260709 13:07:19.143492 19402 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.144608 19395 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:19.148988 19432 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 1.198s	user 0.017s	sys 0.012s
I20260709 13:07:19.150288 19442 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:19.153892 19419 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.164s	user 0.005s	sys 0.006s
W20260709 13:07:19.158162 19406 consensus_meta.cc:287] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.000s
I20260709 13:07:19.159543 19401 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.014885 16470 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:19.046185 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1949) took 2228 ms. Trace:
I20260709 13:07:19.095736 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.085281 19112 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.159755 19305 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.160771 19308 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.160456 19382 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:19.198208 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.013s	sys 0.017s
W20260709 13:07:19.310551 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.014s	sys 0.017s
I20260709 13:07:19.215255 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.311674 19266 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.338501 16469 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.331756 16463 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:19.248673 16610 raft_consensus.cc:2368] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:19.315707 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.282734 17127 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:19.229719 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.262148 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.232251 16542 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:19.273141 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.256459 16613 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
W20260709 13:07:19.391453 16435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.003s	sys 0.012s
W20260709 13:07:19.391877 16435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.003s	sys 0.012s
I20260709 13:07:19.315371 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:19.260079 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.239516 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.250315 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:19.308580 19204 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.318s	user 0.006s	sys 0.004s
I20260709 13:07:19.395440 16464 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.325073 19365 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:19.405213 18945 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.161111 19446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.031s	sys 0.038s
W20260709 13:07:19.406347 19446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.031s	sys 0.038s
I20260709 13:07:19.406162 18945 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:19.167207 19408 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 2.129s	user 0.000s	sys 0.005s
I20260709 13:07:19.167373 19460 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.410490 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:19.411450 19460 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.412294 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:19.163692 19392 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.413936 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:19.415474 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.216117 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:19.260255 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.284870 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 516) took 1129 ms. Trace:
I20260709 13:07:19.281775 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 608) took 1970 ms. Trace:
W20260709 13:07:19.243983 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 750564us
I20260709 13:07:19.281826 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 554) took 2617 ms. Trace:
W20260709 13:07:19.230780 16541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1516) took 2465 ms (client timeout 2088 ms). Trace:
W20260709 13:07:19.418022 16541 rpcz_store.cc:269] 0709 13:07:16.766214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.766709 (+   495us) service_pool.cc:224] Handling call
0709 13:07:19.230180 (+2463471us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400032ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.230437 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445643520}
I20260709 13:07:19.265069 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1686) took 2872 ms. Trace:
I20260709 13:07:19.417924 17119 rpcz_store.cc:276] 0709 13:07:16.664434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.664755 (+   321us) service_pool.cc:224] Handling call
0709 13:07:16.665114 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.703948 (+ 38834us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:16.756425 (+ 52477us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.965325 (+1208900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.965376 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:17.965444 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.281296 (+1315852us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b540070f654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.281401 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.281654 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52641,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3875,"raft.queue_time_us":99686,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":88671616,"thread_start_us":1208506,"threads_started":2,"wal-append.queue_time_us":531521,"wal-append.run_cpu_time_us":1783,"wal-append.run_wall_time_us":1265890}
I20260709 13:07:19.419267 16618 rpcz_store.cc:276] 0709 13:07:16.392584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.449759 (+ 57175us) service_pool.cc:224] Handling call
0709 13:07:16.450142 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.360247 (+1910105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.264327 (+904080us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540001ead4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.264720 (+   393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4379299072}
I20260709 13:07:19.163646 19419 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.417573 17123 rpcz_store.cc:276] 0709 13:07:17.311468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.311753 (+   285us) service_pool.cc:224] Handling call
0709 13:07:17.312046 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.678090 (+366044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.281169 (+1603079us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54004b0ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.281603 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703035776}
I20260709 13:07:19.421479 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 435) took 1079 ms. Trace:
I20260709 13:07:19.421965 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.421831 16618 rpcz_store.cc:276] 0709 13:07:18.342509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.420358 (+1077849us) service_pool.cc:224] Handling call
0709 13:07:19.420733 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.421110 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.421135 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.421197 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.421239 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.421308 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.421416 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.422571 19419 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:19.233351 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33132 (request call id 25) took 1331 ms. Trace:
I20260709 13:07:19.377470 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:19.312443 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 983169us
I20260709 13:07:19.283962 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 615) took 1182 ms. Trace:
I20260709 13:07:19.397425 16617 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:19.280294 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:19.313104 19381 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:19.398707 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.257586 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.377889 19374 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.431268 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 437) took 1084 ms. Trace:
I20260709 13:07:19.215204 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:19.281491 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 609) took 1950 ms. Trace:
W20260709 13:07:19.316285 19361 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.945s	user 0.008s	sys 0.004s
I20260709 13:07:19.332427 19275 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.401645 19402 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.229386 16536 rpcz_store.cc:276] 0709 13:07:16.817788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.817943 (+   155us) service_pool.cc:224] Handling call
0709 13:07:16.818362 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.955222 (+1136860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.955249 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.963026 (+  7777us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.236246 (+273220us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:18.236286 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.236349 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.045918 (+809569us) raft_consensus.cc:1685] finished
0709 13:07:19.045944 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.046118 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4647,"raft.queue_time_us":277939,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":1361559,"threads_started":2,"wal-append.queue_time_us":388256}
I20260709 13:07:19.164040 19406 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.402676 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.403990 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:19.404794 19438 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:19.281510 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 557) took 2430 ms. Trace:
I20260709 13:07:19.423449 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:19.398897 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 297475us
I20260709 13:07:19.423427 19419 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:19.426523 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:19.426997 16469 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:19.424799 17126 rpcz_store.cc:276] 0709 13:07:18.126098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.126318 (+   220us) service_pool.cc:224] Handling call
0709 13:07:18.215196 (+ 88878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.282843 (+1067647us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.282886 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.282950 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.283005 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.283608 (+   603us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540047bb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.283647 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.283803 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21039,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":257,"spinlock_wait_cycles":2453010304}
I20260709 13:07:19.417243 17121 rpcz_store.cc:276] 0709 13:07:18.155311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.314026 (+158715us) service_pool.cc:224] Handling call
0709 13:07:19.284423 (+970397us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b54004b1754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.284629 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665142016}
I20260709 13:07:19.428040 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:19.412245 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 344705us
I20260709 13:07:19.423727 16618 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:19.430140 19472 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.431725 16617 rpcz_store.cc:276] 0709 13:07:18.346423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.425233 (+1078810us) service_pool.cc:224] Handling call
0709 13:07:19.430506 (+  5273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.430897 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.430927 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.431003 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.431042 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.431094 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.431187 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.424384 16545 rpcz_store.cc:276] 0709 13:07:17.924919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.925109 (+   190us) service_pool.cc:224] Handling call
0709 13:07:19.232867 (+1307758us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400380c54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374f7853 00007ffa3c4c560a 00007ffa35a4b7d4 00007ffa35a4b762 00007ffa35a4b691 00007ffa35a4b60c 00007ffa35a4a8c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.233080 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795951488}
I20260709 13:07:19.432278 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 441) took 1080 ms. Trace:
I20260709 13:07:19.433929 16466 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:19.429418 16468 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:19.437609 16541 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:19.438319 16470 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:19.438117 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:19.447695 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 436) took 1096 ms. Trace:
I20260709 13:07:19.448107 16618 rpcz_store.cc:276] 0709 13:07:18.346045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.422843 (+1076798us) service_pool.cc:224] Handling call
0709 13:07:19.423253 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.441639 (+ 18386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.441847 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.443632 16613 rpcz_store.cc:276] 0709 13:07:18.347728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.078916 (+731188us) service_pool.cc:224] Handling call
0709 13:07:19.424199 (+345283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:19.452582 16464 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:19.462782 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:19.462949 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.464866 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.474280 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.477686 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.478439 19469 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:19.478874 19406 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:19.479202 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.479403 18945 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.479836 19472 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.432370 17125 rpcz_store.cc:276] 0709 13:07:17.331346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.407831 (+ 76485us) service_pool.cc:224] Handling call
0709 13:07:17.408130 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:17.408445 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.408472 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:17.436758 (+ 28286us) log.cc:844] Serialized 26 byte log entry
0709 13:07:18.373814 (+937056us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18001cace0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:19.064419 (+690605us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:19.064454 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.064533 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.280729 (+216196us) raft_consensus.cc:1685] finished
0709 13:07:19.280786 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.281212 (+   426us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7511,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":14650,"spinlock_wait_cycles":3447040,"thread_start_us":690389,"threads_started":1,"wal-append.queue_time_us":1698757}
I20260709 13:07:19.592310 16618 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:19.492054 16614 raft_consensus.cc:2410] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:19.616472 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 611) took 1579 ms. Trace:
W20260709 13:07:19.564117 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 137756us
I20260709 13:07:19.481467 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:19.485085 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 210990us
I20260709 13:07:19.589677 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:19.608801 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:19.560863 16464 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.654562 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.481401 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1679) took 2845 ms. Trace:
I20260709 13:07:19.587821 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.668524 17127 rpcz_store.cc:276] 0709 13:07:18.037312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.037572 (+   260us) service_pool.cc:224] Handling call
0709 13:07:18.089545 (+ 51973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.398958 (+1309413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.616109 (+217151us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.616396 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742223744}
I20260709 13:07:19.480643 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.670033 17119 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:19.480937 16611 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:19.670380 16468 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:19.674069 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1915) took 1194 ms. Trace:
I20260709 13:07:19.612571 16470 pending_rounds.cc:85] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 4
I20260709 13:07:19.600440 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 406) took 2295 ms. Trace:
I20260709 13:07:19.674652 16611 rpcz_store.cc:276] 0709 13:07:18.479670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.402293 (+922623us) service_pool.cc:224] Handling call
0709 13:07:19.673989 (+271696us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:19.581393 17124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.002s	sys 0.015s
I20260709 13:07:19.677371 17126 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 4.
I20260709 13:07:19.675585 16542 rpcz_store.cc:276] 0709 13:07:17.305226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.524997 (+219771us) service_pool.cc:224] Handling call
0709 13:07:17.573122 (+ 48125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.424078 (+1850956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.599996 (+175918us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001f59d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:19.600319 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3813351296}
I20260709 13:07:19.589154 17122 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:07:19.587636 16610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1702) took 1368 ms (client timeout 1541 ms). Trace:
I20260709 13:07:19.583060 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:19.684955 19337 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.462949 19419 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:19.681206 16610 rpcz_store.cc:269] 0709 13:07:18.219036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.440869 (+221833us) service_pool.cc:224] Handling call
0709 13:07:19.587331 (+1146462us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54002490d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.587545 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038841088}
I20260709 13:07:19.690696 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.675122 16470 pending_rounds.cc:107] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:07:19.442261 19361 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.692080 16470 raft_consensus.cc:2889] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:19.693073 19033 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:19.699559 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.700171 17123 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:19.697576 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.694906 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.686928 19337 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.476608 19438 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.705260 19361 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.704937 19033 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.705672 19337 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.706238 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:19.707819 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:19.708369 19392 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.708808 17118 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.709085 19431 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.709162 19392 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.482450 19112 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:19.721642 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.718200 16541 raft_consensus.cc:2410] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:19.719696 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:19.502718 19204 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.672732 16465 rpcz_store.cc:276] 0709 13:07:16.636013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.638513 (+  2500us) service_pool.cc:224] Handling call
0709 13:07:16.638874 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.639334 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.639373 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.639956 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.790036 (+150080us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:17.074431 (+284395us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.181459 (+107028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.181544 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.575679 (+394135us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b48000030d8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:07:19.166271 (+1590592us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:19.472201 (+305930us) raft_consensus.cc:1685] finished
0709 13:07:19.480956 (+  8755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.481201 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51072,"prepare.queue_time_us":616848,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":7997,"raft.queue_time_us":41049,"raft.run_cpu_time_us":3648,"raft.run_wall_time_us":926854,"spinlock_wait_cycles":93791872,"thread_start_us":396761,"threads_started":3,"wal-append.queue_time_us":207218}
I20260709 13:07:19.745783 19392 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.748198 16539 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:19.710045 19431 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.708829 19402 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.759152 17127 raft_consensus.cc:2410] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:07:19.769223 16469 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:19.769677 16468 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:19.760744 19402 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:19.764256 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:19.779582 19472 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.779872 16616 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:19.775363 19402 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.781423 19112 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.782236 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 333) took 1191 ms. Trace:
I20260709 13:07:19.782624 16461 rpcz_store.cc:276] 0709 13:07:18.558290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.807351 (+249061us) service_pool.cc:224] Handling call
0709 13:07:19.212691 (+405340us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:07:19.213444 (+   753us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.213948 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:19.430129 (+216181us) log.cc:844] Serialized 14 byte log entry
0709 13:07:19.731200 (+301071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:19.731254 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:19.731311 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.731446 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.749125 (+ 17679us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49885,"prepare.queue_time_us":347389,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":8944,"raft.queue_time_us":77017,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":80,"spinlock_wait_cycles":29692160,"thread_start_us":442333,"threads_started":2}
I20260709 13:07:19.439775 17120 rpcz_store.cc:276] 0709 13:07:16.851383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.852044 (+   661us) service_pool.cc:224] Handling call
0709 13:07:16.898458 (+ 46414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.898883 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.898921 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.899533 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:07:17.316203 (+416670us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:17.329060 (+ 12857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.404505 (+ 75445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.148434 (+1743929us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:19.280748 (+132314us) raft_consensus.cc:1685] finished
0709 13:07:19.280806 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.281249 (+   443us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73176,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5672,"spinlock_wait_cycles":11633920,"thread_start_us":146966,"threads_started":1,"wal-append.queue_time_us":979704}
W20260709 13:07:19.786793 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 186490us
I20260709 13:07:19.719512 19469 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:19.793987 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.796907 19407 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.796608 17121 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:19.802961 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 95373.2us
I20260709 13:07:19.804751 17123 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.805501 19407 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.813797 19407 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:19.817189 19112 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:19.818349 19469 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.822135 19033 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.822675 19401 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:19.801656 19457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.004s	sys 0.009s
W20260709 13:07:19.845266 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.816601 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:19.859724 19392 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:19.860464 19392 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.860998 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 513) took 1691 ms. Trace:
I20260709 13:07:19.861363 17124 rpcz_store.cc:276] 0709 13:07:18.154404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.960114 (+805710us) service_pool.cc:224] Handling call
0709 13:07:18.986173 (+ 26059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.007294 (+ 21121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.007324 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.007875 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.788036 (+780161us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:19.795875 (+  7839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.802039 (+  6164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.827875 (+ 25836us) raft_consensus.cc:1685] finished
0709 13:07:19.827895 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.845480 (+ 17585us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81546,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":17810,"thread_start_us":644503,"threads_started":1,"wal-append.queue_time_us":665612}
I20260709 13:07:19.862713 19392 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.865675 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.866071 19406 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.866559 16465 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:19.863271 19033 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.867372 19033 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:19.867661 19420 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.868139 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.868263 19420 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:19.864435 19407 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.867199 19406 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:19.866400 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:19.874934 19420 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:19.875753 19407 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.876444 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:19.862064 17118 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:19.868535 19033 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.876693 19420 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:19.912209 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 197254us
I20260709 13:07:19.912573 19275 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.912998 19275 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.913374 19275 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.877390 19438 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:19.867601 19400 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:19.915066 19400 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.915386 19400 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:19.883669 16469 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.918370 16469 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:19.884126 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:19.877017 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48657.4us
I20260709 13:07:19.920164 16468 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:19.882905 16461 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.922004 16436 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:19.876071 19406 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:19.922948 17119 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:19.923159 19406 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:19.924417 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 518) took 1768 ms. Trace:
I20260709 13:07:19.892345 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:19.924847 17119 rpcz_store.cc:276] 0709 13:07:18.156250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.714304 (+1558054us) service_pool.cc:224] Handling call
0709 13:07:19.922778 (+208474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.923346 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.924191 (+   845us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400523850. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.924341 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416260992}
I20260709 13:07:19.900173 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:19.924455 19406 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:19.924489 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48092.6us
I20260709 13:07:19.928172 19406 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:19.877192 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:19.882043 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:19.913223 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:19.934247 16465 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.935864 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:19.945192 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:19.946401 19440 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.947028 19440 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:19.947803 19275 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:19.949582 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 191506us
I20260709 13:07:19.950516 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:19.951515 19392 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.951926 19392 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:19.952265 19392 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.948263 19440 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.953179 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:19.955562 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:19.959183 19431 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.959920 19337 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.959965 19336 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:19.963601 17127 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:19.896440 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:19.851949 19457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.004s	sys 0.010s
I20260709 13:07:19.820574 19402 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:19.963018 19438 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:19.982281 19438 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.982672 19438 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.876844 19152 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.984279 19152 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.984748 19402 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:19.986563 19420 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:19.986994 19420 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:19.987450 19420 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.989495 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 443) took 1197 ms. Trace:
I20260709 13:07:19.989890 16617 rpcz_store.cc:276] 0709 13:07:18.792253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.473816 (+681563us) service_pool.cc:224] Handling call
0709 13:07:19.685725 (+211909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.706990 (+ 21265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.707034 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.707765 (+   731us) log.cc:844] Serialized 26 byte log entry
0709 13:07:19.791045 (+ 83280us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:19.791085 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:19.791164 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:19.989267 (+198103us) raft_consensus.cc:1685] finished
0709 13:07:19.989291 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:19.989414 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1564,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":82796,"threads_started":1,"wal-append.queue_time_us":279486}
W20260709 13:07:19.991554 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 95289.3us
W20260709 13:07:19.992969 17122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 612) took 1934 ms (client timeout 2069 ms). Trace:
I20260709 13:07:19.993712 19477 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:19.994303 19477 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:19.993430 17122 rpcz_store.cc:269] 0709 13:07:18.058816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.059073 (+   257us) service_pool.cc:224] Handling call
0709 13:07:19.992757 (+1933684us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540067ded4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:19.992876 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3438025472}
I20260709 13:07:19.995426 19477 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:19.984628 19152 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.006058 19407 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:20.007853 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94799.8us
I20260709 13:07:20.023808 16611 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:20.024282 16616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1704) took 1225 ms (client timeout 1523 ms). Trace:
W20260709 13:07:20.024674 16616 rpcz_store.cc:269] 0709 13:07:18.798736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.082609 (+283873us) service_pool.cc:224] Handling call
0709 13:07:20.024039 (+941430us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54003e6a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:20.024212 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184266112}
I20260709 13:07:20.025866 16612 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:20.026418 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.027905 19336 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:20.028000 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.024730 19361 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:19.916347 19400 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.029052 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.029850 16618 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:20.030047 19400 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.035111 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.037087 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.037858 16617 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.040401 19407 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.041106 19407 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.043641 19407 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.040560 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 439) took 1693 ms. Trace:
W20260709 13:07:20.045228 19485 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:20.044906 16612 rpcz_store.cc:276] 0709 13:07:18.347092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.429198 (+1082106us) service_pool.cc:224] Handling call
0709 13:07:20.025671 (+596473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.026264 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.040351 (+ 14087us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54003e6a50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:20.040491 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299799296}
W20260709 13:07:20.046506 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 70303.5us
I20260709 13:07:20.047897 16465 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:20.007416 19204 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.045879 19275 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:20.055860 18490 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.057426 19434 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.058060 19434 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.060328 19434 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.061009 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 517) took 1905 ms. Trace:
I20260709 13:07:20.061547 17126 rpcz_store.cc:276] 0709 13:07:18.155973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.690397 (+1534424us) service_pool.cc:224] Handling call
0709 13:07:19.762214 (+ 71817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:20.059906 (+297692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:20.059934 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:20.059989 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.060032 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.060690 (+   658us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54007b57d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:20.060743 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.060914 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460992768}
I20260709 13:07:20.056408 18490 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.066915 19438 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.067340 18490 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.052505 19336 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:20.072989 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 126020us
I20260709 13:07:20.073243 19336 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:20.073695 19419 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.073767 19336 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.068127 16617 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:20.068251 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 519) took 1911 ms. Trace:
I20260709 13:07:20.076915 17123 rpcz_store.cc:276] 0709 13:07:18.156508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.700821 (+1544313us) service_pool.cc:224] Handling call
0709 13:07:19.778817 (+ 77996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:19.806761 (+ 27944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.067968 (+261207us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400641ed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:20.068181 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48189696}
W20260709 13:07:20.080401 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 130052us
I20260709 13:07:20.076472 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:20.086123 19365 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:20.086575 19365 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.086874 19365 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.087319 19275 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.088093 19452 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.089532 19434 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:20.090713 19434 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.091068 19434 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:20.092051 19434 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.101342 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:20.017355 19392 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.102087 16612 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:20.055186 19407 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.113610 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.116854 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:20.122092 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94234.7us
I20260709 13:07:20.120745 18490 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.105409 19204 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:07:20.137639 16611 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:20.141364 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.142055 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.146275 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.146528 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.147254 17127 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:20.147671 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.148149 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.148964 17126 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:20.151517 19458 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.152181 19458 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.152652 19458 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.153621 19458 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.116004 19407 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.159502 17123 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:20.172662 19336 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.165046 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:20.176893 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.180904 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:20.165890 19434 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.186576 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 55329.6us
I20260709 13:07:20.187520 18490 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:20.145171 19420 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.188418 18490 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.191182 18490 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.190979 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:20.204659 16618 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:20.207142 17126 raft_consensus.cc:2376] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5. Re-sending same reply.
I20260709 13:07:20.217073 17122 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:07:20.217540 17122 pending_rounds.cc:85] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 6
I20260709 13:07:20.217784 17122 pending_rounds.cc:107] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:07:20.218073 17122 raft_consensus.cc:2889] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:20.219612 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.227366 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.228899 16612 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.230556 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:20.235116 16611 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:07:20.231669 19480 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.158s	user 0.001s	sys 0.001s
I20260709 13:07:20.238124 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.217347 19438 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.242018 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.243460 19336 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.244037 16614 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:20.238731 17123 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:20.246006 19460 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:20.246470 19460 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.248426 19440 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.248950 19464 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:07:20.253006 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.258874 18490 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.262642 16610 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:20.266294 19437 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.267223 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:20.267992 16613 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:20.237252 19392 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.242018 18945 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.251477 19440 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:20.295876 18490 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.247388 19460 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:20.303812 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53870.4us
I20260709 13:07:20.276916 19437 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:20.307108 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 317932us
W20260709 13:07:20.307509 19483 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.251s	user 0.006s	sys 0.000s
I20260709 13:07:20.309667 19460 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:20.311185 19490 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:07:20.314467 19440 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.316046 19440 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.317437 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.318068 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.318689 17126 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:07:20.321128 19489 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:20.321378 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.322147 17126 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:20.322276 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1916) took 1527 ms. Trace:
I20260709 13:07:20.322754 19420 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.324553 17126 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.322600 16619 rpcz_store.cc:276] 0709 13:07:18.795339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.484486 (+689147us) service_pool.cc:224] Handling call
0709 13:07:19.558815 (+ 74329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.621233 (+ 62418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.621277 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.698375 (+ 77098us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.018908 (+320533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.018943 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.019024 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.322064 (+303040us) raft_consensus.cc:1685] finished
0709 13:07:20.322084 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.322223 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40774,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":22937,"thread_start_us":225132,"threads_started":1,"wal-append.queue_time_us":360298}
W20260709 13:07:20.333244 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 120143us
W20260709 13:07:20.335652 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.341230 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.342252 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.342634 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.342980 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.346168 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.271345 19365 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:20.379148 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.383903 16617 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:20.386847 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.383670 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:20.388234 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47366us
I20260709 13:07:20.388970 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.389035 19402 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:20.389751 19431 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.390815 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.392577 19401 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.370338 18945 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.401516 19437 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.403501 19431 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.404392 19361 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.404882 19361 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:20.406165 19361 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.408293 19361 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.417901 19420 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.418535 19420 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.361527 19407 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:20.301513 19152 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:20.424917 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 78864us
I20260709 13:07:20.423383 19152 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:20.429414 19365 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.441964 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:20.437445 19336 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.444231 19336 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.444337 18490 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:20.444761 18490 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.445122 18490 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.444978 19438 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:20.437840 18945 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.450062 19438 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.451100 19438 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.451476 17122 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.451548 18945 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.451897 19438 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.445161 19336 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.440348 19420 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:20.468833 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82086.6us
I20260709 13:07:20.461728 19460 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:20.469873 19438 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.470765 19371 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:20.471136 19371 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.445621 19337 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:20.472100 19371 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.543334 18490 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:20.545194 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 459005us
I20260709 13:07:20.553391 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:20.546963 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:20.541200 19371 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.561682 18490 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.564993 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:20.566908 17122 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.570358 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.580825 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:20.581626 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 468021us
I20260709 13:07:20.581634 19460 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:20.587949 19460 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:20.588738 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:20.589176 19460 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.590752 19460 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:20.584427 19492 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:20.585110 16539 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:20.581733 16537 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:20.574927 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.599241 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.599433 19497 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.599921 16466 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:20.599581 19464 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.600251 19497 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.600749 19464 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.602974 19497 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:20.603678 19497 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.604127 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:20.608475 16466 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:20.605156 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.609599 17123 raft_consensus.cc:2410] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:20.610757 16545 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:20.617542 16542 raft_consensus.cc:2410] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:20.618479 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.579428 19458 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:20.620517 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.610072 19464 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:20.619127 19497 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.636353 16541 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:20.616115 19420 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.637108 16537 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:20.638340 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 105168us
I20260709 13:07:20.641307 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:20.642055 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.637895 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.624356 19458 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.647809 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:20.637321 19469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.033s	sys 0.047s
I20260709 13:07:20.621492 19275 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:20.625850 19152 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:20.642500 19420 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:20.661358 19469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.033s	sys 0.047s
I20260709 13:07:20.675544 16542 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:20.647142 19458 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:20.669831 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.677081 16467 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.677816 16537 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.666973 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:20.678928 16463 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:20.681157 16541 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:20.682183 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.684343 16610 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:20.685088 16619 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:20.641059 19406 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:20.686353 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.685063 16539 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:20.668587 19420 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.683609 18490 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:20.691084 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.692097 16613 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:20.699385 16462 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:20.688184 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 296076us
W20260709 13:07:20.706614 19493 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:20.708541 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1708) took 1289 ms. Trace:
I20260709 13:07:20.709345 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:20.709714 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.710275 16614 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.712021 19407 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:20.713155 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 318633us
W20260709 13:07:20.723800 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.727026 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:20.708936 16470 rpcz_store.cc:276] 0709 13:07:19.419512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.465734 (+ 46222us) service_pool.cc:224] Handling call
0709 13:07:19.564730 (+ 98996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.798300 (+233570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.798333 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.802458 (+  4125us) log.cc:844] Serialized 26 byte log entry
0709 13:07:20.346898 (+544440us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:20.346948 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:20.347038 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:20.708317 (+361279us) raft_consensus.cc:1685] finished
0709 13:07:20.708336 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:20.708451 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":472914,"threads_started":1,"wal-append.queue_time_us":720242}
I20260709 13:07:20.684250 19499 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.675316 19497 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:20.699661 19402 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:20.743506 16539 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:20.744829 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.700400 19501 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.754220 16541 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:07:20.743909 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.003s	sys 0.028s
W20260709 13:07:20.765344 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.004s	sys 0.029s
I20260709 13:07:20.715030 19407 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:20.765746 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 758401us
W20260709 13:07:20.783209 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.785301 16467 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:20.794085 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:20.794306 16470 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:20.794813 16617 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:20.795789 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:20.796655 16619 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:20.801702 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.802829 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:20.813704 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.814610 16463 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:20.729220 19469 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:07:20.816212 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:20.818964 16464 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:20.816653 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:20.819444 16612 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:20.820626 16614 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:20.818296 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:20.769491 19501 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:20.822669 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.833444 16541 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:20.837001 16462 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:20.860023 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 181052us
W20260709 13:07:20.861564 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.863823 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:20.867794 16465 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:20.860749 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:20.837150 19501 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.871781 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.794737 19499 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:20.881984 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:20.884632 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.880728 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:20.893323 16468 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:20.896363 16463 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:20.894480 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:20.905556 19437 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:20.909304 19500 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:07:20.909554 19502 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:07:20.910954 19512 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:20.881085 19336 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:20.935197 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.937002 17122 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:20.882767 16433 connection.cc:256] RPC call timeout handler was delayed by -2.0287987680000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:07:20.885699 19365 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:20.939148 16464 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:20.925120 19361 consensus_meta.cc:287] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.508s	user 0.012s	sys 0.000s
I20260709 13:07:20.873042 19507 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.204s
I20260709 13:07:20.959906 16463 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:20.961906 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 373131us
I20260709 13:07:20.988369 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:20.942070 19336 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.873111 19407 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:20.991662 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 46680.5us
W20260709 13:07:20.992444 16582 leader_election.cc:336] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.608s (SENT)
I20260709 13:07:20.994514 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:20.963605 19431 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:20.952862 19365 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:20.994854 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:20.993624 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:20.907481 19437 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.006842 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:20.993734 19336 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.007453 16541 raft_consensus.cc:2376] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7. Re-sending same reply.
I20260709 13:07:20.968405 19275 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:07:21.011133 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:20.991987 19204 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:20.930925 19402 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.025065 19464 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:21.025497 19464 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:21.026295 19464 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.019711 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.018867 16542 raft_consensus.cc:2376] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9. Re-sending same reply.
I20260709 13:07:21.022387 19527 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:21.022790 19509 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:21.023119 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:21.023782 19504 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:21.023979 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:21.024252 19033 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.021291 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.012962 19497 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:21.043618 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84797.5us
I20260709 13:07:21.043454 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.004494 19361 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:21.020721 19400 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.055918 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:21.037066 19527 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.020483 19401 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:07:21.061343 16542 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:21.442910 19501 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:07:21.477699 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.163611 16539 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:21.479184 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.479808 16539 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:21.480911 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:21.481527 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 487742us
I20260709 13:07:21.101233 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.484041 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.106122 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:21.355993 16466 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:21.062644 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:21.480945 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 518626us
I20260709 13:07:21.112298 19400 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:21.046411 19509 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:21.487149 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 475475us
I20260709 13:07:21.296605 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.487915 16544 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:21.251021 19531 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:21.488492 19434 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:21.489082 19434 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.297341 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.491010 19434 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.491345 16538 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:21.492266 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:21.248939 19523 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:21.278378 16540 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:21.494048 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.494307 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.494729 19527 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.477427 19501 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.495071 16545 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:21.248556 19506 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 13:07:21.496008 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.496598 16545 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:21.497574 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.498160 16545 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:21.257438 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.502197 19401 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:21.502589 19401 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:21.503490 19401 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.485318 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.043495 19458 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.505148 16536 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.505832 16461 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:07:21.057731 16541 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:21.289983 19371 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 13:07:21.506888 19458 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:21.507149 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.507572 19498 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:21.507988 19498 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:21.508235 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.481611 16539 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:21.293547 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:21.476143 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.510165 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.510707 16537 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.508792 16541 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:21.042093 19504 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:21.504945 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 480997us
I20260709 13:07:21.513409 16538 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:21.492925 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:21.520627 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 477212us
I20260709 13:07:21.539559 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:21.538250 16545 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:21.538851 16544 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:21.548094 16543 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.548974 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 489227us
I20260709 13:07:21.552453 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:21.554373 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.100262 19510 raft_consensus.cc:2764] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:21.561043 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.504673 19401 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.561688 16538 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:21.561990 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:21.563413 16538 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:21.563699 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.564210 16541 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.564460 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:21.559800 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.566591 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:21.567276 17122 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:21.099756 19431 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.482353 19392 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:21.057108 19033 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:21.572404 16544 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:07:21.569480 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.214469 19499 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.291265 19437 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.571600 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:21.573457 17123 pending_rounds.cc:85] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 7
I20260709 13:07:21.579018 17123 pending_rounds.cc:107] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:21.579303 17123 raft_consensus.cc:2889] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:21.248327 19361 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:21.585486 19361 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:21.586490 16511 leader_election.cc:400] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:21.586853 16511 leader_election.cc:403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.586436 19361 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.587695 19361 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.587898 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:21.568282 19510 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:21.590380 19510 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.593047 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:21.595366 19033 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.597534 19534 raft_consensus.cc:2764] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:21.598332 19534 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:21.579880 16539 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:21.562795 19527 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:21.572609 19336 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
I20260709 13:07:21.581580 19509 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:21.570711 19431 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.577841 16545 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:21.603071 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 63300.7us
I20260709 13:07:21.548578 19504 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.636248 16539 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.638450 19501 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.640807 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.642891 19509 raft_consensus.cc:2764] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:21.654817 19520 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.655946 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:21.656744 17122 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:21.658003 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:21.658682 17122 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:21.659077 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:21.659435 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.121256 19420 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.662334 19420 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:21.664963 19509 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.666126 19419 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:21.633659 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.659994 19504 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.668076 16537 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:21.599020 19534 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:21.675395 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:21.675751 16542 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:21.675443 16470 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:21.685204 16545 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:21.687290 16537 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:21.668857 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:21.508761 19498 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.572394 19540 raft_consensus.cc:2764] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:21.670231 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:21.632858 19431 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.697291 16542 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:21.700384 16541 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 13:07:21.701397 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 161896us
I20260709 13:07:21.701700 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 341) took 1064 ms. Trace:
I20260709 13:07:21.702128 16465 rpcz_store.cc:276] 0709 13:07:20.633097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.633538 (+   441us) service_pool.cc:224] Handling call
0709 13:07:21.697130 (+1063592us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002a85d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:21.697249 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399072512}
I20260709 13:07:21.703054 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.703663 16540 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:21.705005 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.705473 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.706284 16537 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:21.706974 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.707808 16537 raft_consensus.cc:2410] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:21.709327 19519 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.709875 19519 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.711287 16544 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.666972 19509 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:21.693289 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:21.674876 19407 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:21.632289 19434 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:07:21.692607 19361 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:21.716527 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.717238 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:21.717617 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.691495 19534 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.615958 19336 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.721853 19407 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.725672 19541 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.737404 19541 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:21.737788 19541 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:21.726487 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.739292 19521 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.739776 19521 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:21.740345 17120 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:21.741899 19521 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:21.744808 19534 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:21.745792 19510 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:21.746356 19510 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.746775 19510 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.726734 19538 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.720393 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.725486 19498 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:21.737522 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:21.723132 16542 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:21.731590 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:21.752976 17125 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:21.749434 17119 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:21.731499 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.735992 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:21.757903 16536 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:21.758330 16538 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.717206 19501 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:21.848435 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.819255 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.801388 16464 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.776342 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.854997 16544 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
W20260709 13:07:21.787606 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51711.4us
I20260709 13:07:21.775750 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:21.727434 19545 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:21.847334 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.875102 16541 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:21.777232 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:21.851478 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.720067 19543 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:21.730423 19401 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.868943 16537 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:21.868988 16543 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:21.869294 16536 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:21.761327 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:21.906386 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.870764 16463 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:21.906401 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.748317 19520 raft_consensus.cc:2764] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:21.907469 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.908075 16543 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:21.729975 19407 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.732142 19365 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.877434 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.909060 16537 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:07:21.909647 16541 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:21.910468 16537 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.878134 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.911597 16542 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:21.782688 19538 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.919754 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:21.879156 16610 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:21.879837 16618 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:21.727568 19420 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:07:21.881160 16468 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.727960 19509 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:21.729858 19504 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.881677 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:21.847980 18945 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.883006 19527 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:21.848160 19400 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.728843 19336 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:21.884450 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:21.889257 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 228459us
I20260709 13:07:21.811895 19519 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:21.893404 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:21.894120 19521 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:21.881186 16613 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:21.895143 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:21.909552 19365 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.905148 19543 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:21.933480 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:21.933848 16542 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:21.934090 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 119839us
I20260709 13:07:21.935323 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:21.961118 16536 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:21.935873 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 339) took 1309 ms. Trace:
I20260709 13:07:21.817836 19434 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.920475 19534 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:21.908670 19513 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.900s	user 0.000s	sys 0.021s
I20260709 13:07:21.846948 19510 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:21.938639 16615 raft_consensus.cc:2410] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:21.901262 19541 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:21.970801 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.998926 16545 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:21.973287 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 304481us
I20260709 13:07:22.004488 16613 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:22.004739 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:21.962067 16466 rpcz_store.cc:276] 0709 13:07:20.626556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.626702 (+   146us) service_pool.cc:224] Handling call
0709 13:07:21.935730 (+1309028us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54002a6cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:21.935822 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948973952}
W20260709 13:07:21.982961 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108755us
W20260709 13:07:21.983781 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64092.6us
I20260709 13:07:22.020809 16539 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:22.021319 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.972090 19434 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.979367 19464 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.028837 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:21.946599 18945 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:22.030201 16541 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:22.026702 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.948907 19400 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:22.032712 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47524.1us
I20260709 13:07:22.035530 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.031531 19434 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.028266 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:22.019140 19498 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.038995 16511 leader_election.cc:400] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:22.032471 19510 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.020380 19538 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:22.058849 16511 leader_election.cc:400] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:22.040983 16537 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:22.067075 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.067858 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:22.036303 19401 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:21.971362 19543 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.058086 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.060907 19521 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.074577 16541 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:22.108963 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:22.156656 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.156848 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:22.078480 19419 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.172523 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1737) took 1397 ms. Trace:
I20260709 13:07:22.172968 17127 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:07:22.185437 16461 rpcz_store.cc:276] 0709 13:07:20.774853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.774957 (+   104us) service_pool.cc:224] Handling call
0709 13:07:20.816338 (+ 41381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.506221 (+689883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.172231 (+666010us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54000b4854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:22.172449 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585108864}
I20260709 13:07:22.171344 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:22.083240 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:22.183017 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73737.6us
W20260709 13:07:22.190019 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 131393us
I20260709 13:07:22.076700 19460 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:22.196305 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:22.199958 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:22.203604 19571 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.156816 19401 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.197629 19460 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:22.209842 19560 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:07:22.210354 19558 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:07:22.212091 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:22.212248 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.213493 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:22.232553 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 455398us
I20260709 13:07:22.239261 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:22.239840 16470 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:22.240563 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:22.241137 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:22.244704 16470 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.076922 19407 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.126s
W20260709 13:07:22.248373 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47689.3us
I20260709 13:07:22.249286 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.253729 16541 raft_consensus.cc:2376] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 9. Re-sending same reply.
I20260709 13:07:22.254492 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.254915 16541 raft_consensus.cc:2376] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 9. Re-sending same reply.
I20260709 13:07:22.255672 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.248411 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.108366 19431 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:22.256340 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69395us
W20260709 13:07:22.258962 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59097.9us
I20260709 13:07:22.259653 17125 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:22.211668 19400 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:22.265776 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:22.268088 16470 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:22.257233 16537 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:22.270720 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.212492 18945 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:22.271766 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.271978 16541 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:22.273728 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.274170 16541 raft_consensus.cc:2376] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5. Re-sending same reply.
I20260709 13:07:22.274744 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.261441 19371 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:22.278321 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.278864 16541 raft_consensus.cc:2376] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 6. Re-sending same reply.
I20260709 13:07:22.251778 19521 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:22.192955 19419 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.248584 19361 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:22.290359 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:22.297379 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 289074us
I20260709 13:07:22.297952 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.299010 16537 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:22.300730 16461 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:22.300532 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.301746 16470 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:22.302011 16543 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:22.338488 16541 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:22.342317 16541 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:22.339730 16543 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:22.256171 19572 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:22.298452 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:22.344233 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45932us
W20260709 13:07:22.353590 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 92649us
I20260709 13:07:22.356997 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:22.289666 19504 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.302505 19507 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:22.358202 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 101431us
W20260709 13:07:22.363394 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 93876.5us
I20260709 13:07:22.363895 16541 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:22.367332 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:22.368034 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 98794.8us
I20260709 13:07:22.369280 16541 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.369416 16543 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:22.370625 16541 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:22.373157 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 439701us
I20260709 13:07:22.377241 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:22.339135 19477 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:07:22.357045 19534 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:22.360234 19033 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:22.379849 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:22.363574 19516 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.359045 19572 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:22.345570 19400 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:07:22.367377 19562 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:22.371017 19361 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.396801 17127 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:22.371789 19507 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:22.389389 19406 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:22.398103 19521 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.399124 19576 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:07:22.402248 19571 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:22.404405 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:22.429642 17125 raft_consensus.cc:2410] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:22.404574 19400 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.417392 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:22.384136 18945 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.383008 19033 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.431138 17123 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.434770 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:22.435961 19419 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:22.415002 19562 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.432755 19571 consensus_queue.cc:1243] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:22.453042 19336 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.435892 19371 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:22.433140 19516 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:22.454963 19562 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:22.454859 19371 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.436271 19458 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:22.455996 19516 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.456435 19516 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:22.456820 19406 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:22.457181 19516 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.457703 19406 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:22.458436 19516 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:22.470346 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 82640.7us
I20260709 13:07:22.474278 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:22.460593 19585 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:07:22.478210 19584 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:22.480983 19556 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:07:22.434226 19033 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:22.471524 19400 consensus_queue.cc:1243] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:22.585376 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.435555 18945 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:22.611800 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.639799 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.584503 19504 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:22.644124 19504 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.565757 19361 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.565208 19538 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:22.567299 19431 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:22.606045 19498 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.068s
W20260709 13:07:22.663242 19582 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:07:22.605046 19585 consensus_queue.cc:1243] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:22.723733 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 353753us
I20260709 13:07:22.604545 19534 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:22.767948 19586 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:07:22.657505 19361 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:22.802886 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 432592us
I20260709 13:07:22.694758 19400 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.668361 19538 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:22.977597 19401 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.978246 19401 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:22.979332 19401 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.981168 19562 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:22.982517 19562 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:22.982942 19562 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:22.819233 19361 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:22.984010 19562 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:22.769893 19534 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:23.056834 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.570578 19572 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:22.980635 19401 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:23.016386 19406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.007s
W20260709 13:07:23.098222 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 297478us
I20260709 13:07:23.107504 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:23.098636 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 718870us
I20260709 13:07:23.108716 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.089330 19590 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.114964 19590 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.107926 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 201117us
W20260709 13:07:23.128584 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 654355us
W20260709 13:07:23.019148 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.007s
W20260709 13:07:23.130296 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.007s
W20260709 13:07:23.130761 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 742179us
I20260709 13:07:23.132575 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:23.156020 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.177284 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69880.5us
W20260709 13:07:23.182857 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 50375.8us
W20260709 13:07:23.185444 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.187131 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.106488 19588 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.884831 19400 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.193728 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.194586 16470 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:23.195199 19400 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:23.195900 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.196630 16612 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:23.199606 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:23.200207 16619 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:23.183458 19431 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.184448 19562 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.191190 19507 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:23.217288 16461 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:23.221788 19437 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:23.202400 19365 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.231s	user 0.007s	sys 0.006s
W20260709 13:07:23.213505 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 104887us
W20260709 13:07:23.234545 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55493.3us
I20260709 13:07:23.196727 19501 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.235469 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.252476 16470 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:07:23.239475 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.257337 16611 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:23.237488 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:23.241652 19538 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:23.245005 19438 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.185556 19371 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:07:23.249459 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.300401 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:23.302582 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:23.303799 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 54475.9us
I20260709 13:07:23.208403 19588 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.232048 19431 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.298990 19437 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.260294 19595 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:23.306502 19434 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.244s	user 0.012s	sys 0.000s
I20260709 13:07:23.263619 19504 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.313670 19464 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.281s	user 0.007s	sys 0.004s
I20260709 13:07:23.325982 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.265021 19507 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:07:23.337344 19336 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.340958 19504 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:23.342038 19501 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.342967 16617 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:23.368168 16617 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:23.345151 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 411) took 2043 ms. Trace:
I20260709 13:07:23.348963 19590 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.349785 19534 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:23.351593 19588 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.352130 19595 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.377250 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:23.327132 19437 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.358227 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 417) took 1880 ms. Trace:
I20260709 13:07:23.364281 17090 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:23.369011 16538 rpcz_store.cc:276] 0709 13:07:21.302080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.564102 (+262022us) service_pool.cc:224] Handling call
0709 13:07:21.580730 (+ 16628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.848039 (+267309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.344901 (+1496862us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002909d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:23.345087 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408065792}
I20260709 13:07:23.372852 16541 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:23.400233 17125 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:23.373396 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47540.1us
I20260709 13:07:23.401254 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:23.404978 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.398289 16539 rpcz_store.cc:276] 0709 13:07:21.478209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.637161 (+158952us) service_pool.cc:224] Handling call
0709 13:07:21.637476 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.021379 (+383903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.357933 (+1336554us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400380754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:23.358156 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880956800}
I20260709 13:07:23.408027 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:23.325165 19600 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.410259 16617 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:23.408910 16618 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:23.335996 19434 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:23.402451 19437 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.424913 16617 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.377264 19599 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.392513 19464 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:23.423530 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.399417 19588 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.421654 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.422250 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58062us
I20260709 13:07:23.439396 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:23.420871 19516 consensus_meta.cc:287] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.962s	user 0.009s	sys 0.004s
I20260709 13:07:23.412614 19570 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.370985 19336 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.391389 19392 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:07:23.455821 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 212312us
W20260709 13:07:23.454173 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 275850us
I20260709 13:07:23.472785 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:23.440064 19371 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.476918 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:23.474047 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.455250 19610 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:23.495838 16617 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:23.501535 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 381479us
I20260709 13:07:23.456574 19516 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:23.462981 19540 raft_consensus.cc:2764] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:23.509552 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1940) took 1991 ms. Trace:
I20260709 13:07:23.445441 19464 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.502664 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:23.446048 19600 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:23.501049 19497 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.360s	user 0.040s	sys 0.048s
I20260709 13:07:23.496476 19501 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.545940 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 141023us
I20260709 13:07:23.500339 19400 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.506027 19509 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.446277 19588 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.559914 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.589324 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.575917 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:23.541496 16617 rpcz_store.cc:276] 0709 13:07:21.511063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.511169 (+   106us) service_pool.cc:224] Handling call
0709 13:07:21.548413 (+ 37244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.342871 (+1794458us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5400102320. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37474dc0 00007ffa374ff1c0 00007ffa37500231 00007ffa374fcd8f 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c
0709 13:07:23.502070 (+159199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.502304 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34825984}
W20260709 13:07:23.601970 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.506866 19516 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.510533 19603 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
W20260709 13:07:23.555994 19597 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:07:23.573908 19497 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.437s	user 0.040s	sys 0.053s
I20260709 13:07:23.506842 19590 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.171s
I20260709 13:07:23.508565 19596 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:23.509244 19152 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:07:23.553423 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 76598.4us
I20260709 13:07:23.596243 19431 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:23.591398 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:23.701380 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 198762us
I20260709 13:07:23.684423 19516 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:23.703785 17125 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:23.685392 19600 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.706122 19615 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:23.706465 19601 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260709 13:07:23.710721 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 134899us
I20260709 13:07:23.714632 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:23.698051 19504 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:23.725853 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.597462 19501 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.739244 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 147899us
I20260709 13:07:23.707895 19540 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:23.741433 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.706492 19606 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:23.727367 19602 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:07:23.751238 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:23.754482 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:23.753620 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.740137 19504 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.748240 19420 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.737869 19434 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:23.750406 19606 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.752988 19507 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:23.758759 19590 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.777494 19507 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:23.779771 19608 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.747740 19543 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:07:23.777915 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.752116 19556 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:23.727630 19615 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:23.756000 19595 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.777431 19606 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.749791 19570 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:23.777012 19431 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:23.774027 19420 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:23.800455 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:23.735708 19600 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.789386 19434 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.788760 19507 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:23.816982 16537 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:23.816233 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 418) took 2337 ms (client timeout 1862 ms). Trace:
I20260709 13:07:23.845045 19611 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.797502 19590 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:23.765810 19504 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.801199 19464 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.860297 19501 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.861718 16544 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:23.872431 19572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.017s	sys 0.034s
I20260709 13:07:23.780535 19620 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
W20260709 13:07:23.886541 19572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.017s	sys 0.034s
I20260709 13:07:23.886767 19636 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:23.794811 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:23.887351 19636 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.758994 19540 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.886565 16544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 1999) took 1968 ms (client timeout 1608 ms). Trace:
W20260709 13:07:23.888727 16544 rpcz_store.cc:269] 0709 13:07:21.917676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.984959 (+ 67283us) service_pool.cc:224] Handling call
0709 13:07:23.800285 (+1815326us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800003398. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:07:23.886459 (+ 86174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740480}
I20260709 13:07:23.862632 19420 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:23.872041 16540 rpcz_store.cc:269] 0709 13:07:21.478495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.493803 (+ 15308us) service_pool.cc:224] Handling call
0709 13:07:23.815778 (+2321975us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002b5a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:23.816137 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471344512}
I20260709 13:07:23.870447 19543 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.893642 19543 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:23.893854 19540 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.894140 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.894467 19543 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.896576 19613 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:07:23.897017 19543 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.895068 16461 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:23.916544 19336 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.872457 19434 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:23.915840 19590 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.917078 19637 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:23.890853 19611 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:23.921191 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126648us
I20260709 13:07:23.796406 19608 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:23.953694 16466 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.891462 19464 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:23.891191 19588 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:23.963449 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:23.963289 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.959551 19434 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.972561 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.918660 19406 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:07:23.978089 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 224534us
I20260709 13:07:23.975936 16461 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:23.993024 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:23.969000 19637 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:24.001976 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:24.011377 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:24.011555 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:23.989322 19646 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:07:24.027210 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 272792us
I20260709 13:07:24.027226 16466 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:24.030544 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:23.989748 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 231467us
I20260709 13:07:24.032097 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:24.079510 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:24.080525 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.024852 19614 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:07:24.000272 19519 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:24.018208 19617 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:07:24.085332 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83437.4us
I20260709 13:07:24.091984 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:23.991255 19621 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:24.096661 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69552.8us
I20260709 13:07:24.099151 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:24.087220 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.105108 16544 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:24.033344 19464 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.106266 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.110845 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.111438 16465 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:24.107645 16540 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:24.109613 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:24.089936 19519 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:24.100359 19621 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:24.116367 19647 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.135810 19647 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.136137 19647 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:24.138085 19437 consensus_meta.cc:287] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.698s	user 0.009s	sys 0.000s
I20260709 13:07:24.138513 19437 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.095431 19644 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:24.139714 19644 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:24.123310 19636 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.123513 19600 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.141667 19608 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.091321 19646 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:24.169550 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.158211 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:24.172750 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.130074 19361 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.056s	user 0.009s	sys 0.003s
W20260709 13:07:24.130015 19638 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
W20260709 13:07:24.129488 19033 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.540s	user 0.014s	sys 0.000s
W20260709 13:07:24.128918 19649 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:07:24.129515 19622 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:07:24.176424 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.157833 16467 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:24.236305 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59942.3us
I20260709 13:07:24.237676 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.238708 19464 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.239246 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:24.165802 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.237974 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:24.129310 19623 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:07:24.167289 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:24.167490 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.181371 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:24.134737 19401 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.030s	user 0.010s	sys 0.000s
I20260709 13:07:24.133611 19605 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.175437 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 356981us
I20260709 13:07:24.239832 19464 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.129196 19640 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.124959 19615 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.242571 16464 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:24.166069 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.242528 16467 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:24.113745 19336 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:07:24.110276 19588 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:07:24.245383 16465 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:24.260360 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:24.261261 19562 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.025s	user 0.011s	sys 0.000s
I20260709 13:07:24.261431 19657 raft_consensus.cc:2764] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:24.130649 19648 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:07:24.130163 19643 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.265035 19646 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.274019 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.274335 19606 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:24.275205 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.275924 16470 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:24.277988 19611 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.278254 16540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:24.118975 19637 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.279029 16540 raft_consensus.cc:606] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:24.280164 19592 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 1.476s	user 0.000s	sys 0.020s
I20260709 13:07:24.280973 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:24.281589 17119 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:24.283299 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:24.283869 17121 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
I20260709 13:07:24.284353 18945 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.125082 19651 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.134534 19621 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.247531 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 155649us
I20260709 13:07:24.287330 19606 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:24.276577 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.290069 16470 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:24.291020 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.140545 19437 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.140573 19644 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.252592 19434 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.292820 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.293215 16466 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:24.134070 19519 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.228935 19504 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:24.256109 19509 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.661s	user 0.010s	sys 0.000s
I20260709 13:07:24.298070 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.298697 16470 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 3.
I20260709 13:07:24.233237 19361 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.243650 19033 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.163244 19647 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.195909 19507 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.252583 19516 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.335384 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:24.365123 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 273188us
I20260709 13:07:24.346007 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 540) took 2178 ms. Trace:
I20260709 13:07:24.292271 19401 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.365888 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:24.290632 19636 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:24.373728 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.366870 17120 rpcz_store.cc:276] 0709 13:07:22.167973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.168078 (+   105us) service_pool.cc:224] Handling call
0709 13:07:22.189673 (+ 21595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:22.199136 (+  9463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.199166 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:22.199641 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.361006 (+161365us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:22.361055 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.361133 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.279495 (+1918362us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:24.297914 (+ 18419us) raft_consensus.cc:1685] finished
0709 13:07:24.297932 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.345946 (+ 48014us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5047,"raft.queue_time_us":5208,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":20885,"spinlock_wait_cycles":157154688,"thread_start_us":74807,"threads_started":1,"wal-append.queue_time_us":356717}
I20260709 13:07:24.386461 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:24.386889 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 89607.1us
I20260709 13:07:24.387112 16470 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.376978 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.387668 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:24.388307 16464 raft_consensus.cc:2410] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:24.394407 16541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92aeb38730a646668d4f528d66afd917"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:24.395154 16541 raft_consensus.cc:606] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:24.411806 17127 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:24.416852 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.418041 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.418658 16464 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:24.341939 19336 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.335167 19361 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.419747 16463 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:24.331187 19509 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:24.421669 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.364220 19608 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.362049 19562 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.373046 18945 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.294588 19420 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.418037 19647 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:24.336869 19434 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.393850 19401 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.589818 19516 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.590293 19401 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:24.590586 16470 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:24.446105 19608 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.591843 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.593267 19608 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.593839 19653 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:24.595221 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.341666 19588 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:07:24.409039 19431 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.418553 19645 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.187s
I20260709 13:07:24.596856 19431 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.450606 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.598351 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:24.598699 16464 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.599048 16545 raft_consensus.cc:606] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:24.599397 16545 raft_consensus.cc:614] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:24.431128 16467 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
W20260709 13:07:24.585842 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 219999us
I20260709 13:07:24.602421 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:24.585355 19543 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.002s
I20260709 13:07:24.603791 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:24.595003 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.438644 19507 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:24.421963 19658 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.628979 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.629951 19658 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:24.631629 19628 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.782s	user 0.001s	sys 0.001s
I20260709 13:07:24.631312 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.632194 16470 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:24.632344 19658 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:24.633384 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1994) took 2784 ms. Trace:
I20260709 13:07:24.633435 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:24.437167 19540 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.633882 16542 rpcz_store.cc:276] 0709 13:07:21.853475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.912277 (+ 58802us) service_pool.cc:224] Handling call
0709 13:07:21.912578 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.959693 (+ 47115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.633137 (+2673444us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54002062d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:24.633309 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28008704}
I20260709 13:07:24.634721 19540 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.635317 19639 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.635860 19639 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.636672 16470 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.630300 19556 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.597242 19431 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.638537 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.657732 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:24.652472 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1960) took 1188 ms. Trace:
I20260709 13:07:24.653571 17122 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:24.659699 17122 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:24.655303 19653 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:24.463063 16583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 2.001s (SENT) [suppressed 34 similar messages]
W20260709 13:07:24.663686 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 68758.4us
I20260709 13:07:24.658934 16618 rpcz_store.cc:276] 0709 13:07:23.464322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.464527 (+   205us) service_pool.cc:224] Handling call
0709 13:07:23.502794 (+ 38267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.503201 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.503243 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.503818 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.696911 (+193093us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:23.698473 (+  1562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.698686 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.631012 (+932326us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:24.636952 (+  5940us) raft_consensus.cc:1685] finished
0709 13:07:24.636974 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.652390 (+ 15416us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90327,"raft.queue_time_us":36471,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":46789,"spinlock_wait_cycles":14381952,"thread_start_us":107040,"threads_started":1,"wal-append.queue_time_us":211808}
I20260709 13:07:24.659471 16470 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:24.666815 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:24.667498 16470 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:24.660375 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:24.689424 16467 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:24.703023 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 99294.9us
I20260709 13:07:24.703373 16470 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 8. Ops: []
I20260709 13:07:24.704608 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.708989 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.422660 19336 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:24.609788 18945 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.713129 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.718712 16464 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:07:24.720312 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 465409us
I20260709 13:07:24.721379 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.722481 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.714782 17122 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.723918 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:24.724261 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.703830 19647 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:24.688403 19653 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:24.706638 19608 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:24.720204 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 308914us
I20260709 13:07:24.443202 19541 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:24.425333 19033 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:24.727033 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:24.737583 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:24.656754 19556 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:24.739681 19654 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.734270 19646 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.740589 17122 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.741447 19643 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:24.742908 19627 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.962s	user 0.000s	sys 0.001s
I20260709 13:07:24.738572 19608 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:24.753289 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.754818 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1944) took 2895 ms. Trace:
W20260709 13:07:24.807512 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80568.1us
I20260709 13:07:24.807924 16611 rpcz_store.cc:276] 0709 13:07:21.859219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.869893 (+ 10674us) service_pool.cc:224] Handling call
0709 13:07:21.894605 (+ 24712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.257778 (+1363173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.754547 (+1496769us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000a00d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:24.754751 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133160832}
I20260709 13:07:24.722235 18945 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.736734 19648 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:24.442340 19519 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.443420 19562 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:24.804129 17122 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:24.729278 19657 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.729068 19516 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:24.722421 19637 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:24.736936 19653 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.809813 19608 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.809247 19658 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:24.794152 19654 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.828645 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:24.833928 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 96402.3us
W20260709 13:07:24.824476 19535 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:07:24.836961 19564 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 2.688s	user 0.014s	sys 0.016s
I20260709 13:07:24.837452 19400 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:24.815253 19648 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.815609 19541 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.825199 19637 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.829357 19646 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:24.914891 19637 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:24.850164 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:24.851879 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 388814us
I20260709 13:07:24.850736 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:24.851750 19654 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.857236 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:24.866195 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:24.925420 16538 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.925577 16545 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.866827 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:24.926595 16536 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:24.867376 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:24.927955 16542 raft_consensus.cc:2393] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:24.869024 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:24.929080 16544 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:24.869707 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:24.930323 16543 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:24.937366 19624 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.024s	user 0.006s	sys 0.006s
I20260709 13:07:24.938839 16539 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 5: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:24.938946 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1959) took 1535 ms. Trace:
I20260709 13:07:24.922089 16540 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:24.820525 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 96717.9us
I20260709 13:07:24.870395 19400 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.833246 19516 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:24.939656 16619 rpcz_store.cc:276] 0709 13:07:23.403228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.403522 (+   294us) service_pool.cc:224] Handling call
0709 13:07:23.403875 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.405761 (+  1886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.405792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.416923 (+ 11131us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.595445 (+178522us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:23.595486 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.595549 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.839395 (+1243846us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:24.938542 (+ 99147us) raft_consensus.cc:1685] finished
0709 13:07:24.938590 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.938877 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":2034,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5591,"spinlock_wait_cycles":13677952,"thread_start_us":149559,"threads_started":1,"wal-append.queue_time_us":334229}
I20260709 13:07:24.871964 19648 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:24.815364 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 629) took 3100 ms. Trace:
I20260709 13:07:25.105907 17122 rpcz_store.cc:276] 0709 13:07:21.715317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.715559 (+   242us) service_pool.cc:224] Handling call
0709 13:07:21.715844 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.653463 (+2937619us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54006859a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37474dc0 00007ffa374ff1c0 00007ffa37500231 00007ffa374fcd8f 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c
0709 13:07:24.815002 (+161539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.815290 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625075456}
I20260709 13:07:25.115502 16543 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:24.814615 19336 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:25.170109 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.186575 19361 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.197501 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.198107 16536 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.207820 16538 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:25.216586 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:25.223750 16545 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:25.213574 19361 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.237353 19361 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.237124 19516 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.240840 19646 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.249472 19556 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.259840 16536 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:25.276152 16467 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:25.275915 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.278694 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.279474 16536 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.283651 16467 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:25.272374 19606 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.296798 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.297411 16540 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.262312 19643 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:07:25.309160 18945 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.301843 19527 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:25.354853 16536 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:25.310393 19562 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:25.310166 19519 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:25.313053 19401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.007s
W20260709 13:07:25.345141 19674 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:25.297477 19606 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:25.365751 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 144472us
W20260709 13:07:25.355995 19605 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.103s	user 0.011s	sys 0.000s
I20260709 13:07:25.351984 19527 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:25.373597 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:25.352509 19660 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.018s
I20260709 13:07:25.396534 16536 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:25.384349 19401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.009s	sys 0.007s
W20260709 13:07:25.369331 19521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.706s	user 0.009s	sys 0.027s
W20260709 13:07:25.397145 19621 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.111s	user 0.011s	sys 0.000s
W20260709 13:07:25.399866 19660 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.001s	sys 0.018s
I20260709 13:07:25.398815 19605 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:25.404948 19521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.742s	user 0.009s	sys 0.027s
I20260709 13:07:25.403936 19519 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:25.464373 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.465229 16619 raft_consensus.cc:2368] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 9.
I20260709 13:07:25.467566 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:25.418081 19621 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.478379 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:25.480549 16467 raft_consensus.cc:2376] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 5. Re-sending same reply.
I20260709 13:07:25.443728 19605 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.498749 16467 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:25.500344 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.501199 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:25.501150 16611 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:25.501786 17122 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.502562 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:25.499802 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 274996us
I20260709 13:07:25.505199 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.506805 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.509414 16468 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:25.473472 18945 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:25.510685 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:25.544860 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:25.592089 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:25.592341 16536 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:25.462976 19688 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:07:25.519033 17122 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:25.544762 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.524241 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:25.658900 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 94890.3us
W20260709 13:07:25.657388 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.583837 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.582692 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.659307 16619 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:25.660341 16612 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.442595 19527 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.656817 16611 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:25.527027 16467 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:25.659904 17093 connection.cc:256] RPC call timeout handler was delayed by -1.7797085070000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:07:25.661880 17093 connection.cc:256] RPC call timeout handler was delayed by -1.6159085069999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:07:25.583506 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:25.662469 17093 connection.cc:256] RPC call timeout handler was delayed by -1.6159085069999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:07:25.663683 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:25.466771 19521 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.500679 19667 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:07:25.582085 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.671307 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:25.584440 19678 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:07:25.672194 16619 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:07:25.501428 19660 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.679983 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:25.544866 19679 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:07:25.547693 19677 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:07:25.680912 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:25.681409 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 157760us
I20260709 13:07:25.685127 16467 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:25.658604 19570 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:25.584897 19675 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:07:25.681391 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:25.547047 19682 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:07:25.683651 19556 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.681447 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 97013.6us
I20260709 13:07:25.585347 19648 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.740437 19556 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:25.740978 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.690876 19570 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.740973 19556 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.742177 19648 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:25.742708 19653 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.890s	user 0.010s	sys 0.000s
I20260709 13:07:25.592813 19460 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.742920 19570 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.693413 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.743611 16611 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:25.744310 19654 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 13:07:25.670329 19535 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:25.744784 19654 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.745074 19535 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.746026 16614 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.719086 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:25.674413 19696 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:25.688789 18945 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.473454 19643 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.208s
I20260709 13:07:25.726387 16540 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:25.727627 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:25.728474 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.678758 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:25.750082 16610 raft_consensus.cc:2410] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:07:25.730726 19684 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260709 13:07:25.734499 19676 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:07:25.737396 19557 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:25.674494 19521 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:25.589262 19608 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.000s
I20260709 13:07:25.765084 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:25.765709 16470 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:25.765508 19608 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.766426 19521 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:25.766579 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:25.767817 19608 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:25.767880 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.504125 19605 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.768594 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:25.769037 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:25.771802 16616 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.744642 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.772065 16612 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:25.747457 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.674592 19681 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:07:25.750010 16541 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 3.
W20260709 13:07:25.727679 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 46363us
I20260709 13:07:25.775040 16615 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.750686 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:25.776070 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.776540 16540 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:25.761732 16467 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.784452 19570 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:25.785657 19662 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.361s	user 0.008s	sys 0.000s
I20260709 13:07:25.786027 19535 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:25.787660 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:25.788372 16467 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:25.773380 16545 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:25.810770 19689 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:25.814328 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:25.814993 16470 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.816658 16616 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:25.817765 19605 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:25.822799 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.823638 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.743214 19653 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.821991 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 591) took 1014 ms. Trace:
I20260709 13:07:25.824905 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:25.718609 19665 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.105s
W20260709 13:07:25.817109 19400 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.001s
I20260709 13:07:25.778172 19562 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:25.770903 19606 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:25.830464 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54610.4us
I20260709 13:07:25.683605 19697 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:07:25.826706 17123 rpcz_store.cc:276] 0709 13:07:24.807660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.807774 (+   114us) service_pool.cc:224] Handling call
0709 13:07:24.808100 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.808409 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.808434 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.808891 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.301358 (+492467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:25.301397 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.302023 (+   626us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.821796 (+519773us) raft_consensus.cc:1685] finished
0709 13:07:25.821815 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.821935 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7874,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4937,"thread_start_us":465739,"threads_started":1,"wal-append.queue_time_us":543189}
I20260709 13:07:25.836452 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:25.761621 18945 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.838263 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:25.842049 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 72314.2us
I20260709 13:07:25.837822 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.820915 19682 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:25.845898 16618 raft_consensus.cc:2368] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:25.847927 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:25.848968 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:25.849471 16536 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.850091 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:25.850999 16545 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:07:25.842819 19400 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.853446 19400 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:25.853715 19535 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.854244 19535 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.854683 19535 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.855962 18945 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.856986 19621 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:25.857010 16468 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:07:25.857118 19431 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.151s	user 0.008s	sys 0.005s
I20260709 13:07:25.858306 19431 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.858918 19653 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:25.857710 19654 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:25.862550 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:25.863300 16463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1701) took 1721 ms (client timeout 1505 ms). Trace:
I20260709 13:07:25.833551 19521 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.863898 16463 rpcz_store.cc:269] 0709 13:07:24.141561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.142675 (+  1114us) service_pool.cc:224] Handling call
0709 13:07:25.863057 (+1720382us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54002a8ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:25.863215 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552292608}
I20260709 13:07:25.867908 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.868161 16462 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:25.842995 19562 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.868247 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.870160 17122 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:25.829007 19605 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:25.848137 19401 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:25.876030 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.877751 16612 raft_consensus.cc:2368] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 8.
I20260709 13:07:25.879105 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.892035 16536 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:25.910653 16610 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:25.912149 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.913337 16463 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.916322 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.868083 19521 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.878314 19371 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:25.918793 16611 raft_consensus.cc:2368] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:25.872488 19562 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:25.929315 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.933480 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.937544 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:25.919629 19521 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.940117 16463 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:25.941318 16611 raft_consensus.cc:2368] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
W20260709 13:07:25.927790 19625 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 2.137s	user 0.001s	sys 0.008s
I20260709 13:07:25.945468 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:25.949540 16612 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:25.949697 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.951874 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:25.953545 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.954689 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:25.957283 16466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1700) took 1816 ms (client timeout 2031 ms). Trace:
W20260709 13:07:25.957722 16466 rpcz_store.cc:269] 0709 13:07:24.141280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.142598 (+  1318us) service_pool.cc:224] Handling call
0709 13:07:25.957056 (+1814458us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b5400355cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:25.957190 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84260736}
I20260709 13:07:25.958192 19401 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.958925 19401 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.965050 19431 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:25.957727 16462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1691) took 2196 ms (client timeout 2161 ms). Trace:
I20260709 13:07:25.950541 16610 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:25.971448 16470 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:25.973266 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:25.966084 16462 rpcz_store.cc:269] 0709 13:07:23.761315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.761568 (+   253us) service_pool.cc:224] Handling call
0709 13:07:25.957490 (+2195922us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400378a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:25.957619 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4776771968}
I20260709 13:07:25.945477 19693 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.980127 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:25.924093 19371 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:25.925272 19556 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:25.991284 17125 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.979830 19588 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:25.992921 19588 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:25.994195 19588 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.002539 16612 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:26.010021 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.011199 16612 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.011335 16610 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:26.013602 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.014317 16611 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:26.017681 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.019769 16611 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.018810 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.019991 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.021450 17125 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:26.021553 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.028738 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.029829 16610 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:26.033843 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.041661 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.042632 16543 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:26.043727 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.045300 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.046101 16543 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.048044 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.053148 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.054684 19703 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:26.055645 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.056449 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.058053 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.031402 19431 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.029352 19660 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.060520 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.061661 19685 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.065389 16467 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.062541 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.066100 17126 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:26.066268 16540 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.996377 19693 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.068461 19693 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.053897 19556 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.065064 19431 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.069410 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.069988 16542 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
W20260709 13:07:26.070570 19637 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.149s	user 0.011s	sys 0.000s
I20260709 13:07:26.070633 19431 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.070839 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.071476 16542 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.062196 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.073257 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.074087 16610 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:26.072325 19535 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.074873 19639 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.075995 19535 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.077414 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.077941 16544 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.078251 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.078920 17122 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:26.079712 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.077941 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.064055 19570 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.071115 19637 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.081123 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.242460 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.243464 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.113776 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.083750 19401 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:26.239615 19656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.753s	user 0.010s	sys 0.006s
I20260709 13:07:26.115159 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:26.082634 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1641514719999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:07:26.089675 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.245095 19637 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:26.124276 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.247427 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:26.250152 16462 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.250293 16463 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:26.248535 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1641514719999577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 13:07:26.251276 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1623514719999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:07:26.251693 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1623514719999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:07:26.252053 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1407514720000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:07:26.252450 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1326514720000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:07:26.164012 19562 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.083197 16543 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:26.254021 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1326514720000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
I20260709 13:07:26.254832 16612 raft_consensus.cc:2368] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:26.255349 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.255849 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.113127 17121 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.256908 19562 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.211512 16542 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:26.257732 19712 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:26.258002 19639 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.152622 16619 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:26.258699 19434 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:26.258548 19639 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.267135 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.134908 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.088755 16540 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:26.084088 16611 raft_consensus.cc:2410] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:26.133100 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.132807 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.272891 16583 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:26.276513 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:26.254827 16511 connection.cc:256] RPC call timeout handler was delayed by -1.1209514720000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:07:26.249226 17119 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:26.277063 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.278003 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.241652 19477 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.266871 19712 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:26.278589 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.266167 19562 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.279541 19712 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.280063 19562 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.280546 19703 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:26.281033 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.281698 16540 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.282197 19562 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.259704 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.282877 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:26.246702 19656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.815s	user 0.011s	sys 0.006s
I20260709 13:07:26.268510 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.111410 16544 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:26.284116 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.284735 16619 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:26.284744 16542 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:26.273540 16470 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:26.275444 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.240816 19572 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:26.288079 17120 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:26.298275 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:26.288661 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0741514720000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:07:26.298981 16544 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:07:26.299104 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0345514719999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 13:07:26.246150 19570 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.300369 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.106021 19665 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:26.277141 16543 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.319371 16511 leader_election.cc:400] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 9.
I20260709 13:07:26.324805 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.329388 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.328730 16540 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:26.332870 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.334218 16611 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:26.284015 19477 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:26.336755 16540 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:26.249475 19521 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.297614 19535 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.340155 16540 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.297887 19572 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:26.313207 19570 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.351087 16611 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.269299 19616 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:26.345280 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.320256 19401 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.321009 19562 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.352584 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.288228 19637 raft_consensus.cc:2764] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:07:26.270311 19434 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.354470 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.363095 16610 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:26.356514 16470 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
W20260709 13:07:26.360478 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57802.1us
I20260709 13:07:26.364357 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:26.371004 16540 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:26.371390 16540 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:26.368378 16543 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:26.347460 19535 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.379288 16543 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:26.378544 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 95952.8us
I20260709 13:07:26.380306 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:26.382323 16470 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.385037 16543 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:26.361539 19401 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.332134 19665 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.380108 19535 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.399658 19401 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.385572 19431 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.384707 19477 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.433071 16540 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.500046 16543 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:07:26.504231 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 139955us
I20260709 13:07:26.504417 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.505363 16617 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.508490 16543 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:26.477051 19520 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.002s	sys 0.008s
I20260709 13:07:26.512387 16540 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.521318 16511 leader_election.cc:400] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:26.529945 19477 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:26.526074 19520 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.002s	sys 0.009s
I20260709 13:07:26.541704 16611 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:26.542495 19713 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:07:26.542800 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.442494 19572 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.545351 19572 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:26.501075 19616 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:26.549829 19616 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.551810 19616 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.554675 16541 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:26.555148 19521 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:26.555334 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2011) took 1045 ms. Trace:
I20260709 13:07:26.555660 16541 rpcz_store.cc:276] 0709 13:07:25.509736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.554122 (+1044386us) service_pool.cc:224] Handling call
0709 13:07:26.554457 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.555093 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.555282 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:26.510522 19641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.084s	user 0.003s	sys 0.027s
W20260709 13:07:26.557538 19641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.133s	user 0.003s	sys 0.027s
I20260709 13:07:26.557773 19665 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:26.559010 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 291838us
I20260709 13:07:26.559710 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:26.562582 16582 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:26.571084 19703 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:26.573370 17120 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.575549 19686 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.576115 19686 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.576399 19535 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.577018 19686 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:26.577894 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.581240 19718 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.598222 19718 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:26.598484 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.583747 19703 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:26.599303 17118 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:26.599956 19718 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.601266 19718 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.584961 19535 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.586334 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:26.566910 19521 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.566947 16540 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:07:26.611263 16540 pending_rounds.cc:85] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 4
I20260709 13:07:26.611526 16540 pending_rounds.cc:107] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:26.611788 16540 raft_consensus.cc:2889] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:26.611716 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.592723 19420 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:26.593010 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.613116 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.613919 19654 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.614056 19703 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:26.614331 19654 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.614537 19703 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:26.594465 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:26.614934 19703 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.615188 19654 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.615805 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.616184 19654 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.617170 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.617993 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:26.565183 16463 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.583775 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:26.597122 19656 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:26.619829 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:26.620081 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 267549us
I20260709 13:07:26.625064 16545 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:26.626386 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.626997 16540 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.632112 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:26.634388 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:26.635869 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.636909 17125 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:26.638039 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:26.618520 19690 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.630615 19521 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.662199 19521 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.663134 19521 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.665942 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:26.666750 16467 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.668839 19637 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:26.668985 19540 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:26.639029 19721 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.669404 19637 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.669842 19721 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:26.643467 19673 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.711s	user 0.001s	sys 0.004s
I20260709 13:07:26.670239 19637 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.671713 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1771) took 2252 ms. Trace:
I20260709 13:07:26.673116 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:26.672046 16464 rpcz_store.cc:276] 0709 13:07:24.419236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.719727 (+300491us) service_pool.cc:224] Handling call
0709 13:07:24.735415 (+ 15688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.741062 (+  5647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.741090 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.741570 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.795730 (+ 54160us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:24.796247 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.796638 (+   391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.642556 (+1845918us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:26.671415 (+ 28859us) raft_consensus.cc:1685] finished
0709 13:07:26.671435 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.671651 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3421,"raft.queue_time_us":6462,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":75,"spinlock_wait_cycles":163388288,"thread_start_us":49928,"threads_started":1,"wal-append.queue_time_us":102923}
I20260709 13:07:26.649634 19533 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:26.674396 19533 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:26.674772 19533 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:26.675040 19527 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.676113 16467 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:26.651230 19460 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.677116 19460 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.677495 19460 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.652743 19498 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:26.623924 19477 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.652681 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.681592 16545 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.683327 16465 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:26.683815 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 581) took 4267 ms. Trace:
I20260709 13:07:26.684165 17127 rpcz_store.cc:276] 0709 13:07:22.416231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.416350 (+   119us) service_pool.cc:224] Handling call
0709 13:07:22.416619 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.412355 (+1995736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.683564 (+2271209us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400641ed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:26.683731 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4587764992}
I20260709 13:07:26.660305 19336 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.641981 19616 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.685609 19616 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.685786 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 1996) took 4811 ms. Trace:
I20260709 13:07:26.686228 16537 rpcz_store.cc:276] 0709 13:07:21.873944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.299807 (+425863us) service_pool.cc:224] Handling call
0709 13:07:23.816733 (+1516926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:23.871715 (+ 54982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.685560 (+2813845us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002b5a50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:26.685699 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486031616}
I20260709 13:07:26.686543 19616 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.687640 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.688299 16537 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:26.623739 19420 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:26.680976 19716 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:07:26.618672 19719 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:26.688174 19570 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:26.692951 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.693310 16465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1710) took 2462 ms (client timeout 1924 ms). Trace:
W20260709 13:07:26.730531 16465 rpcz_store.cc:269] 0709 13:07:24.231204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.260036 (+ 28832us) service_pool.cc:224] Handling call
0709 13:07:26.684741 (+2424705us) spinlock_profiling.cc:243] Waited 2.42 s on lock 0x7b54002a8fd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:26.693242 (+  8501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5569975168}
I20260709 13:07:26.732494 16545 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:26.695163 16540 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:26.672252 19721 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.689563 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.619549 19643 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:26.707957 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70033.5us
I20260709 13:07:26.702056 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.728642 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:26.746477 16465 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:26.748256 19718 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:26.749262 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:26.750842 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 110985us
I20260709 13:07:26.752761 19584 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:26.753315 19584 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.754205 19584 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.754503 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:26.756735 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.756094 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.758625 19719 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.758893 16537 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:26.760627 16537 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:26.761503 19535 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.762959 19665 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:26.756979 19598 raft_consensus.cc:2764] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:26.770751 19570 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.761552 16511 leader_election.cc:400] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 8.
I20260709 13:07:26.782050 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.782779 16540 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.680992 19498 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.789445 19692 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:07:26.792801 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:26.792919 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:26.775933 19371 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.793589 16545 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:26.796295 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.797680 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:26.733270 19724 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:26.806315 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:26.806495 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.648687 19401 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.787798 19507 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.825325 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.826856 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.828111 19460 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.829087 19703 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.830291 19460 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:26.822564 19562 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:07:26.831410 16462 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:26.831735 19431 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.832142 19431 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:26.832525 19431 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.832343 19498 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:26.832980 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.833585 19498 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.835044 17127 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 11. Ops: []
I20260709 13:07:26.836757 19401 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:26.822129 19572 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:26.838864 19562 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.839228 19562 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.840744 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.841107 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.772864 19599 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:26.822115 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.822744 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.842121 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:26.792691 19721 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:26.788347 19598 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:26.854486 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:26.857470 16617 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:26.841661 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.840023 19562 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.844944 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.812855 19692 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:26.821080 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59966.2us
I20260709 13:07:26.860704 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:26.870194 16545 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.822255 19535 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.860458 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.805142 19420 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:26.871186 16611 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.860962 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.807176 19647 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.873193 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:26.854435 19570 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:26.831735 19703 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:26.889066 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47011.9us
I20260709 13:07:26.893051 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.889887 16540 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:26.868728 19641 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.868937 19556 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.903033 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.844306 19507 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.860302 19728 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.884439 16619 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:26.933501 16545 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
W20260709 13:07:26.934224 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64637.8us
I20260709 13:07:26.935276 16511 leader_election.cc:400] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:26.935649 16511 leader_election.cc:403] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.939551 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:26.891494 19692 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:26.888259 19570 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:26.908136 19562 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:26.953030 19600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.081s	user 0.014s	sys 0.048s
I20260709 13:07:26.937187 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.943605 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:26.901680 19665 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:26.904703 19641 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.904276 19595 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:26.971515 16539 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:26.894867 19647 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:26.978015 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.981894 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2012) took 1471 ms. Trace:
W20260709 13:07:26.952848 19541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.697s	user 0.025s	sys 0.034s
I20260709 13:07:26.986735 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:26.950711 19728 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:26.964744 19600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.116s	user 0.014s	sys 0.048s
W20260709 13:07:26.992712 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57616.2us
I20260709 13:07:26.958052 19570 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:26.993855 16511 leader_election.cc:400] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:26.994284 16511 leader_election.cc:403] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.938627 19535 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:26.982590 16539 rpcz_store.cc:276] 0709 13:07:25.509961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.941976 (+1432015us) service_pool.cc:224] Handling call
0709 13:07:26.967306 (+ 25330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.981564 (+ 14258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.981824 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.997149 19507 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.997769 19639 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:26.984609 19665 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:26.973872 19703 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.970924 19718 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:26.974979 19641 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.975478 19401 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:27.008255 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:26.986084 19541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.733s	user 0.025s	sys 0.034s
W20260709 13:07:27.025575 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.995478 19722 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.027065 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:27.014446 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:27.018631 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.030954 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.031668 16617 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:27.035259 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.028381 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.012729 16611 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
W20260709 13:07:27.019917 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 401951us
I20260709 13:07:27.041953 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:27.043370 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.046933 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:27.048381 16470 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.050230 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:27.050175 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.051029 16461 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.046088 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:27.051249 16617 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:27.052472 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:27.049746 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:27.018700 19540 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:27.057785 16464 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.059715 16617 raft_consensus.cc:1217] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Deduplicated request from leader. Original: 5.4->[6.5-8.6]   Dedup: 6.5->[8.6-8.6]
I20260709 13:07:27.060411 16617 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:07:27.063488 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.063946 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:27.029273 19541 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:27.031730 19401 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:27.033591 19595 raft_consensus.cc:2764] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:27.034314 19639 raft_consensus.cc:2764] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:07:27.080451 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:27.019439 19703 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:27.078399 16465 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:27.049623 19507 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.054975 19477 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.049746 19371 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:27.090025 19431 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.056779 19722 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:27.062467 19538 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:27.071385 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.080313 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:27.064865 19464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.830s	user 0.019s	sys 0.008s
I20260709 13:07:27.086943 19686 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.088048 19533 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.051235 19724 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:27.080361 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:27.056031 19420 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:27.093068 17124 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:27.095983 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:27.125535 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 45248.8us
I20260709 13:07:27.125945 16467 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.105835 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:27.094050 16463 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.074084 19636 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.112733 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:27.130913 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:27.094208 19642 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.123041 19371 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.078504 19643 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:07:27.082020 19588 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:07:27.114475 19477 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:27.111594 19538 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:27.134629 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:27.124866 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 215809us
I20260709 13:07:27.072466 19665 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.143464 16467 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:27.121788 19464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.876s	user 0.019s	sys 0.009s
I20260709 13:07:27.145695 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:27.032413 19692 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.120697 19647 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:27.092046 19431 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:27.138955 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 328348us
I20260709 13:07:27.145083 19371 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.164435 16465 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:27.136965 19657 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.132467 19637 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:27.167089 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:27.135625 19460 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:27.197697 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 258227us
I20260709 13:07:27.093441 19722 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.161401 19538 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.214105 16465 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:27.134847 19420 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:27.219501 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 149268us
W20260709 13:07:27.209633 19731 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:07:27.208449 19371 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:27.221576 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 144692us
I20260709 13:07:27.166363 19737 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.208338 19636 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.214099 19725 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:07:27.316901 19556 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:27.362349 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.208426 19598 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.152s
W20260709 13:07:27.381839 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 85784.2us
I20260709 13:07:27.125371 19728 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.219010 19657 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:27.386539 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:27.382669 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 216617us
W20260709 13:07:27.389802 16511 leader_election.cc:336] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.735s (SENT)
I20260709 13:07:27.395879 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:27.157447 19541 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:27.357167 19737 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.165880 19401 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.212570 19730 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.177s
I20260709 13:07:27.454859 19657 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:27.459525 19736 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:27.369330 19636 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:27.460937 19747 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:07:27.461853 19738 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:27.462111 19406 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.462236 19636 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:27.462739 19406 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:27.370275 19477 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.463634 19406 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:27.468274 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 99793.5us
W20260709 13:07:27.439154 19527 consensus_meta.cc:287] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.764s	user 0.013s	sys 0.000s
I20260709 13:07:27.474867 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 647) took 1340 ms. Trace:
W20260709 13:07:27.475793 16511 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.764s (SENT)
I20260709 13:07:27.476279 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:27.421617 19644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.033s	sys 0.034s
I20260709 13:07:27.475419 17122 rpcz_store.cc:276] 0709 13:07:26.134295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.247037 (+112742us) service_pool.cc:224] Handling call
0709 13:07:26.589907 (+342870us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b5800003c98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:07:26.590088 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.628731 (+ 38643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.628787 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.629219 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.026273 (+397054us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:27.026325 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.026415 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.465739 (+439324us) raft_consensus.cc:1685] finished
0709 13:07:27.465763 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.474786 (+  9023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29071,"raft.queue_time_us":38309,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5217,"spinlock_wait_cycles":2816896,"thread_start_us":281601,"threads_started":1,"wal-append.queue_time_us":518479}
W20260709 13:07:27.479878 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 61702.1us
I20260709 13:07:27.480026 19570 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.481070 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:27.482360 19739 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:27.433593 19595 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:27.427583 19737 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:27.486235 16616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 468) took 1904 ms (client timeout 1515 ms). Trace:
W20260709 13:07:27.486765 16616 rpcz_store.cc:269] 0709 13:07:25.582232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.582476 (+   244us) service_pool.cc:224] Handling call
0709 13:07:27.486014 (+1903538us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003af554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:27.486144 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255542016}
I20260709 13:07:27.488041 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1786) took 1723 ms. Trace:
I20260709 13:07:27.491902 16613 raft_consensus.cc:2410] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:07:27.488411 16469 rpcz_store.cc:276] 0709 13:07:25.764264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.863028 (+ 98764us) service_pool.cc:224] Handling call
0709 13:07:26.693630 (+830602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.693807 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.693829 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:26.693865 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:26.693897 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.693945 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.487891 (+793946us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54002a8fd0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:27.487987 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879067904}
I20260709 13:07:27.359108 19724 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.498144 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 450) took 1523 ms. Trace:
I20260709 13:07:27.498528 16542 rpcz_store.cc:276] 0709 13:07:25.974405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.285935 (+311530us) service_pool.cc:224] Handling call
0709 13:07:26.286287 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.324272 (+ 37985us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.324318 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.344991 (+ 20673us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.620394 (+275403us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.620433 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.620494 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.497945 (+877451us) raft_consensus.cc:1685] finished
0709 13:07:27.497965 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.498084 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":265889,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":281955,"threads_started":2,"wal-append.queue_time_us":517638}
I20260709 13:07:27.501329 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:27.490520 19732 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:07:27.499627 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 81731.1us
I20260709 13:07:27.507609 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:27.508375 16616 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.509622 19595 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.510690 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 470) took 1927 ms. Trace:
W20260709 13:07:27.486361 19644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.034s	sys 0.038s
I20260709 13:07:27.467546 19431 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:27.511056 16614 rpcz_store.cc:276] 0709 13:07:25.582887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.583019 (+   132us) service_pool.cc:224] Handling call
0709 13:07:25.583399 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.746423 (+163024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.510396 (+1763973us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540025e254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:27.510621 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373548928}
W20260709 13:07:27.500113 19710 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.247s	user 0.001s	sys 0.005s
I20260709 13:07:27.519104 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 365) took 1271 ms. Trace:
I20260709 13:07:27.432875 19745 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:07:27.527657 16462 rpcz_store.cc:276] 0709 13:07:26.248021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.265993 (+ 17972us) service_pool.cc:224] Handling call
0709 13:07:27.518902 (+1252909us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400263c54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:27.519032 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269744384}
W20260709 13:07:27.529572 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.536006 16616 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:27.537307 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:27.538928 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:27.540024 16540 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:27.540817 16537 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:27.498987 19520 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.559367 16461 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.002s
I20260709 13:07:27.559986 16461 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:27.542058 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:27.598140 16537 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:27.606487 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:27.607146 16542 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:27.610452 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 81158.8us
W20260709 13:07:27.598448 19498 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.764s	user 0.005s	sys 0.007s
I20260709 13:07:27.615396 16612 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:27.506590 19703 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:27.495381 19639 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:27.623881 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:27.530620 19742 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.625358 16545 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.627086 19743 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:07:27.627553 19746 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:27.627128 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:27.637172 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.598893 19570 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:27.626003 19431 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:27.651806 17126 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.628196 19742 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:27.639649 19639 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:27.669112 16618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1711) took 2183 ms (client timeout 1764 ms). Trace:
W20260709 13:07:27.669514 16618 rpcz_store.cc:269] 0709 13:07:25.470549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.492402 (+ 21853us) service_pool.cc:224] Handling call
0709 13:07:27.653359 (+2160957us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54003dac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:27.653500 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777879296}
I20260709 13:07:27.655982 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:27.660921 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1794) took 1836 ms. Trace:
I20260709 13:07:27.511814 19556 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:27.656086 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.670469 16466 rpcz_store.cc:276] 0709 13:07:25.824356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.959519 (+135163us) service_pool.cc:224] Handling call
0709 13:07:25.959803 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.960105 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.960133 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.966648 (+  6515us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.259848 (+293200us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:26.259913 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.260013 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.375896 (+1115883us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:27.650926 (+275030us) raft_consensus.cc:1685] finished
0709 13:07:27.650955 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.660852 (+  9897us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1533,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":20531584,"thread_start_us":79785,"threads_started":1,"wal-append.queue_time_us":262642}
I20260709 13:07:27.666625 16545 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:27.674332 16470 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.680353 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:27.642259 19743 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:27.605809 19520 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.666872 19742 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:27.696178 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 210144us
I20260709 13:07:27.689669 19758 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:07:27.642704 19533 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:27.647636 19431 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:27.656738 19762 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:27.689512 19757 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:07:27.700338 17122 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.711397 19757 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.711810 19757 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:27.701957 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.667145 19639 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:27.704182 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:27.705451 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:27.708515 19753 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.680016 19657 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.701941 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:27.718981 16466 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:07:27.719223 16545 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:27.696072 19477 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:27.706380 19643 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.721117 19533 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.741720 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:27.712522 19703 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:27.718032 19762 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.754191 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:27.702884 19761 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:27.712589 19757 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.760591 19757 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:27.742231 19754 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:07:27.763062 19750 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:27.763648 19371 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.789674 16612 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:27.790263 19371 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:27.791090 19641 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.000s
I20260709 13:07:27.768095 19572 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:27.737416 19752 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.778333 19760 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:27.781193 19639 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.728600 19657 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.784638 19538 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.785068 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:27.811179 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 335371us
I20260709 13:07:27.761415 19507 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:27.787640 19434 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:27.793505 19420 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:27.793967 19572 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:27.795557 19767 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:27.791476 19641 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.758780 19758 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:27.796000 19752 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.738785 19477 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.815886 19371 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:27.826622 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.830605 16545 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:27.838531 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 349635us
I20260709 13:07:27.729979 19743 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.741470 19643 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:27.817713 19507 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.747411 19431 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.835867 19639 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:27.733614 19753 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.860961 16511 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:27.840677 19337 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.863504 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.868345 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1965) took 1068 ms. Trace:
I20260709 13:07:27.840956 19758 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:27.849597 19371 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.868882 16619 rpcz_store.cc:276] 0709 13:07:26.800259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.979374 (+179115us) service_pool.cc:224] Handling call
0709 13:07:26.979754 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.980368 (+   614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.023646 (+ 43278us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.024257 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.379539 (+355282us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:27.379964 (+   425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.380965 (+  1001us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.868086 (+487121us) raft_consensus.cc:1685] finished
0709 13:07:27.868107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.868275 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5868,"thread_start_us":293980,"threads_started":1,"wal-append.queue_time_us":597302}
I20260709 13:07:27.870118 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:27.844065 19760 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:27.875821 17122 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:27.881786 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 469) took 2299 ms. Trace:
I20260709 13:07:27.883170 16615 rpcz_store.cc:276] 0709 13:07:25.582586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.582855 (+   269us) service_pool.cc:224] Handling call
0709 13:07:25.583129 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.779159 (+196030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.881548 (+2102389us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000d66d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:27.881729 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429883648}
I20260709 13:07:27.857519 19507 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.881260 19336 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:27.825333 19572 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:27.868266 19743 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.881134 19758 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:27.850432 19588 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:07:27.917987 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:27.865032 19703 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:27.887452 19431 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.922873 19753 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:27.888727 19336 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:27.931418 16613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1710) took 2461 ms (client timeout 1735 ms). Trace:
W20260709 13:07:27.941586 16613 rpcz_store.cc:269] 0709 13:07:25.470224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.470342 (+   118us) service_pool.cc:224] Handling call
0709 13:07:27.931225 (+2460883us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:27.931349 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4566721920}
I20260709 13:07:27.867722 19337 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:07:27.957273 17090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.028s	sys 0.066s
I20260709 13:07:27.919369 19654 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:27.902076 19769 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:27.960997 16617 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:27.959340 19620 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:27.966615 19620 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:27.957687 17090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.029s	sys 0.066s
W20260709 13:07:27.969060 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:27.958245 19562 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.986s	user 0.012s	sys 0.000s
I20260709 13:07:27.913101 19595 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:07:27.961414 19642 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
W20260709 13:07:28.034670 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.959957 19654 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:27.945665 19665 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:27.973665 19588 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.044209 16611 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:28.059703 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 141791us
I20260709 13:07:27.911144 19742 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.036077 19642 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.075278 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:28.077433 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.044905 19595 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.079489 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:28.083698 16465 raft_consensus.cc:2376] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5. Re-sending same reply.
I20260709 13:07:28.069453 19768 raft_consensus.cc:2764] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:28.042583 19626 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:07:28.067613 19703 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.086730 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.086972 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.098295 16466 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:28.087527 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.086758 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:28.077299 19763 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:28.091070 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.102329 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:28.102687 16464 raft_consensus.cc:2410] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:28.093703 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1784) took 2332 ms. Trace:
I20260709 13:07:27.972954 19760 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:28.103854 16468 rpcz_store.cc:276] 0709 13:07:25.761027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.762027 (+  1000us) service_pool.cc:224] Handling call
0709 13:07:25.767195 (+  5168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.857785 (+ 90590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.093408 (+2235623us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b54002a80d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:28.093631 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205695360}
I20260709 13:07:28.104552 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1982) took 1215 ms. Trace:
I20260709 13:07:28.101078 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.082980 19477 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:27.967357 19620 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:28.106146 16469 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:28.058470 19588 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.082067 19595 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:28.038029 19336 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.152021 16465 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:28.108597 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.135434 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.156662 16466 raft_consensus.cc:2368] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:28.157899 16613 raft_consensus.cc:2410] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:28.109371 19643 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:28.158715 19371 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.099826 19773 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:28.090026 19538 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.099949 19556 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:28.161062 16619 rpcz_store.cc:276] 0709 13:07:26.888886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.884231 (+995345us) service_pool.cc:224] Handling call
0709 13:07:27.884537 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.884805 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:28.006188 (+121383us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.104091 (+ 97903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.104198 (+   107us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.104267 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.104347 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.104488 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200644,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":124,"spinlock_wait_cycles":59877248,"thread_start_us":202814,"threads_started":2}
I20260709 13:07:28.162118 19556 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.106026 19753 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.165576 19753 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:28.159282 19588 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.144367 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:28.139101 19775 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:07:28.142525 19777 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:07:28.151093 19774 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:07:28.155393 19737 consensus_meta.cc:287] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.008s
I20260709 13:07:28.151046 19337 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:28.160678 19773 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:28.168588 19595 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.102962 19703 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:28.191016 19776 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:28.195114 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1979) took 1342 ms. Trace:
I20260709 13:07:28.199541 16614 rpcz_store.cc:276] 0709 13:07:26.853030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.691509 (+838479us) service_pool.cc:224] Handling call
0709 13:07:27.707714 (+ 16205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.719634 (+ 11920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.719677 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.720240 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.931245 (+211005us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:27.931301 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.931394 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.194905 (+263511us) raft_consensus.cc:1685] finished
0709 13:07:28.194925 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.195058 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2824,"raft.queue_time_us":19809,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":15146,"thread_start_us":187806,"threads_started":1,"wal-append.queue_time_us":350068}
I20260709 13:07:28.195335 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1800) took 1149 ms. Trace:
I20260709 13:07:28.180192 19336 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.182094 19620 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.201608 16463 rpcz_store.cc:276] 0709 13:07:27.045989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.047882 (+  1893us) service_pool.cc:224] Handling call
0709 13:07:27.073887 (+ 26005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.127099 (+ 53212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.195097 (+1067998us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:28.195270 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45947648}
W20260709 13:07:28.221606 19772 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:07:28.228926 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.195828 19665 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:28.271307 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1981) took 1396 ms. Trace:
I20260709 13:07:28.195708 19737 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:28.272078 19757 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.005s
I20260709 13:07:28.304492 16461 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:28.267093 19753 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:28.318193 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 596) took 1617 ms. Trace:
I20260709 13:07:28.318809 17127 rpcz_store.cc:276] 0709 13:07:26.701060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.702451 (+  1391us) service_pool.cc:224] Handling call
0709 13:07:26.702824 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.835436 (+132612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.317851 (+1482415us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400578ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:28.318096 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303635328}
I20260709 13:07:28.237087 19665 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.326738 19785 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.331241 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.20464e+06us
I20260709 13:07:28.336342 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:28.340070 19787 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:28.347127 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:28.327368 19785 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.362075 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.337045 19646 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:28.364682 19646 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.346980 19438 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.355055 19753 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:28.386821 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.387657 16613 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.392202 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 451) took 2417 ms. Trace:
I20260709 13:07:28.437240 16465 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:28.389629 19723 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:28.439791 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:28.440663 16466 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.441260 16469 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:07:28.449208 16468 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:07:28.440620 19780 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:28.410180 19690 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:28.398669 19753 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:28.413782 19371 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:28.438854 19704 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.463260 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:28.470036 16469 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:28.528812 19793 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:07:28.504721 19704 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.566852 16613 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:28.568152 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.583999 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.584945 16613 raft_consensus.cc:2376] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 10. Re-sending same reply.
I20260709 13:07:28.469357 19371 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:28.599598 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.600489 16613 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.600893 19753 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:28.582226 19737 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:28.609706 16613 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:28.583650 19785 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.585346 19646 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.604991 19665 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:28.605355 19788 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:07:28.632889 16466 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:28.629063 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.631210 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 464) took 2063 ms. Trace:
I20260709 13:07:28.634342 16543 rpcz_store.cc:276] 0709 13:07:26.567937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.568172 (+   235us) service_pool.cc:224] Handling call
0709 13:07:26.568407 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.568564 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:28.233253 (+1664689us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.627149 (+393896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.630870 (+  3721us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.630935 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.631018 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.631147 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1654778,"prepare.queue_time_us":1700346,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":3503,"thread_start_us":392515,"threads_started":1}
I20260709 13:07:28.639580 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:28.630300 19431 consensus_meta.cc:287] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.003s
I20260709 13:07:28.641016 16615 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:28.635325 19719 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:28.641937 16466 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:28.656152 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:28.643622 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 463) took 2076 ms. Trace:
I20260709 13:07:28.658252 16543 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:28.641984 19791 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:07:28.665599 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.666579 16613 raft_consensus.cc:2368] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:28.667538 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.668190 16613 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:28.672268 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.638890 19718 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.664687 19719 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:28.712236 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:28.719069 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.724020 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.726003 16613 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:28.728339 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:28.729630 19753 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:28.730239 19753 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.730747 19753 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:28.731334 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.683782 19665 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:28.742575 19599 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:28.755939 19801 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:28.760008 16469 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:28.762550 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2029) took 1087 ms. Trace:
I20260709 13:07:28.798046 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:28.797334 16545 rpcz_store.cc:276] 0709 13:07:27.675645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.845993 (+170348us) service_pool.cc:224] Handling call
0709 13:07:27.846342 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.846582 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:28.657041 (+810459us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.762186 (+105145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.762251 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.762308 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.762376 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.762491 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":367039,"prepare.queue_time_us":387557,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6622,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":539478,"threads_started":2}
I20260709 13:07:28.764320 16466 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:28.761296 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:28.799165 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:28.840859 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2019) took 3099 ms. Trace:
I20260709 13:07:28.959797 16545 raft_consensus.cc:606] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:28.960405 16545 raft_consensus.cc:614] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:28.803439 16543 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:28.960093 16536 rpcz_store.cc:276] 0709 13:07:25.741158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.893215 (+152057us) service_pool.cc:224] Handling call
0709 13:07:25.934226 (+ 41011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.949296 (+ 15070us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:28.138794 (+2189498us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.396894 (+258100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.409137 (+ 12243us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.409353 (+   216us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.409406 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.409503 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.840628 (+431125us) raft_consensus.cc:1685] finished
0709 13:07:28.840647 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.840801 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2131842,"prepare.queue_time_us":2167253,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":12721,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"spinlock_wait_cycles":4117760,"thread_start_us":217856,"threads_started":1,"wal-append.queue_time_us":428651}
I20260709 13:07:28.962536 16543 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:28.823348 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:28.769356 19704 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:28.982843 16466 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:28.863372 19799 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:28.754652 19719 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:28.991217 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 558) took 2682 ms. Trace:
I20260709 13:07:28.992242 17126 rpcz_store.cc:276] 0709 13:07:26.309237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.309362 (+   125us) service_pool.cc:224] Handling call
0709 13:07:26.309709 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.652404 (+1342695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.991012 (+1338608us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54006e0ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:28.991162 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085845376}
W20260709 13:07:28.864410 19803 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:07:28.853413 19797 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:07:28.873488 19802 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:28.781818 19371 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:28.964921 16613 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:28.977051 19620 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.005s
I20260709 13:07:28.942862 19718 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.796253 19665 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.178673 17126 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:29.087239 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2030) took 1387 ms. Trace:
I20260709 13:07:29.382458 16469 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:29.169584 16616 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:29.316392 16468 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:29.391155 16616 pending_rounds.cc:85] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 8
I20260709 13:07:29.315095 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:29.138046 16461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1723) took 1434 ms (client timeout 1566 ms). Trace:
I20260709 13:07:28.658574 16541 rpcz_store.cc:276] 0709 13:07:26.567656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.567789 (+   133us) service_pool.cc:224] Handling call
0709 13:07:26.568178 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.568358 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:28.171314 (+1602956us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.643141 (+471827us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.643222 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.643304 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.643393 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.643552 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1643984,"prepare.queue_time_us":1606844,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7464,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6695,"thread_start_us":464331,"threads_started":1}
I20260709 13:07:28.393225 16544 rpcz_store.cc:276] 0709 13:07:25.974648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.299715 (+325067us) service_pool.cc:224] Handling call
0709 13:07:26.299965 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.300166 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:28.151890 (+1851724us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.388721 (+236831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.388802 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.388867 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.391977 (+  3110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.392128 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1842671,"prepare.queue_time_us":1851589,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":120,"spinlock_wait_cycles":21888,"thread_start_us":236446,"threads_started":1}
I20260709 13:07:29.311221 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:29.028829 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:29.004005 16536 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.141963 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1575) took 4292 ms. Trace:
I20260709 13:07:29.160423 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1971) took 2358 ms. Trace:
I20260709 13:07:29.395666 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 474) took 1424 ms. Trace:
I20260709 13:07:29.395831 16617 rpcz_store.cc:276] 0709 13:07:26.801498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.061314 (+259816us) service_pool.cc:224] Handling call
0709 13:07:27.653494 (+592180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.968828 (+315334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.159143 (+1190315us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54003dac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.160185 (+  1042us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54003dac50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:29.160345 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067608192}
I20260709 13:07:29.396174 16536 rpcz_store.cc:276] 0709 13:07:27.971098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.962182 (+991084us) service_pool.cc:224] Handling call
0709 13:07:29.002833 (+ 40651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.395446 (+392613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.395615 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:29.331174 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.397672 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.325402 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:29.164252 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 1986) took 2160 ms. Trace:
I20260709 13:07:29.391268 16542 rpcz_store.cc:276] 0709 13:07:27.700152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.905928 (+205776us) service_pool.cc:224] Handling call
0709 13:07:27.906274 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.334676 (+428402us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:28.360366 (+ 25690us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.959841 (+599475us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.960138 (+   297us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.960197 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:28.960248 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.086911 (+126663us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54002b5554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.086973 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.087149 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102139,"prepare.queue_time_us":138606,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":1820,"raft.queue_time_us":261,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":33482,"spinlock_wait_cycles":984587136,"thread_start_us":496601,"threads_started":1,"wal-append.queue_time_us":1024595}
I20260709 13:07:29.398789 16611 rpcz_store.cc:276] 0709 13:07:27.004316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.046815 (+ 42499us) service_pool.cc:224] Handling call
0709 13:07:29.164055 (+2117240us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b5400234bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:29.164183 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151561600}
W20260709 13:07:29.393250 16461 rpcz_store.cc:269] 0709 13:07:27.703862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.703956 (+    94us) service_pool.cc:224] Handling call
0709 13:07:29.137797 (+1433841us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54003566d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:29.137967 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347485952}
W20260709 13:07:29.166600 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.179628 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.391556 16616 pending_rounds.cc:107] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 13:07:29.306123 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.401623 16616 raft_consensus.cc:2889] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.122506 16619 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:29.402920 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1987) took 1011 ms. Trace:
I20260709 13:07:29.409356 16616 rpcz_store.cc:276] 0709 13:07:28.391122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.168839 (+777717us) service_pool.cc:224] Handling call
0709 13:07:29.169152 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.402529 (+233377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.402849 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.403249 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 486) took 1071 ms. Trace:
I20260709 13:07:29.169094 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1984) took 2230 ms. Trace:
W20260709 13:07:29.405237 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 94129us
I20260709 13:07:29.411687 16615 rpcz_store.cc:276] 0709 13:07:26.938273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.884510 (+946237us) service_pool.cc:224] Handling call
0709 13:07:27.888710 (+  4200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.652754 (+764044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.168797 (+516043us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540001e5d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.169026 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729402112}
I20260709 13:07:29.179193 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.194280 16614 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.417495 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1990) took 1016 ms. Trace:
I20260709 13:07:29.418037 16614 rpcz_store.cc:276] 0709 13:07:28.401578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.193622 (+792044us) service_pool.cc:224] Handling call
0709 13:07:29.194061 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.417181 (+223120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.417424 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:29.302561 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:29.411458 16619 rpcz_store.cc:276] 0709 13:07:28.332064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.121922 (+789858us) service_pool.cc:224] Handling call
0709 13:07:29.122288 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.402951 (+280663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.403183 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:29.388399 19814 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:07:29.427906 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 102599us
W20260709 13:07:29.149353 19811 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.229s	user 0.004s	sys 0.000s
W20260709 13:07:29.102641 19639 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.234s	user 0.013s	sys 0.000s
W20260709 13:07:29.102002 19336 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.887s	user 0.008s	sys 0.004s
W20260709 13:07:29.082870 19507 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.186s	user 0.014s	sys 0.000s
I20260709 13:07:29.175016 19538 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.097467 19641 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.187309 19762 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:29.430557 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 128070us
I20260709 13:07:29.466663 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:29.091288 19758 consensus_meta.cc:287] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.151s	user 0.012s	sys 0.000s
I20260709 13:07:29.395448 16538 rpcz_store.cc:276] 0709 13:07:24.849737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.208605 (+358868us) service_pool.cc:224] Handling call
0709 13:07:25.209055 (+   450us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:25.400402 (+191347us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:25.480548 (+ 80146us) log.cc:844] Serialized 14 byte log entry
0709 13:07:25.834510 (+353962us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:25.863631 (+ 29121us) log.cc:844] Serialized 78 byte log entry
0709 13:07:25.863794 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.095439 (+2231645us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18003da7a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa3aef53c7 00007ffa375079a7 00007ffa375170bf 00007ffa37517038
0709 13:07:28.100515 (+  5076us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.239614 (+139099us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.264664 (+ 25050us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.279196 (+ 14532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.101344 (+822148us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003da7a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:29.138590 (+ 37246us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b18003da7a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:29.140544 (+  1954us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b18003da7a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419
0709 13:07:29.141556 (+  1012us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54002904d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.141614 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.141686 (+    72us) raft_consensus.cc:1685] finished
0709 13:07:29.141704 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.141893 (+   189us) inbound_call.cc:177] Queueing success response
0709 13:07:29.174718 (+ 32825us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b480021e058. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
Metrics: {"mutex_wait_us":78811,"prepare.queue_time_us":3338321,"prepare.run_cpu_time_us":171,"prepare.run_wall_time_us":3901,"raft.queue_time_us":33566,"raft.run_cpu_time_us":13913,"raft.run_wall_time_us":929810,"spinlock_wait_cycles":111368704,"thread_start_us":554760,"threads_started":4,"wal-append.queue_time_us":676800,"wal-append.run_cpu_time_us":2824,"wal-append.run_wall_time_us":1098797}
I20260709 13:07:29.419790 19464 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.003961 19719 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.440454 19748 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:29.306303 19557 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.156s
I20260709 13:07:29.442282 19769 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.457695 19806 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.443313 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:29.192273 19361 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.172842 19572 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.134416 19520 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:29.116392 19654 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.143392 19527 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.364192 19584 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.369441 19431 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.471995 19639 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.101823 19735 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.329146 19534 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:29.440672 19498 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.462705 16469 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:28.952052 19753 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.429334 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:29.524276 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 95117.3us
W20260709 13:07:29.524636 16585 connection.cc:256] RPC call timeout handler was delayed by -1.0189190270000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 13:07:29.525279 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:29.304592 19556 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.117865 19742 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.120946 19657 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.501752 19371 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:07:29.495007 19748 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.501802 19361 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.539106 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1603) took 2000 ms. Trace:
W20260709 13:07:29.091039 19743 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.191s	user 0.006s	sys 0.006s
I20260709 13:07:29.472483 16463 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:29.407944 19540 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:29.473029 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:29.427757 19737 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.431867 19477 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.791450 19599 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:29.037782 19595 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.819s	user 0.008s	sys 0.004s
I20260709 13:07:29.465596 19336 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.497195 16610 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:29.322887 19401 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:07:29.504372 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:29.170809 19809 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
I20260709 13:07:29.510360 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:29.128155 19723 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:29.512814 16618 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.465759 19507 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.470417 19538 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.502955 19690 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:29.492592 19464 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.525692 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:29.531247 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.427129 19620 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:29.512197 19527 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:29.512315 19806 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:29.573467 19703 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.521759 19654 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:29.549913 19805 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:29.533263 19534 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.521955 19735 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:29.528554 19761 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.575423 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.528144 19520 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.533404 19641 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:29.641530 19641 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.641989 19641 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.642827 19538 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.533954 19557 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.532369 19598 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:29.565800 19371 consensus_queue.cc:1243] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:29.614485 17126 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:29.521957 19584 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.573822 19639 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:29.529343 19498 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.474762 19758 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.521122 19431 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.567417 19744 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.637928 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:29.600345 19690 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:29.640043 19810 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:29.638451 19599 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.639684 19761 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.598953 19723 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.640753 19520 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.688133 19520 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.567906 19477 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.691414 19735 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.615144 19620 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.615437 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.598322 19740 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.637341 19507 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.652530 19401 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:29.653163 19742 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:29.700984 19620 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:29.716003 19815 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:29.702225 19752 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.637421 19361 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.645692 19616 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:29.563213 19540 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.637523 19534 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.597862 19595 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:29.745599 19812 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.431s	user 0.005s	sys 0.000s
I20260709 13:07:29.744973 19620 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.747206 19595 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.593971 19336 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.747861 19620 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.650274 19656 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.678910 19762 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:29.749950 19762 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:29.751209 19762 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.658859 19557 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:29.753738 19557 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.755630 19721 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.756016 19721 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:29.756208 19723 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.685640 19773 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.756819 19721 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.757413 19773 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:29.757822 19824 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:07:29.758065 19721 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.686303 19761 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.684862 19599 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:29.762313 19477 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.670871 19665 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.655643 19598 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.730262 19753 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.725073 17118 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:29.704872 19740 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.678228 19744 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.732918 19748 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:29.674585 19527 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.772629 19527 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:29.773159 19740 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.774370 19431 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.773214 19498 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.775120 19744 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.775486 19598 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.704437 19806 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.776681 19584 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:29.745275 19540 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.749722 19656 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.781762 19656 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.653537 19464 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.690646 19758 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:29.803316 19641 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.808002 19641 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.810302 17125 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:29.810828 17125 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:29.564954 19737 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.821370 19737 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.835973 19690 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.842649 19690 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:29.420706 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.875727 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:29.877708 16463 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:29.873194 16461 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:29.883499 16463 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:29.885639 16466 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:29.499027 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1805) took 2430 ms. Trace:
I20260709 13:07:29.886814 16470 rpcz_store.cc:276] 0709 13:07:27.068833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.069085 (+   252us) service_pool.cc:224] Handling call
0709 13:07:27.093955 (+ 24870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.674917 (+580962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.498723 (+1823806us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003575d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.498952 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334143360}
I20260709 13:07:29.889478 16467 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
W20260709 13:07:29.892449 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.898401 16470 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:29.893754 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.898825 16470 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:29.893898 16465 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:07:29.899560 16461 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:29.900787 16465 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:29.896744 16466 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:29.939363 16611 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:29.901100 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.941125 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.942507 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:29.946240 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:29.947291 16616 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.949542 16538 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:29.673758 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:29.951016 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:29.951606 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:29.952152 16613 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:07:29.952323 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 278513us
I20260709 13:07:29.952695 16538 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:29.904111 16468 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:29.955003 16611 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:29.956686 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:29.957681 16538 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:29.961355 16544 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:29.963500 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1972) took 3161 ms. Trace:
I20260709 13:07:29.944428 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:29.545109 16540 rpcz_store.cc:276] 0709 13:07:27.538652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.598523 (+ 59871us) service_pool.cc:224] Handling call
0709 13:07:27.598845 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.611971 (+ 13126us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:28.630351 (+1018380us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.770367 (+140016us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.770906 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.771105 (+   199us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:28.965838 (+194733us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.966467 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.966562 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.538831 (+572269us) raft_consensus.cc:1685] finished
0709 13:07:29.538861 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.539032 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":599818,"prepare.queue_time_us":805069,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":1253,"raft.queue_time_us":16566,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":32695,"thread_start_us":536555,"threads_started":2,"wal-append.queue_time_us":832214}
I20260709 13:07:29.966203 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:29.966981 19464 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.967562 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:29.967850 19464 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.811798 17125 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.970346 19336 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.971107 19336 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:29.971400 19464 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.971916 17125 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.972519 19464 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.563850 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 90858.7us
I20260709 13:07:29.925875 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:29.973479 19464 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:29.974874 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:29.926185 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1727) took 1851 ms (client timeout 1518 ms). Trace:
I20260709 13:07:29.977540 16511 leader_election.cc:400] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:29.936861 16617 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:29.976948 19464 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:29.979426 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1996) took 1573 ms. Trace:
I20260709 13:07:29.979902 16617 rpcz_store.cc:276] 0709 13:07:28.405901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.397508 (+991607us) service_pool.cc:224] Handling call
0709 13:07:29.397829 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.978277 (+580448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.979104 (+   827us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540036bd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.979333 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237286144}
I20260709 13:07:28.272105 16612 rpcz_store.cc:276] 0709 13:07:26.875269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.790760 (+915491us) service_pool.cc:224] Handling call
0709 13:07:27.791064 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.791305 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:28.036541 (+245236us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.270802 (+234261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.270879 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:28.270948 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.271044 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.271225 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4462,"prepare.queue_time_us":279218,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":3855,"thread_start_us":474553,"threads_started":2}
I20260709 13:07:29.963979 16618 rpcz_store.cc:276] 0709 13:07:26.801711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.670203 (+868492us) service_pool.cc:224] Handling call
0709 13:07:27.695678 (+ 25475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.593623 (+1897945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.962941 (+369318us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000d5cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.963294 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4178467072}
I20260709 13:07:29.981381 19477 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:29.981444 19534 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.982352 19477 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.982641 19534 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:29.930989 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.985489 19477 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.985698 19534 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.986404 19534 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.971819 19336 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.987176 19534 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:29.989037 16611 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:29.989454 19336 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.980945 16511 leader_election.cc:403] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.937224 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 1961) took 3137 ms. Trace:
I20260709 13:07:29.990350 16610 rpcz_store.cc:276] 0709 13:07:26.799119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.803196 (+  4077us) service_pool.cc:224] Handling call
0709 13:07:26.823582 (+ 20386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.570947 (+2747365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.936539 (+365592us) spinlock_profiling.cc:243] Waited 2.67 s on lock 0x7b540033ac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:29.936941 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6143116544}
I20260709 13:07:29.990828 19540 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.991883 19557 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:07:29.976958 16467 rpcz_store.cc:269] 0709 13:07:28.074778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.074952 (+   174us) service_pool.cc:224] Handling call
0709 13:07:29.925827 (+1850875us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400356bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:29.926063 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169000192}
I20260709 13:07:29.908118 16469 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:29.989917 19534 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:29.900347 16470 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:29.995558 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.919894 16539 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:30.015620 19595 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:30.016367 16615 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:30.019567 19595 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.021842 19719 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.025127 19721 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.025575 16616 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:30.028842 19557 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:30.028239 16367 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.030623 19557 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.031374 19758 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.032188 19758 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.031276 16367 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.991972 19540 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:30.035336 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.039062 19534 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:30.041178 16470 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.032435 19152 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.045205 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 68055.4us
I20260709 13:07:30.034086 16367 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 9, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:30.030645 19761 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:30.058588 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.062697 16538 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:30.055691 19719 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:30.070765 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.077761 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.079777 16616 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:30.084862 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:30.085640 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.085857 16540 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.086756 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.087657 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.088186 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.089042 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.090221 16611 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:30.091182 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:30.096275 16435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.003s
W20260709 13:07:30.096866 16435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.010s	sys 0.003s
I20260709 13:07:30.097820 19595 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.099534 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:30.099896 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.100565 16464 raft_consensus.cc:2368] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:30.102413 16537 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:30.104001 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.104974 16541 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:30.106024 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.107115 16615 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:30.076215 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.077930 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.088915 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.079810 19761 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.122212 16610 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:07:30.124833 16539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 475) took 2107 ms (client timeout 1991 ms). Trace:
I20260709 13:07:30.126542 19152 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:30.125358 16539 rpcz_store.cc:269] 0709 13:07:27.971399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.743169 (+771770us) service_pool.cc:224] Handling call
0709 13:07:30.070281 (+1327112us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002b5a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:30.078980 (+  8699us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551704960}
I20260709 13:07:30.130587 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.131330 16539 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:30.131846 19758 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:30.129086 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.124979 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:30.134132 16616 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:30.135651 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.137849 16468 raft_consensus.cc:2368] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
W20260709 13:07:30.138170 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62670.6us
I20260709 13:07:30.128450 16544 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:30.140899 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.142249 19152 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.108467 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.143882 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.143735 19719 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.144835 16542 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:30.146740 16542 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:30.148294 16542 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:07:30.148993 16469 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:30.149168 19572 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.149524 19761 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.150223 19761 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.149873 19572 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.150731 19761 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:30.151079 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.151337 19761 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.152293 16537 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:30.150437 16538 raft_consensus.cc:2410] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:30.154927 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.158571 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.159503 16617 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.159554 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.160395 16536 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:30.160925 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:30.185794 16539 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.185854 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.161180 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.162092 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.188604 16618 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:30.162874 19762 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.163642 19721 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.173521 16541 raft_consensus.cc:2410] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:30.164397 19773 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 13:07:30.174130 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.015s	sys 0.004s
I20260709 13:07:30.174804 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.175765 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:30.176025 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 650205us
I20260709 13:07:30.174150 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:30.178233 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.179072 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.198959 16610 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:30.181106 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.182018 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.182765 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:30.200052 16544 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.201210 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.202098 16616 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:30.203212 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.204074 17124 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:30.205220 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.184968 19540 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.180172 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.206141 16618 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:30.206611 16467 raft_consensus.cc:2368] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:30.207674 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:30.209268 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.015s	sys 0.005s
I20260709 13:07:30.184005 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:30.209775 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 790549us
I20260709 13:07:30.209976 16545 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.213482 16464 raft_consensus.cc:2368] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:30.209149 16461 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:30.205475 16466 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:30.214071 16611 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.214704 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.214931 16611 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:30.215247 16468 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:30.215363 16613 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.216415 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:30.216807 19773 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.217168 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.218334 19823 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.219071 19823 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.218323 16612 raft_consensus.cc:2410] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:30.220366 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.217315 19773 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:30.221014 19822 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.221495 19721 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.221999 19773 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.217289 19152 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:30.208665 16467 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:30.223760 19721 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:30.219609 16614 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:07:30.221181 16543 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:30.201210 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.228371 16367 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 8, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 8 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.220715 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:30.232678 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:30.233253 16541 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.233428 19152 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.234025 17125 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:07:30.234404 17125 pending_rounds.cc:85] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 8
I20260709 13:07:30.234676 17125 pending_rounds.cc:107] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:30.234974 17125 raft_consensus.cc:2889] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:30.236619 19743 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:07:30.237413 19464 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.238078 19464 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.221724 19822 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.239540 16613 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:30.215524 19762 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:30.155982 19572 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.231184 16367 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.242358 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.241408 16536 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:30.242777 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.252007 16539 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:30.253994 16544 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:30.258383 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.258780 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.259069 16613 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.254237 17124 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:30.264305 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.273965 16545 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:30.241812 19762 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:30.244278 19735 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.275401 19762 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.264305 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.277369 16467 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:30.277544 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:30.277840 17122 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:30.279469 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.281533 19762 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.281623 17120 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:07:30.317612 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.281898 16541 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
W20260709 13:07:30.282325 19431 consensus_queue.cc:1175] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:30.283898 19823 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.240706 19464 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.260308 19822 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.320626 16613 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:30.297518 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:30.321645 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.321952 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.328045 16615 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.324493 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:30.329052 16617 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:30.330687 17125 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:30.331761 16540 raft_consensus.cc:2410] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:30.328605 16611 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:30.336105 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 97571.9us
I20260709 13:07:30.337828 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.338790 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.337476 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.341674 16465 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.328227 19719 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:30.347321 16611 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.353307 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.352308 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.359258 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.360000 16614 pending_rounds.cc:85] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 8
I20260709 13:07:30.360360 16614 pending_rounds.cc:107] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:07:30.360620 16614 raft_consensus.cc:2889] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.346691 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.365370 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.371528 16467 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:30.372113 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.377406 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:30.378914 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.387486 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.388046 17125 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:30.391044 17125 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.392661 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.394029 17124 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:30.395990 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.397294 17124 raft_consensus.cc:2410] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:30.400298 16434 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:30.404047 17090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.991s (SENT) [suppressed 35 similar messages]
W20260709 13:07:30.408710 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.410945 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.412678 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.409972 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:30.417140 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.385313 19822 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:30.420423 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.422466 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.432847 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.433595 16540 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
W20260709 13:07:30.437059 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.421104 17120 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:30.435104 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.444125 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:30.448676 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.379384 19719 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.451418 16615 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:30.453995 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.411023 19464 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.385267 19758 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:30.452112 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.455744 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.455858 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.455603 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.456563 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.458848 16468 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:30.459470 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.461854 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:30.463706 16541 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.440215 19823 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:07:30.460147 19822 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.455510 19371 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.472505 16539 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:07:30.477670 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.477779 16540 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:30.480474 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.480561 19598 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:07:30.481879 19721 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:30.479624 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.483886 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.480396 19641 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.484295 16511 connection.cc:256] RPC call timeout handler was delayed by -1.6144834319999291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:07:30.487596 19540 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.487342 19595 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.512749 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:30.513585 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.515769 16541 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:30.517982 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 52963.4us
I20260709 13:07:30.520412 16540 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:30.525297 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.517514 19690 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.528115 19690 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.529520 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.530860 19690 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.531026 19758 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.531517 19758 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.531894 19758 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.532029 19420 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.532573 19420 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.532985 19420 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:30.533340 19838 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:30.539242 16463 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:30.531845 19723 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.547307 19723 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.553819 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1824) took 1033 ms. Trace:
I20260709 13:07:30.554296 16463 rpcz_store.cc:276] 0709 13:07:29.520234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.884294 (+364060us) service_pool.cc:224] Handling call
0709 13:07:29.884714 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.539702 (+654988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.552754 (+ 13052us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003b9554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:30.553750 (+   996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504294272}
I20260709 13:07:30.561192 19832 raft_consensus.cc:3055] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:07:30.561353 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 52466.3us
I20260709 13:07:30.561756 19832 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:30.563087 16434 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:30.562943 19832 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.564056 19735 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:30.484696 19464 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.518860 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:30.478924 19371 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:30.577219 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.579288 16465 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:30.585757 19762 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.590227 19762 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:30.597167 19762 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.521526 19641 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.601161 16469 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.602120 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2002) took 1067 ms. Trace:
I20260709 13:07:30.602264 19641 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.602572 16619 rpcz_store.cc:276] 0709 13:07:29.433193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.582521 (+149328us) service_pool.cc:224] Handling call
0709 13:07:29.582951 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.583236 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:30.134566 (+551330us) log.cc:844] Serialized 14 byte log entry
0709 13:07:30.467123 (+332557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:30.473068 (+  5945us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:30.484643 (+ 11575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.489154 (+  4511us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:30.500628 (+ 11474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15369,"prepare.queue_time_us":543393,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":5070,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":14198,"spinlock_wait_cycles":3997568,"thread_start_us":720913,"threads_started":2,"wal-append.queue_time_us":274738}
I20260709 13:07:30.606388 19773 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.580854 19737 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:30.609115 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 114688us
I20260709 13:07:30.609769 19762 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.610375 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:30.611296 19656 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:30.611662 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.613257 19656 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:30.614329 16463 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.615576 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.617501 16461 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:30.617687 19527 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.618348 19527 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:30.619416 19464 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.617529 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.581786 19832 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:30.626871 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.627712 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.628310 16467 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:30.626941 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.616108 19761 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.629168 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.628969 16463 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:30.628657 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.635300 16470 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:30.636664 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.627736 16464 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:30.630486 16367 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 6, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.636719 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.646150 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:30.566170 19540 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.573958 19595 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.656168 16540 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:30.620826 19656 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:30.625422 19719 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:30.656661 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.659271 16616 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.660027 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:30.662861 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49985.2us
I20260709 13:07:30.648383 19721 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:30.648559 19735 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:30.619411 19527 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:30.670760 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 172120us
W20260709 13:07:30.671432 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.673120 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 269095us
I20260709 13:07:30.674269 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.668731 16469 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:30.678890 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.679638 16540 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:30.681172 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108260us
I20260709 13:07:30.676174 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.645107 19737 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:30.683826 16541 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:07:30.672094 19721 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.678833 19464 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:30.687218 16541 pending_rounds.cc:85] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 2
I20260709 13:07:30.690246 16541 pending_rounds.cc:107] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:07:30.690521 16541 raft_consensus.cc:2889] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.688119 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:30.677320 19641 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.691458 19641 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.691865 19641 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.661432 19656 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.693513 19371 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.689846 19721 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.699203 19535 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.699658 19535 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.699970 19535 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.705930 19540 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.707290 19498 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:30.707410 19748 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:30.677196 19822 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.713793 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:30.714484 17119 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:30.727162 16611 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:30.728456 19464 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.761881 16540 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:30.755474 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:30.766305 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 170195us
I20260709 13:07:30.734776 19762 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.723306 19598 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:07:30.761034 19557 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:30.761952 19464 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.766556 19748 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:30.761431 19758 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:30.800527 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 161805us
I20260709 13:07:30.788880 19464 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.800163 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 124043us
I20260709 13:07:30.788795 19748 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:30.794673 19719 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.792371 19557 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:30.812525 16539 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:30.799686 19761 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.808724 19595 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:30.820180 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 113416us
I20260709 13:07:30.824714 19557 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.825301 16545 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:30.827244 19535 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.828668 17120 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:30.829398 19842 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:07:30.818032 19719 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.839303 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 109568us
W20260709 13:07:30.840315 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.824553 19748 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.846124 19748 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.798121 19420 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.833935 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:30.850703 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.866501 16613 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:30.869490 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:30.872139 16616 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:30.875365 17118 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:30.860610 19721 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.846457 19737 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:07:30.837584 19823 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:30.882073 19758 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.849128 19719 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.882241 19762 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:07:30.906525 16365 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 277) took 36370 ms (client timeout 15000 ms). Trace:
I20260709 13:07:30.884974 19535 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.886782 19641 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.889091 19822 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:30.890537 19737 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:30.910772 19737 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:30.911463 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:30.911830 19737 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:30.913066 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:30.893252 19821 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:07:30.883455 19420 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.886368 19735 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.914659 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:30.915261 19735 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:30.915452 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.886830 16367 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 2 to 4, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:07:30.926645 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.931210 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71699.2us
I20260709 13:07:30.888840 19721 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.936081 16545 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:30.937708 19723 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.938024 19641 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:30.880744 19464 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:30.935873 19737 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.940732 19464 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:30.941469 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.941742 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:30.945325 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:30.945797 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.953164 16616 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.945897 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:30.954456 16614 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:30.955847 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.956564 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.948540 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.969928 16610 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:30.927843 19690 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:31.000784 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.003486 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53794.9us
I20260709 13:07:30.932814 19540 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:30.901180 19823 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.008715 19641 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:31.045217 19641 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.008972 19656 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:31.049204 16511 leader_election.cc:400] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:31.049615 16511 leader_election.cc:403] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.050954 17122 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:31.051285 16367 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 7, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:31.052866 19748 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.055683 19690 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.057130 19723 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.062754 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:31.063472 16537 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:31.064659 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.065609 16538 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:30.950331 19464 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:07:31.066608 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:30.946022 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:31.067412 16538 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:31.068219 19758 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:31.068871 19758 consensus_queue.cc:1243] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:31.069031 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:31.069772 17125 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:31.070112 19758 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:31.071125 19420 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:31.071509 19420 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:31.072489 19420 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.064675 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.078315 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.078927 16537 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:31.079553 19598 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:31.079800 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.080416 16537 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:31.087126 16543 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:31.052912 16367 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 8, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:31.088406 16543 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:31.088505 16367 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 4, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:31.089432 16542 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:31.080562 19850 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.081095 19832 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:31.081604 19527 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:31.069789 19748 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.083001 16545 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:07:31.086205 16536 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:31.068511 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.050971 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:31.093673 16616 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:31.094637 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82075.3us
W20260709 13:07:31.029935 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.946527 19371 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:31.115670 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.110154 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.104130 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:31.117065 19527 consensus_queue.cc:1243] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:31.117848 16538 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:31.130402 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:31.148514 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.157052 19748 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.158500 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:31.157420 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53419.3us
I20260709 13:07:31.164050 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.164840 16538 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:31.155507 16367 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 2 to 4, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:31.169803 16544 raft_consensus.cc:2393] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:31.141311 19595 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.144433 19723 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:31.177132 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 266146us
I20260709 13:07:31.139724 19371 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:31.182237 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.184809 16536 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:31.194101 16436 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:31.208519 19844 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:07:31.207707 16367 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.213973 16367 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 6, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.227242 19641 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:31.231276 19420 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.112360 19850 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.219374 19735 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:31.318042 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.333149 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 282270us
W20260709 13:07:30.907040 16365 rpcz_store.cc:269] 0709 13:06:54.535444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.535706 (+   262us) service_pool.cc:224] Handling call
0709 13:07:30.906199 (+36370493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.886800 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.953174 (+ 66374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.953222 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:07:18.953247 (+    25us) tablet.cc:662] Decoding operations
0709 13:07:18.954022 (+   775us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.954093 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.954131 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:18.954626 (+   495us) tablet.cc:701] Row locks acquired
0709 13:07:18.954651 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:07:18.954845 (+   194us) write_op.cc:270] Start()
0709 13:07:18.954980 (+   135us) write_op.cc:276] Timestamp: P: 1783602438954778 usec, L: 0
0709 13:07:18.955008 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.955855 (+   847us) log.cc:844] Serialized 1701 byte log entry
0709 13:07:20.179357 (+1223502us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:21.105851 (+926494us) op_driver.cc:464] REPLICATION: finished
0709 13:07:21.597375 (+491524us) write_op.cc:301] APPLY: starting
0709 13:07:21.597529 (+   154us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:21.597816 (+   287us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:21.597862 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:21.598698 (+   836us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:21.599058 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:07:21.604688 (+  5630us) write_op.cc:312] APPLY: finished
0709 13:07:21.710377 (+105689us) log.cc:844] Serialized 41 byte log entry
0709 13:07:22.006735 (+296358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.033059 (+ 26324us) write_op.cc:454] Released schema lock
0709 13:07:22.038023 (+  4964us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:22.156942 (+118919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:22.156971 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1931647,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":478049,"apply.run_cpu_time_us":73421,"apply.run_wall_time_us":479190,"num_ops":4,"prepare.queue_time_us":695182,"prepare.run_cpu_time_us":19568,"prepare.run_wall_time_us":1176162,"raft.queue_time_us":703626,"raft.run_cpu_time_us":8795,"raft.run_wall_time_us":353291,"replication_time_us":2082803,"spinlock_wait_cycles":39148928,"thread_start_us":2080195,"threads_started":5,"wal-append.queue_time_us":1460741,"wal-append.run_cpu_time_us":48448,"wal-append.run_wall_time_us":2692221}]]}
W20260709 13:07:31.347142 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.350811 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:31.352969 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 159024us
I20260709 13:07:31.348847 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:31.322755 19540 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:31.361894 19690 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:07:31.238382 19823 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:31.362758 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58629.5us
I20260709 13:07:31.362994 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:31.363525 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:31.357172 16367 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:31.367666 16544 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:31.372116 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.377749 19858 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:07:31.369478 16367 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.372045 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:31.383855 19857 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:31.325347 19527 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:07:31.387264 19822 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.387748 19822 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:31.389037 19719 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:31.389919 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.390192 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.390724 16538 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:31.390913 16542 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:31.391319 19719 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:31.364936 19641 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.392125 16545 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.388638 19822 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.393899 19822 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.395429 19735 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:31.396970 19598 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:31.399091 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.366012 19870 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:31.417501 19859 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:31.418356 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 67724.6us
I20260709 13:07:31.418462 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.419242 16545 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:31.419371 16511 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:07:31.419788 16511 leader_election.cc:403] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.239650 19371 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.426834 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:31.427672 16611 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:31.392478 19641 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:31.429230 19737 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.429863 19737 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:31.431604 16617 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:31.432535 19858 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.433044 19858 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:31.433178 16618 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:31.434525 19735 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:31.435092 19735 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.435181 19737 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.437160 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.437381 19735 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:31.437860 16466 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:31.434000 19858 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:31.438591 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.438843 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84248.7us
I20260709 13:07:31.464123 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.467170 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.467824 16542 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.468700 16545 raft_consensus.cc:2393] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:31.470537 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.474375 16470 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:31.474895 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.475709 16538 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:31.474402 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.477079 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:31.475564 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:31.477795 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.478444 16536 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:31.478965 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:31.479584 17125 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.486114 17090 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:31.486688 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:31.489249 16468 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:31.476862 19540 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
W20260709 13:07:31.492072 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.493808 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.476558 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.498888 16540 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:31.500619 16538 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.485896 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.434065 19859 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:31.491065 16545 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:31.502125 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.506772 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.509460 16539 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:31.510699 16544 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:31.504890 16537 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:31.479351 19832 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.507969 19595 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.525592 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:31.532665 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 113453us
I20260709 13:07:31.513213 19572 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:31.429293 19641 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.531577 16468 pending_rounds.cc:85] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:07:31.515645 19821 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:31.518333 19858 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.555094 17125 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:31.569468 19867 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.549156 16468 pending_rounds.cc:107] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:31.587015 16468 raft_consensus.cc:2889] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.587286 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:31.547539 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:31.553519 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.555462 19656 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:31.528865 19832 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:31.557391 19860 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.226s	user 0.005s	sys 0.000s
I20260709 13:07:31.562381 19859 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.568629 19868 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:31.568879 19735 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.569448 19850 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:31.513091 19721 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:31.578647 16542 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:31.584589 16469 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:31.589545 16536 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:31.590545 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:31.547384 16538 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:31.596865 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:31.602190 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.604152 16543 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.605846 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.625797 16545 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:31.605243 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 73287.9us
I20260709 13:07:31.610981 19868 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.612534 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.629520 16469 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:31.629869 16544 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:31.613055 19735 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.626456 19464 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:31.548446 19595 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.600975 19737 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:31.649459 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59017.7us
I20260709 13:07:31.633179 19870 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:31.630640 19527 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:31.664637 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.666353 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.666930 16537 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:31.667204 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:31.669117 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.672219 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:31.601459 19821 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.604638 19867 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.688877 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.690828 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.693814 16537 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:31.633705 19598 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:07:31.691639 16511 leader_election.cc:400] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:31.694531 16511 leader_election.cc:403] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.691388 16469 pending_rounds.cc:85] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 2
I20260709 13:07:31.696177 16469 pending_rounds.cc:107] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:07:31.696461 16540 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:31.696609 16469 raft_consensus.cc:2889] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:31.696084 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 97979.6us
W20260709 13:07:31.698505 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.670019 19527 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:31.700089 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.705085 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 200751us
I20260709 13:07:31.659546 19737 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.710021 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.711033 16537 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:31.714507 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.714939 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:31.699808 19822 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:31.702252 19527 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.701959 19870 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:31.718909 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.701244 19420 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:31.727443 16536 raft_consensus.cc:2376] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 6. Re-sending same reply.
I20260709 13:07:31.735817 19595 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:31.707719 19748 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:07:31.737862 19735 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:31.739686 19832 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:31.740516 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.741129 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:31.741479 16543 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:31.741806 19572 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:31.755699 16543 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:31.756577 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.757982 16537 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
W20260709 13:07:31.758592 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67477.7us
I20260709 13:07:31.759783 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:31.761569 16540 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.759858 16461 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:07:31.775139 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 68190.1us
I20260709 13:07:31.775744 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:31.776479 16536 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:31.778365 16540 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:31.779827 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50270.4us
I20260709 13:07:31.780467 16540 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:31.780990 16536 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.712148 19872 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:07:31.783756 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:31.784570 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:31.784983 19864 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:07:31.785239 16540 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:31.756946 19540 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:31.786657 19540 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:31.787050 19540 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:31.787186 16540 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:07:31.788020 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 139033us
I20260709 13:07:31.795024 16543 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:31.796587 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:31.797693 19464 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:31.800799 19464 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:31.804284 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.771229 19595 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:31.805454 19595 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.805969 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:31.807586 19595 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:31.793731 19832 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:07:31.809592 19572 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:31.810343 19878 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.810842 19878 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:31.811548 19879 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:07:31.812690 19885 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:31.813944 19880 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:07:31.815035 19873 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:07:31.815384 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 105510us
I20260709 13:07:31.815976 16469 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:31.816246 16511 leader_election.cc:400] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:31.817514 16511 leader_election.cc:400] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 5. Current term is 6.
I20260709 13:07:31.818521 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:31.809036 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:31.825783 16613 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:31.812858 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 263475us
I20260709 13:07:31.838297 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:31.779892 19420 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:31.843091 16540 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:31.843442 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1611) took 1122 ms. Trace:
I20260709 13:07:31.791999 19872 consensus_queue.cc:1243] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:07:31.846462 16541 rpcz_store.cc:276] 0709 13:07:30.715521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.715656 (+   135us) service_pool.cc:224] Handling call
0709 13:07:30.731020 (+ 15364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:30.768457 (+ 37437us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:30.928617 (+160160us) log.cc:844] Serialized 14 byte log entry
0709 13:07:31.353445 (+424828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.392511 (+ 39066us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:07:31.393001 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.393147 (+   146us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:31.393186 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.393253 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:31.788335 (+395082us) raft_consensus.cc:1685] finished
0709 13:07:31.837368 (+ 49033us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:31.837517 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":863,"prepare.queue_time_us":284469,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":33791,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":5409,"spinlock_wait_cycles":9758976,"thread_start_us":357983,"threads_started":3,"wal-append.queue_time_us":640962}
W20260709 13:07:31.852303 19881 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:31.856937 19892 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:07:31.857360 19420 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.796993 19889 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:31.779215 19850 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 13:07:31.860880 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 201138us
W20260709 13:07:31.857446 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60929.6us
W20260709 13:07:31.842582 19882 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:31.845443 19870 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:31.848831 19832 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:31.879127 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:31.871348 19832 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:31.882071 19832 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.882303 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:31.883000 16462 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:31.864108 19889 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:31.904292 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 85856.8us
I20260709 13:07:31.908128 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:31.913596 16616 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:31.914026 19821 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:31.914769 19654 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:31.915192 19654 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:31.915480 19867 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:31.916050 19654 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.916493 19889 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:31.918474 19654 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:31.922135 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:31.922501 16543 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:31.931454 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:31.932637 16511 leader_election.cc:400] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:31.933110 16511 leader_election.cc:403] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:31.937127 16536 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:31.899027 19868 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:31.952865 17125 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:31.953836 19540 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:31.955823 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:31.960019 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.963145 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:32.023638 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82991.9us
I20260709 13:07:32.025771 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:32.026741 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:31.992374 19595 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.028141 19595 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.028241 19872 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.028584 19595 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.028702 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.030501 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.033474 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.037398 16543 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:32.029599 19872 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:31.973361 19870 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
W20260709 13:07:32.062299 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 120749us
I20260709 13:07:32.029143 19859 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:07:32.068405 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62294.2us
W20260709 13:07:32.072196 19890 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:07:32.017076 19878 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:32.033187 19867 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.075160 19892 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:32.062364 19723 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.065999 19872 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.088111 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:32.097239 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.089749 19872 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.104874 19723 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.105456 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:32.106160 16617 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:32.077390 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46973.7us
I20260709 13:07:32.079321 19420 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:32.080315 19891 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:32.080590 19527 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.081291 19540 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:32.041554 19868 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:07:32.114903 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83912.2us
I20260709 13:07:32.115190 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:32.087829 19892 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.121174 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:32.123747 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:32.086236 19858 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:07:32.084692 19737 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:32.169159 16470 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:32.171267 16614 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:32.171392 17125 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:07:32.171895 17125 pending_rounds.cc:85] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 8
I20260709 13:07:32.172194 17125 pending_rounds.cc:107] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:32.172487 17125 raft_consensus.cc:2889] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.091517 19595 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.173594 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.086874 19758 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 13:07:32.181569 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58454.6us
W20260709 13:07:32.187628 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 99618.2us
I20260709 13:07:32.190428 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.163833 19878 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.194002 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.197297 16511 leader_election.cc:400] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:32.197631 16511 leader_election.cc:403] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:32.169363 19832 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.162706 19557 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.179301 19737 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.228062 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:32.234125 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44913.3us
I20260709 13:07:32.238499 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:32.239903 19431 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:32.240291 19656 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.178398 19572 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:07:32.195556 19878 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.265439 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:32.196009 19885 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:32.269876 16619 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:32.231307 19867 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.269244 19557 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:07:32.267143 19420 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:07:32.240828 19656 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.241724 19721 raft_consensus.cc:2764] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:32.241189 19540 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:07:32.263444 19878 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.269338 19891 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.286394 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:32.241091 19893 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:07:32.277460 19867 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.281900 19656 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.301461 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.309224 19884 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.302050 19598 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.330334 19859 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:32.331080 19868 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.331681 19868 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.287093 19654 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:07:32.295594 19867 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.329809 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.334733 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 97851.9us
W20260709 13:07:32.339192 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62010.4us
I20260709 13:07:32.310104 19758 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:32.355160 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:32.368254 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 81942.1us
I20260709 13:07:32.372381 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:32.377588 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 76227.9us
I20260709 13:07:32.303315 19431 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:07:32.381170 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 184857us
I20260709 13:07:32.385735 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:32.386590 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.296408 19891 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.327816 19850 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:32.364348 19758 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:32.392899 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.360967 19919 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.393970 19572 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:32.397630 19909 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:07:32.398298 19902 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:07:32.399032 19910 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:07:32.399875 19914 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:07:32.400501 19904 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:07:32.434958 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.435787 16469 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:32.436563 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.437335 16469 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 4: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:32.385357 19859 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.401034 19748 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:32.403044 19913 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:07:32.406486 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51427.4us
W20260709 13:07:32.406821 19903 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:07:32.407385 19832 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:32.407425 19905 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:07:32.392124 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.327571 19896 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:07:32.392656 19821 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:32.373063 19527 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:32.429322 19656 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.431114 19598 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.431247 19371 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.437172 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.384887 19595 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:32.437949 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.390327 19892 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:32.451716 19868 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:32.452045 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.453086 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.454165 19929 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:32.458071 19915 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:32.457881 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.539146 16467 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:32.539556 16461 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:32.458985 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.540604 16466 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:32.460224 19891 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:32.388727 19737 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:07:32.413043 19919 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:32.452106 16463 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:32.441303 19859 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.473908 16465 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:32.541431 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:32.478695 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.478391 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:32.481611 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.464289 19872 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.489337 16464 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.536271 16462 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:32.537649 16468 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:32.548633 17122 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.549978 19595 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.553103 19656 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:32.553001 19595 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.554595 19737 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.554973 19737 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.555316 19737 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.555943 19595 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:32.535809 19719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.050s
I20260709 13:07:32.556675 19872 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:32.557029 19719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.050s
I20260709 13:07:32.557318 19872 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:32.557706 19872 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:32.558086 16464 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:32.558545 19872 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.559640 17122 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:32.567493 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88873.2us
I20260709 13:07:32.489239 19821 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.538720 19929 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:32.579244 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:32.580739 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:32.581275 19924 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:32.486117 19654 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:07:32.549001 19859 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:32.596889 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 152963us
I20260709 13:07:32.547222 19919 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:32.600265 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:32.614290 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 132764us
W20260709 13:07:32.617812 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 165591us
I20260709 13:07:32.578701 19821 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:32.618312 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 345630us
I20260709 13:07:32.643525 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.645267 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.649782 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:32.650373 16536 raft_consensus.cc:2376] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 8. Re-sending same reply.
W20260709 13:07:32.681180 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71571us
I20260709 13:07:32.682193 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:32.685074 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 43933.8us
I20260709 13:07:32.687659 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.690539 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.691321 16461 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:32.691232 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.691929 16466 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.597790 19929 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.699298 16544 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:32.706359 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:32.707069 16540 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.616106 19723 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.613215 19889 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:32.710525 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 271681us
I20260709 13:07:32.613103 19868 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:32.698189 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.545231 19758 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:32.740556 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.748973 16469 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
W20260709 13:07:32.752315 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70217.6us
I20260709 13:07:32.743185 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:32.752897 17119 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:32.753628 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:32.751612 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.693339 19719 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.756906 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.757520 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:32.633643 19748 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 13:07:32.762498 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 370408us
I20260709 13:07:32.767527 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.684782 19572 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:07:32.770807 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.759272 16468 raft_consensus.cc:2376] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 7. Re-sending same reply.
I20260709 13:07:32.764267 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:32.767236 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.775435 16469 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:32.774708 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:32.690614 19884 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:32.701166 19557 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:07:32.721256 19891 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:07:32.790515 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:32.765921 19641 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:32.807471 16469 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:32.810973 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:32.767771 19892 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.816167 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62619.3us
I20260709 13:07:32.786975 19893 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.787207 19420 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:32.829896 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:32.832223 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75389us
I20260709 13:07:32.833467 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.834067 16540 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:32.787699 19595 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.767395 19719 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.785725 19940 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:32.814772 19758 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.863143 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:32.810212 19641 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.815093 19723 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:32.790787 19868 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:32.829823 19420 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.841356 19654 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:32.829151 19893 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:32.853272 19943 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:32.860004 19940 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.824822 19892 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.873818 19641 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:32.879976 19420 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:32.861773 19595 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:32.878986 19654 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:32.883817 19893 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.911947 19940 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:32.913296 19943 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.923063 19654 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.890767 19920 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:07:32.953056 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 194546us
I20260709 13:07:32.960086 16470 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:07:32.940508 19944 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:07:32.963088 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:32.941321 19943 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:32.966538 19540 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:32.965750 19939 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:32.992555 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 235587us
I20260709 13:07:32.993520 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:32.995357 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:32.975193 19947 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:32.954500 19723 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.029019 16466 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:33.004103 19868 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.998152 19951 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:33.002622 19598 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:32.997138 19540 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:33.030576 19925 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:33.081326 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 263590us
W20260709 13:07:33.084532 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 113895us
I20260709 13:07:33.031042 19371 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:33.086293 16614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2018) took 1293 ms (client timeout 1516 ms). Trace:
I20260709 13:07:33.133730 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:33.093484 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 91717us
I20260709 13:07:33.134802 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:33.109882 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:33.115247 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.059499 19719 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:33.129568 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:33.045290 19878 consensus_meta.cc:287] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.752s	user 0.012s	sys 0.000s
W20260709 13:07:33.133538 16614 rpcz_store.cc:269] 0709 13:07:31.792599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.792731 (+   132us) service_pool.cc:224] Handling call
0709 13:07:33.086033 (+1293302us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540019f5d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:33.086219 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755966208}
I20260709 13:07:33.138229 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:33.106312 19930 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:07:33.140511 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:33.141433 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:33.142234 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:33.146675 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:33.046335 19868 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.124603 19951 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:33.129596 19595 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:33.131086 19959 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.133181 19925 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:33.166555 16610 pending_rounds.cc:85] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 2
I20260709 13:07:33.167661 16610 pending_rounds.cc:107] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:07:33.167968 16610 raft_consensus.cc:2889] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:33.129156 19850 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:07:33.177963 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.359498 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:33.146318 19572 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:33.185387 19867 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.796s	user 0.008s	sys 0.006s
I20260709 13:07:33.171084 19925 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.147030 19896 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.213s
I20260709 13:07:33.145391 19878 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.379683 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:33.409152 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.025s	sys 0.094s
W20260709 13:07:33.429648 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.025s	sys 0.094s
W20260709 13:07:33.430235 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 655524us
I20260709 13:07:33.430958 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:33.414705 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.374897 19572 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.167831 19892 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:33.425524 16616 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:07:33.437624 16618 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:07:33.437224 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 298442us
I20260709 13:07:33.471779 16611 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:33.398788 19850 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:33.424582 19431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.013s	sys 0.013s
W20260709 13:07:33.485184 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 355665us
I20260709 13:07:33.438975 19942 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.477617 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:33.431984 19721 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:33.499017 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:33.474941 19572 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.354416 19959 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:33.489568 19431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.014s	sys 0.013s
I20260709 13:07:33.412254 19867 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:33.533406 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:33.534229 16466 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:33.535183 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:33.536288 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:33.536813 19953 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:33.537647 19945 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
W20260709 13:07:33.539103 19956 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.395s	user 0.000s	sys 0.000s
I20260709 13:07:33.539623 19954 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:33.539788 19654 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.002s
I20260709 13:07:33.541458 16466 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:07:33.552399 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 121523us
W20260709 13:07:33.607009 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.018s	sys 0.046s
W20260709 13:07:33.608140 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.018s	sys 0.046s
I20260709 13:07:33.550285 19964 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.498795 19721 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:33.625303 19872 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:33.607167 19953 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:33.678462 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 815316us
I20260709 13:07:33.690392 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:33.703069 16466 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:33.709432 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 219286us
I20260709 13:07:33.591318 19595 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.550606 19949 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.551030 19894 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:33.695089 19965 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:07:33.695688 19960 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 13:07:33.690029 19923 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.007s	sys 0.018s
W20260709 13:07:33.691365 19918 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.976s	user 0.011s	sys 0.007s
W20260709 13:07:33.691315 19961 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
W20260709 13:07:33.689982 19948 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.479s	user 0.000s	sys 0.001s
W20260709 13:07:33.693564 19963 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:07:33.501061 19850 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.762866 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:33.633819 19540 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:33.677106 19719 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.690536 19962 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.787067 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:33.817934 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 225535us
I20260709 13:07:33.884138 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:33.505761 19942 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:33.719833 19959 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:33.888252 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 125479us
W20260709 13:07:33.779615 19923 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.008s	sys 0.018s
I20260709 13:07:33.608594 19654 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.893908 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:33.839797 19641 consensus_meta.cc:287] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.001s
W20260709 13:07:33.889585 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 488745us
W20260709 13:07:33.882009 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.005s
I20260709 13:07:33.816973 19894 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:33.901618 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.005s
I20260709 13:07:33.932698 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:33.884181 19598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.000s	sys 0.014s
I20260709 13:07:33.933455 17125 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:33.689718 19721 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.592573 19951 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.695955 19953 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.721153 19964 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.883574 19595 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:33.936460 19598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.000s	sys 0.015s
I20260709 13:07:33.960171 16466 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:33.936553 19959 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:33.967865 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 227872us
I20260709 13:07:33.969319 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:33.978479 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 411) took 1362 ms. Trace:
I20260709 13:07:33.892915 19719 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:33.981482 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 506) took 1332 ms. Trace:
I20260709 13:07:33.946799 19723 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.981894 16538 rpcz_store.cc:276] 0709 13:07:32.649069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.686925 (+ 37856us) service_pool.cc:224] Handling call
0709 13:07:32.713208 (+ 26283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.854739 (+141531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.854975 (+   236us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.856221 (+  1246us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.998936 (+142715us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.998984 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.999086 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.981301 (+982215us) raft_consensus.cc:1685] finished
0709 13:07:33.981318 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.981426 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26742,"raft.queue_time_us":137554,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":32237,"spinlock_wait_cycles":855808,"thread_start_us":212297,"threads_started":2,"wal-append.queue_time_us":256358}
I20260709 13:07:33.978940 16462 rpcz_store.cc:276] 0709 13:07:32.611430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.611539 (+   109us) service_pool.cc:224] Handling call
0709 13:07:32.611936 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.612344 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.612388 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.612933 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.881680 (+268747us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.881734 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.881848 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.973562 (+1091714us) raft_consensus.cc:1685] finished
0709 13:07:33.973588 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.973744 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12514,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":108,"thread_start_us":160484,"threads_started":1,"wal-append.queue_time_us":311164}
I20260709 13:07:33.994570 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 529) took 1890 ms. Trace:
I20260709 13:07:33.959992 19878 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:33.995118 16617 rpcz_store.cc:276] 0709 13:07:32.104500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.106749 (+  2249us) service_pool.cc:224] Handling call
0709 13:07:32.107045 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.119471 (+ 12426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.119506 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.127540 (+  8034us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.266319 (+138779us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.266396 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.266569 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.041095 (+774526us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:33.979913 (+938818us) raft_consensus.cc:1685] finished
0709 13:07:33.979942 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.994491 (+ 14549us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7814,"raft.queue_time_us":14693,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":1283,"spinlock_wait_cycles":32978304,"thread_start_us":70282,"threads_started":1,"wal-append.queue_time_us":162813}
I20260709 13:07:34.009116 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.009974 16617 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:34.011062 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.012986 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:33.934772 19641 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.018415 16617 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:34.024946 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.025957 16616 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:34.028236 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.040570 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:34.052680 19955 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.678s	user 0.000s	sys 0.001s
W20260709 13:07:34.053030 19917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.487s	user 0.000s	sys 0.020s
I20260709 13:07:34.052839 19980 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.236s
W20260709 13:07:34.053447 19917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.645s	user 0.000s	sys 0.020s
I20260709 13:07:34.054019 19982 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:34.054689 19973 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:07:34.055212 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 409) took 1444 ms. Trace:
I20260709 13:07:34.055734 19990 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.052860 19966 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.000797 19540 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.060153 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.006454 19959 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:33.969597 19595 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.055584 16463 rpcz_store.cc:276] 0709 13:07:32.610846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.610971 (+   125us) service_pool.cc:224] Handling call
0709 13:07:32.681360 (+ 70389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.721805 (+ 40445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.721848 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.756556 (+ 34708us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.970193 (+213637us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.982691 (+ 12498us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.984577 (+  1886us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.984742 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.986512 (+  1770us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.054992 (+1068480us) raft_consensus.cc:1685] finished
0709 13:07:34.055009 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.055154 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30050,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":180226,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":76647,"thread_start_us":166867,"threads_started":1,"wal-append.queue_time_us":266645}
I20260709 13:07:34.066187 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:34.068574 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:34.095813 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 201943us
W20260709 13:07:34.057031 19737 consensus_meta.cc:287] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.501s	user 0.014s	sys 0.000s
I20260709 13:07:34.097344 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.105813 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:34.033468 19970 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.106583 16617 raft_consensus.cc:2410] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:34.060945 19991 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:34.056941 19721 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.043264 19923 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:34.061456 19867 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:34.027266 19868 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:34.008246 19723 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.067003 19966 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.061620 19982 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:34.119050 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 149822us
I20260709 13:07:34.120313 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.030969 19894 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.122398 19980 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.137414 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:34.122252 19858 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.121286 19970 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.145761 16615 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:34.126991 19540 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.131387 19966 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.118076 19737 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.134228 19959 raft_consensus.cc:2764] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:07:34.070019 19990 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.142041 19868 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:34.173760 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59810.3us
I20260709 13:07:34.174652 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:34.177896 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.123059 19991 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:34.181456 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44287.1us
I20260709 13:07:34.182226 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:34.183669 19971 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
W20260709 13:07:34.184788 19975 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.398s	user 0.001s	sys 0.001s
I20260709 13:07:34.184906 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 622) took 1199 ms. Trace:
I20260709 13:07:34.185360 17119 rpcz_store.cc:276] 0709 13:07:32.985643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.985872 (+   229us) service_pool.cc:224] Handling call
0709 13:07:32.996002 (+ 10130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.996343 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.996376 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.007025 (+ 10649us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.155925 (+148900us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:33.155976 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.156048 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.184630 (+1028582us) raft_consensus.cc:1685] finished
0709 13:07:34.184653 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.184819 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2604,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":17275,"thread_start_us":116427,"threads_started":1,"wal-append.queue_time_us":443428}
W20260709 13:07:34.187635 19912 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 1.797s	user 0.018s	sys 0.018s
I20260709 13:07:34.139441 19980 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:34.189580 19980 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.191090 19980 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:34.191531 19943 consensus_meta.cc:287] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.204s	user 0.010s	sys 0.002s
I20260709 13:07:34.194865 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 511) took 1311 ms. Trace:
I20260709 13:07:34.193776 19943 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.195274 16540 rpcz_store.cc:276] 0709 13:07:32.883737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.883899 (+   162us) service_pool.cc:224] Handling call
0709 13:07:32.884220 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.884448 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.884476 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.892150 (+  7674us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.029777 (+137627us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:33.360807 (+331030us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.361378 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.361491 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.190992 (+829501us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b24003e4d28. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444efb0 00007ffa370c5488 00007ffa370c5be8 00007ffa3709d398 00007ffa3709876a 00007ffa37097bb6
0709 13:07:34.194590 (+  3598us) raft_consensus.cc:1685] finished
0709 13:07:34.194683 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.194809 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42904,"prepare.queue_time_us":461172,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":351,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":21454,"spinlock_wait_cycles":113646464,"thread_start_us":428488,"threads_started":2,"wal-append.queue_time_us":229023}
I20260709 13:07:34.197880 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.199393 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:34.207688 16464 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:34.125885 19923 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.158128 19850 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:34.183667 19821 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.482s	user 0.006s	sys 0.006s
I20260709 13:07:34.227732 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:34.237962 16540 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:34.228987 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.003s	sys 0.004s
W20260709 13:07:34.238732 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.004s	sys 0.004s
W20260709 13:07:34.225494 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 267410us
I20260709 13:07:34.236420 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:34.243312 17093 leader_election.cc:336] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.603s (SENT)
W20260709 13:07:34.244565 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45243.1us
I20260709 13:07:34.246213 16538 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:34.236487 19572 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 13:07:34.232594 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.193897 19858 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.249446 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.234869 19959 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:34.215850 19994 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.272560 16540 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:34.248853 19868 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.260226 19858 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:34.293547 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44182.6us
I20260709 13:07:34.273260 19959 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.305449 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2030) took 1166 ms. Trace:
I20260709 13:07:34.248435 19821 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.287793 19858 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:34.285220 19868 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.268541 19982 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.304118 20009 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.294291 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:34.274834 19994 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.246939 19572 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.305838 16610 rpcz_store.cc:276] 0709 13:07:33.138965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.140499 (+  1534us) service_pool.cc:224] Handling call
0709 13:07:33.157386 (+ 16887us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.857163 (+699777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.857196 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.889698 (+ 32502us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.229173 (+339475us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:34.229209 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.229306 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.305240 (+ 75934us) raft_consensus.cc:1685] finished
0709 13:07:34.305259 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.305392 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4876,"raft.queue_time_us":338807,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":143,"thread_start_us":742478,"threads_started":2,"wal-append.queue_time_us":361473}
I20260709 13:07:34.321695 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:34.285606 19719 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:34.322518 16540 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.315198 19959 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:34.317313 19943 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:34.290701 20010 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.363417 17126 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:34.420674 16540 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
W20260709 13:07:34.334414 19859 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.718s	user 0.003s	sys 0.010s
I20260709 13:07:34.334096 19595 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:34.334115 19939 consensus_meta.cc:287] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.333s	user 0.010s	sys 0.002s
W20260709 13:07:34.429946 19758 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.559s	user 0.010s	sys 0.003s
I20260709 13:07:34.325380 19994 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.340533 19872 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:34.339618 20013 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:34.521539 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:34.445611 19942 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:34.536437 19821 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:34.521487 19916 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 2.060s	user 0.012s	sys 0.005s
I20260709 13:07:34.521167 19990 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:34.386831 20003 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:34.435901 20002 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:34.438421 19737 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:34.527505 16540 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:34.542690 19919 consensus_meta.cc:287] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.908s	user 0.008s	sys 0.006s
I20260709 13:07:34.525367 19939 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.526356 20013 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.526543 19872 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:34.636104 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 501) took 2750 ms. Trace:
I20260709 13:07:34.636611 16541 rpcz_store.cc:276] 0709 13:07:31.875751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.875898 (+   147us) service_pool.cc:224] Handling call
0709 13:07:31.900447 (+ 24549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:31.900996 (+   549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.901044 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:31.923460 (+ 22416us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.228007 (+304547us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.228067 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.228150 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.245416 (+2017266us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:34.625784 (+380368us) raft_consensus.cc:1685] finished
0709 13:07:34.625810 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.626056 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":10797,"spinlock_wait_cycles":22442880,"thread_start_us":229837,"threads_started":1,"wal-append.queue_time_us":336684}
I20260709 13:07:34.519604 19859 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:34.680310 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 414524us
I20260709 13:07:34.700695 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:34.334271 20009 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:34.636502 19929 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.893s	user 0.014s	sys 0.000s
W20260709 13:07:34.728191 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 495642us
I20260709 13:07:34.729435 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:34.730808 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 451370us
I20260709 13:07:34.631557 19572 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:34.636327 20003 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.637388 19872 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:34.758955 19935 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:34.637512 20013 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:34.758610 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 57999.5us
I20260709 13:07:34.765151 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:34.773195 16540 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:34.767650 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:34.774150 16541 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
W20260709 13:07:34.731781 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 340294us
I20260709 13:07:34.774973 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:34.731124 19758 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:34.770308 19420 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.839s	user 0.014s	sys 0.000s
W20260709 13:07:34.766932 20016 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 13:07:34.788143 16538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.002s	sys 0.010s
W20260709 13:07:34.774114 16462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.018s	sys 0.038s
I20260709 13:07:34.799739 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1871) took 1319 ms. Trace:
I20260709 13:07:34.800130 16462 rpcz_store.cc:276] 0709 13:07:33.480156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.993977 (+513821us) service_pool.cc:224] Handling call
0709 13:07:33.994336 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.994580 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:34.267990 (+273410us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.799381 (+531391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.799433 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:34.799496 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.799569 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.799686 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29510,"prepare.queue_time_us":297214,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":773663,"threads_started":2}
W20260709 13:07:34.803484 16538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.002s	sys 0.010s
I20260709 13:07:34.732561 19929 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.768275 19935 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.758536 19991 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:34.636863 19919 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.926730 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:34.785339 19939 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.159s
W20260709 13:07:34.939116 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.011s	sys 0.016s
I20260709 13:07:35.533290 16612 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:07:35.621526 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.013s	sys 0.036s
W20260709 13:07:35.622224 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 1.32787e+06us
I20260709 13:07:34.994277 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1870) took 1514 ms. Trace:
I20260709 13:07:35.630744 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2033) took 2462 ms. Trace:
I20260709 13:07:34.927919 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:35.637338 16540 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.522333 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 405) took 3086 ms. Trace:
I20260709 13:07:35.638368 16470 rpcz_store.cc:276] 0709 13:07:32.436066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.482384 (+ 46318us) service_pool.cc:224] Handling call
0709 13:07:32.482693 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.960574 (+477881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.522008 (+2561434us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54002a71d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:35.522258 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096819968}
I20260709 13:07:34.995885 16465 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:35.500334 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 408) took 2889 ms. Trace:
I20260709 13:07:35.641242 16462 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:35.642204 16462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 416) took 1399 ms (client timeout 1661 ms). Trace:
W20260709 13:07:35.642752 16462 rpcz_store.cc:269] 0709 13:07:34.243290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.926234 (+682944us) service_pool.cc:224] Handling call
0709 13:07:35.642128 (+715894us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:34.993546 16468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 410) took 2381 ms (client timeout 1603 ms). Trace:
I20260709 13:07:34.999979 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:35.636840 16612 rpcz_store.cc:276] 0709 13:07:33.168124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.168240 (+   116us) service_pool.cc:224] Handling call
0709 13:07:35.524264 (+2356024us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:07:35.524561 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.621906 (+ 97345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.630661 (+  8755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6084992}
I20260709 13:07:35.645783 17125 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:07:35.256311 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 587490us
W20260709 13:07:35.617177 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 887787us
I20260709 13:07:35.649492 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:35.651110 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:35.651939 16469 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:35.644342 16468 rpcz_store.cc:269] 0709 13:07:32.611123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.611278 (+   155us) service_pool.cc:224] Handling call
0709 13:07:34.991943 (+2380665us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54002a6cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:34.992108 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260301696}
I20260709 13:07:35.662159 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:34.797658 19527 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:35.161156 19894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.013s	sys 0.016s
I20260709 13:07:34.805728 19923 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:34.969882 19940 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 2.020s	user 0.010s	sys 0.004s
I20260709 13:07:35.635525 16466 rpcz_store.cc:276] 0709 13:07:33.479810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.966629 (+486819us) service_pool.cc:224] Handling call
0709 13:07:33.966967 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.992720 (+ 25753us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:34.133752 (+141032us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.257048 (+123296us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.282845 (+ 25797us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.283003 (+   158us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.292108 (+  9105us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.318883 (+ 26775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.318966 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.994066 (+675100us) raft_consensus.cc:1685] finished
0709 13:07:34.994084 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.994216 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99110,"prepare.queue_time_us":297070,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":170696,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":12627,"spinlock_wait_cycles":31390080,"thread_start_us":141830,"threads_started":2,"wal-append.queue_time_us":302226}
W20260709 13:07:35.289482 20008 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
W20260709 13:07:35.687938 19925 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 2.207s	user 0.016s	sys 0.001s
I20260709 13:07:35.615229 19931 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:34.921470 19959 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:35.676048 19557 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.920974 19420 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:34.932662 19868 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:35.679036 19935 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:35.674010 19894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.027s	sys 0.025s
W20260709 13:07:35.679719 19540 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.523s	user 0.006s	sys 0.004s
W20260709 13:07:35.280020 19893 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 2.345s	user 0.010s	sys 0.006s
I20260709 13:07:35.641069 16464 rpcz_store.cc:276] 0709 13:07:32.610562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.610679 (+   117us) service_pool.cc:224] Handling call
0709 13:07:32.610980 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.208319 (+1597339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.499900 (+1291581us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54000b3e54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:35.500210 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3671220480}
I20260709 13:07:35.699882 16469 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
W20260709 13:07:35.724071 16469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 417) took 1480 ms (client timeout 1776 ms). Trace:
W20260709 13:07:35.688450 19858 consensus_meta.cc:287] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.349s	user 0.010s	sys 0.000s
I20260709 13:07:35.004590 20026 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.626106 20009 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:35.630470 19929 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:35.694325 20003 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:35.280730 19859 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:35.704100 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54722.3us
I20260709 13:07:35.768159 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:35.724305 19991 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:35.688565 19925 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.705786 16540 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:35.710932 16545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.031s	sys 0.053s
W20260709 13:07:35.724627 16469 rpcz_store.cc:269] 0709 13:07:34.243569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.650830 (+1407261us) service_pool.cc:224] Handling call
0709 13:07:35.723988 (+ 73158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.735926 19868 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.736825 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.000s	sys 0.049s
W20260709 13:07:35.774053 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.000s	sys 0.050s
I20260709 13:07:35.717378 19557 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:34.946753 20023 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.695353 19527 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:35.746105 16614 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:35.786695 19925 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:35.696462 19931 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:35.747159 20009 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:35.704352 16543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.019s	sys 0.080s
W20260709 13:07:35.791689 16543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.019s	sys 0.080s
I20260709 13:07:35.726858 19540 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:35.772852 16545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.364s	user 0.031s	sys 0.053s
I20260709 13:07:35.766700 20003 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:35.775799 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1656) took 1544 ms. Trace:
I20260709 13:07:35.796517 16540 rpcz_store.cc:276] 0709 13:07:34.252226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.785259 (+533033us) service_pool.cc:224] Handling call
0709 13:07:35.772843 (+987584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.765254 20027 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.783390 19980 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.592s	user 0.012s	sys 0.003s
I20260709 13:07:35.783864 19557 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:35.774296 20021 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.040s	sys 0.095s
I20260709 13:07:35.694772 19940 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:35.769657 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:35.785013 19959 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:35.832360 16540 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.731624 19893 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.844738 19893 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:35.792930 19925 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.846060 19925 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:35.846589 19966 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.675s	user 0.005s	sys 0.005s
I20260709 13:07:35.847039 19966 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:35.847671 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1872) took 2367 ms. Trace:
I20260709 13:07:35.736609 19858 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:35.807753 19926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.006s	sys 0.012s
I20260709 13:07:35.842135 19420 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:35.842803 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 73247.4us
I20260709 13:07:35.791255 19891 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:35.874352 19891 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:35.874802 19858 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:35.794868 19929 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:35.876451 19919 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:35.867218 19926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.006s	sys 0.012s
I20260709 13:07:35.848030 16467 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.868827 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:35.796141 19939 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.848188 19925 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:35.868011 19991 raft_consensus.cc:2764] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:07:35.882800 19850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.043s	sys 0.084s
W20260709 13:07:35.870747 20029 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:07:35.866243 19723 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:35.873255 16468 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:35.787671 19868 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.848091 16463 rpcz_store.cc:276] 0709 13:07:33.480469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.105689 (+625220us) service_pool.cc:224] Handling call
0709 13:07:34.122397 (+ 16708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:34.122612 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:34.144471 (+ 21859us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.294017 (+149546us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.847208 (+1553191us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b1800460b40. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287
0709 13:07:35.847317 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.847382 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:35.847434 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.847504 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.847615 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34756,"prepare.queue_time_us":190453,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":61090,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8095,"spinlock_wait_cycles":44779520,"thread_start_us":185657,"threads_started":3,"wal-append.queue_time_us":157463,"wal-append.run_cpu_time_us":1424,"wal-append.run_wall_time_us":1038454}
I20260709 13:07:35.848483 17122 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:35.870359 19420 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:35.810381 20027 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.804179 20009 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:35.926026 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57271.4us
I20260709 13:07:35.805485 20003 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.806113 19527 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:35.916352 16540 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:35.990980 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1662) took 1737 ms. Trace:
I20260709 13:07:35.988662 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:35.831086 20021 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.269s	user 0.041s	sys 0.095s
I20260709 13:07:35.882421 19891 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:35.935851 17091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.014s	sys 0.035s
W20260709 13:07:36.004493 17091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.017s	sys 0.038s
I20260709 13:07:35.926028 19540 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:35.986256 19850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.159s	user 0.051s	sys 0.095s
I20260709 13:07:36.007305 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:36.007596 17125 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:36.008225 17120 raft_consensus.cc:2410] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:35.877082 19931 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:36.009323 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:35.993500 16540 rpcz_store.cc:276] 0709 13:07:34.253943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.831740 (+1577797us) service_pool.cc:224] Handling call
0709 13:07:35.832189 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.990607 (+158418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.990914 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:35.989076 19420 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.005800 19991 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.936967 20042 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.886471 19572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.014s	sys 0.034s
I20260709 13:07:35.952934 19980 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:35.926832 19939 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:35.887055 19929 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:36.051057 19572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.017s	sys 0.036s
W20260709 13:07:36.058641 19988 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.857s	user 0.000s	sys 0.014s
I20260709 13:07:36.052119 19966 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.058245 19980 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.050715 19931 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.059790 20042 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.131219 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 419) took 1332 ms. Trace:
W20260709 13:07:36.132228 16541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.012s
W20260709 13:07:36.182485 16541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.007s	sys 0.012s
I20260709 13:07:36.182343 16470 rpcz_store.cc:276] 0709 13:07:34.798591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.665875 (+867284us) service_pool.cc:224] Handling call
0709 13:07:35.666178 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.666381 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:35.681470 (+ 15089us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.130730 (+449260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.130806 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:36.130876 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.130977 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.131145 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6417,"thread_start_us":448784,"threads_started":1}
W20260709 13:07:36.131943 19951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.017s	sys 0.017s
W20260709 13:07:36.202629 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.006s
W20260709 13:07:36.203037 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.006s	sys 0.006s
I20260709 13:07:36.204281 20045 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:36.205063 20045 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.222795 19654 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.245443 19641 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:36.253875 20043 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:36.254914 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1650) took 2027 ms. Trace:
I20260709 13:07:36.255182 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 414) took 2891 ms. Trace:
I20260709 13:07:36.255661 16465 rpcz_store.cc:276] 0709 13:07:33.357631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.358636 (+  1005us) service_pool.cc:224] Handling call
0709 13:07:34.992509 (+1633873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.640485 (+647976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.248471 (+607986us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002a6cd0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:36.248710 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3628929920}
I20260709 13:07:36.258213 20045 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:36.194078 19951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.165s	user 0.017s	sys 0.018s
W20260709 13:07:36.341140 16466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.021s
W20260709 13:07:36.342710 16466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.005s	sys 0.021s
I20260709 13:07:36.279948 19719 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:36.280344 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 505) took 3639 ms. Trace:
I20260709 13:07:36.255409 16537 rpcz_store.cc:276] 0709 13:07:34.227180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.227308 (+   128us) service_pool.cc:224] Handling call
0709 13:07:34.227681 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.325369 (+ 97688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.325439 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.357063 (+ 31624us) log.cc:844] Serialized 52 byte log entry
0709 13:07:34.680072 (+323009us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:34.680121 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.680206 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.069400 (+1389194us) raft_consensus.cc:1685] finished
0709 13:07:36.254719 (+185319us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.254855 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2096,"raft.queue_time_us":205221,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":36275,"thread_start_us":386313,"threads_started":2,"wal-append.queue_time_us":1196561}
W20260709 13:07:36.341287 16582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.975s (SENT) [suppressed 14 similar messages]
W20260709 13:07:36.344688 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 81126.7us
W20260709 13:07:36.345795 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 357237us
I20260709 13:07:36.261544 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:36.357328 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.359980 16464 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:36.376312 16470 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:36.358919 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.360466 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.303581 19929 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.377839 16462 raft_consensus.cc:2410] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:36.346385 16543 rpcz_store.cc:276] 0709 13:07:32.640627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.643104 (+  2477us) service_pool.cc:224] Handling call
0709 13:07:32.697785 (+ 54681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.837060 (+139275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.837104 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.856884 (+ 19780us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.706630 (+1849746us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b180035cf80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:35.792187 (+1085557us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.268147 (+475960us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.268411 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.268487 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.268545 (+    58us) raft_consensus.cc:1685] finished
0709 13:07:36.279778 (+ 11233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.280273 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9004,"prepare.queue_time_us":216626,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":125482,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":17947,"spinlock_wait_cycles":7102208,"thread_start_us":1608749,"threads_started":3,"wal-append.queue_time_us":3057925}
W20260709 13:07:36.355690 20041 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:36.344890 19868 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.344255 20042 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.379652 16463 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:36.358565 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.378396 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:36.373159 19994 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.792s	user 0.013s	sys 0.000s
I20260709 13:07:36.384930 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.380496 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.382802 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.387156 16470 raft_consensus.cc:2368] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:36.349133 20027 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.384979 16469 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:36.385959 16464 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:36.354714 20045 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:36.390887 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.378978 20003 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.389068 20050 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:36.391682 20003 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.391955 20050 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.392215 20003 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.394114 20003 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:36.394199 20050 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.394626 20003 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:36.394964 20003 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.395288 20003 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.396998 16469 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:36.267449 19723 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:36.398685 19723 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.379376 20052 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:36.365084 19540 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.386282 19994 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.403945 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1660) took 2150 ms. Trace:
I20260709 13:07:36.415817 16612 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:36.387826 19420 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:36.405406 20042 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:36.405746 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:36.384778 20009 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.407939 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.410549 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.405102 20055 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.420341 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:36.415889 16541 rpcz_store.cc:276] 0709 13:07:34.253462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.933535 (+680073us) service_pool.cc:224] Handling call
0709 13:07:34.974478 (+ 40943us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.980661 (+  6183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.980693 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.981342 (+   649us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.183062 (+1201720us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:36.183121 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.183227 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.403747 (+220520us) raft_consensus.cc:1685] finished
0709 13:07:36.403765 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.403892 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":921,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":22964,"thread_start_us":565423,"threads_started":1,"wal-append.queue_time_us":1355194}
I20260709 13:07:36.451493 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.453598 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1655) took 2225 ms. Trace:
I20260709 13:07:36.454916 16464 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:36.879189 16511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.002s
W20260709 13:07:36.879524 16511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.004s	sys 0.002s
I20260709 13:07:36.878528 16538 rpcz_store.cc:276] 0709 13:07:34.228645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.246926 (+ 18281us) service_pool.cc:224] Handling call
0709 13:07:34.270572 (+ 23646us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.804061 (+533489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.804107 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.661829 (+857722us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.078757 (+416928us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.078811 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.078906 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.453330 (+374424us) raft_consensus.cc:1685] finished
0709 13:07:36.453357 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.453521 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49072,"raft.queue_time_us":345375,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7495,"thread_start_us":909421,"threads_started":2,"wal-append.queue_time_us":696435}
W20260709 13:07:36.879918 16511 connection.cc:256] RPC call timeout handler was delayed by -2.207291406999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:07:36.880224 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1415914069999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:07:36.449084 19872 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.681s	user 0.011s	sys 0.003s
I20260709 13:07:36.481694 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 421) took 1558 ms. Trace:
W20260709 13:07:36.880551 16511 connection.cc:256] RPC call timeout handler was delayed by -2.052491406999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:07:36.880959 16511 connection.cc:256] RPC call timeout handler was delayed by -2.032691406999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:07:36.621284 20027 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.492658 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.673432 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:36.673017 19994 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:36.648132 20013 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.843s	user 0.012s	sys 0.000s
W20260709 13:07:36.627348 20058 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:07:36.541554 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:36.425593 19980 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:36.874469 16582 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.004s	sys 0.006s
I20260709 13:07:36.446257 20042 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.447736 16616 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.447139 19723 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:36.881570 16511 connection.cc:256] RPC call timeout handler was delayed by -1.9435914069999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:07:36.937983 16511 connection.cc:256] RPC call timeout handler was delayed by -1.8589914069999622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:07:36.889701 16540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.009s
W20260709 13:07:36.890050 16537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.012s
I20260709 13:07:36.891256 16610 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:36.880911 16466 rpcz_store.cc:276] 0709 13:07:34.923454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.681227 (+757773us) service_pool.cc:224] Handling call
0709 13:07:35.681658 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.703023 (+ 21365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.703054 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.714564 (+ 11510us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.343144 (+628580us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:36.343423 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.343614 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.343682 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.481501 (+137819us) raft_consensus.cc:1685] finished
0709 13:07:36.481517 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.481630 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20891,"raft.queue_time_us":28976,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":20978,"thread_start_us":576494,"threads_started":1,"wal-append.queue_time_us":660858}
I20260709 13:07:36.894832 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.426241 19540 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.877005 19868 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:36.875483 20045 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.943377 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:36.944005 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.876756 19959 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.901969 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.945739 16611 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:36.890918 20009 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.946991 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.936236 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.878073 16615 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:36.939422 16537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.000s	sys 0.013s
I20260709 13:07:36.949082 16611 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:36.940178 16540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.003s	sys 0.010s
W20260709 13:07:36.938395 16511 connection.cc:256] RPC call timeout handler was delayed by -1.8265914069999099s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
W20260709 13:07:36.935057 16582 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.004s	sys 0.007s
W20260709 13:07:36.950489 16511 connection.cc:256] RPC call timeout handler was delayed by -1.7968914069999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:07:36.950861 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 748896us
W20260709 13:07:36.952643 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.949605 16615 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:36.950955 16511 connection.cc:256] RPC call timeout handler was delayed by -1.4458914069999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.255s for a response
I20260709 13:07:36.954357 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:36.955819 19965 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 3.022s	user 0.008s	sys 0.023s
I20260709 13:07:36.945597 19868 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.956193 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:36.942456 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.949476 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1664) took 2695 ms. Trace:
I20260709 13:07:36.958158 16537 rpcz_store.cc:276] 0709 13:07:34.254380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.354229 (+2099849us) service_pool.cc:224] Handling call
0709 13:07:36.377224 (+ 22995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.377447 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:36.387358 (+  9911us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.949148 (+561790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.949200 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:36.949251 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.949317 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.949423 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41,"prepare.queue_time_us":10040,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":561459,"threads_started":1}
W20260709 13:07:36.908905 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.003s	sys 0.010s
W20260709 13:07:36.960397 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.011s
I20260709 13:07:36.950511 16618 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
W20260709 13:07:36.960927 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 699465us
I20260709 13:07:36.962646 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.901916 20027 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.966032 20067 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:36.967533 20067 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.968039 20027 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.970868 19868 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.972832 19540 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:36.893640 19872 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.973274 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:36.974432 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 512) took 4043 ms. Trace:
I20260709 13:07:36.974673 16619 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:36.974870 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.970746 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.938660 19994 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:36.977522 17093 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.027s	sys 0.036s
W20260709 13:07:36.978937 17093 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.028s	sys 0.037s
I20260709 13:07:36.979166 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.979446 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:36.979805 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 598575us
I20260709 13:07:36.974851 16536 rpcz_store.cc:276] 0709 13:07:32.931010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.931173 (+   163us) service_pool.cc:224] Handling call
0709 13:07:32.953770 (+ 22597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.964738 (+ 10968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.964793 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.965223 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.109114 (+143891us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:33.398364 (+289250us) log.cc:844] Serialized 14 byte log entry
0709 13:07:33.398622 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.398703 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.955533 (+3556830us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b24003e4d28. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444f09d 00007ffa3708110e 00007ffa3709888c 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221
0709 13:07:36.956905 (+  1372us) raft_consensus.cc:1685] finished
0709 13:07:36.974197 (+ 17292us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.974367 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10606,"prepare.queue_time_us":516704,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":17934,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":20821,"spinlock_wait_cycles":86683648,"thread_start_us":372123,"threads_started":2,"wal-append.queue_time_us":452034}
I20260709 13:07:36.981855 16616 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:36.982903 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.983124 16610 raft_consensus.cc:2368] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:36.901805 20003 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.988090 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:36.968663 20027 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.940649 20013 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:37.006320 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.014535 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.005066 20027 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.896458 20055 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.963466 20009 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:36.957842 20045 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.963626 19959 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:36.984719 19994 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:37.023929 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.025875 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.026211 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:36.994832 19920 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:07:37.032909 16617 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:37.033730 16509 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:37.032935 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 76820.3us
I20260709 13:07:37.036484 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:37.037871 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.038763 20067 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:37.028041 20069 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.039242 20067 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:37.039781 20067 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.039824 19748 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:37.040347 19748 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:37.041108 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1665) took 2786 ms. Trace:
I20260709 13:07:37.041503 16543 rpcz_store.cc:276] 0709 13:07:34.254609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.382443 (+2127834us) service_pool.cc:224] Handling call
0709 13:07:36.390243 (+  7800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.390389 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.390403 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.419052 (+ 28649us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.895400 (+476348us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:36.895531 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.895615 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.040853 (+145238us) raft_consensus.cc:1685] finished
0709 13:07:37.040888 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.041035 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":474102,"threads_started":1,"wal-append.queue_time_us":590473}
I20260709 13:07:37.043048 20045 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:37.043623 19996 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 2.849s	user 0.003s	sys 0.019s
I20260709 13:07:37.044847 20013 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:37.046258 19431 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:37.039491 20069 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.047930 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.046790 19994 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:37.024704 19885 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:37.050439 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.055981 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.056603 16616 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:37.058689 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1868) took 3579 ms. Trace:
I20260709 13:07:37.059044 16467 rpcz_store.cc:276] 0709 13:07:33.479160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.959159 (+479999us) service_pool.cc:224] Handling call
0709 13:07:33.976598 (+ 17439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.922451 (+1945853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.058514 (+1136063us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54000b4854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:37.058645 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4303376768}
I20260709 13:07:37.061401 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:37.047271 19540 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:37.051467 19885 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:37.050836 20013 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:37.063911 17118 raft_consensus.cc:2368] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:37.075745 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.059829 20045 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:37.082975 19748 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:37.083308 19885 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.084321 19964 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.084399 19885 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.090111 16509 leader_election.cc:400] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:37.090524 16509 leader_election.cc:403] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.064287 20062 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.091682 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.092108 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 675) took 2101 ms. Trace:
I20260709 13:07:37.074484 20027 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.092497 17122 rpcz_store.cc:276] 0709 13:07:34.983570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.993811 (+ 10241us) service_pool.cc:224] Handling call
0709 13:07:34.994145 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.986558 (+992413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.084559 (+1098001us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54006851d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:37.084738 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964324608}
I20260709 13:07:37.097167 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1663) took 2843 ms. Trace:
I20260709 13:07:37.097641 16540 rpcz_store.cc:276] 0709 13:07:34.254163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.045332 (+1791169us) service_pool.cc:224] Handling call
0709 13:07:36.045720 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.049490 (+  3770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.049521 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.344001 (+294480us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.950126 (+606125us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:36.950167 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.950236 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.096966 (+146730us) raft_consensus.cc:1685] finished
0709 13:07:37.096985 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.097112 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1411,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4841,"thread_start_us":571036,"threads_started":1,"wal-append.queue_time_us":628242}
I20260709 13:07:37.103915 16619 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:37.082149 20045 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:37.088759 19540 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.108625 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:37.109652 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48309.6us
I20260709 13:07:37.112339 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.116600 20027 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:37.097903 20013 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:37.115154 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:37.105122 19872 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:37.097261 20069 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.105286 20042 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.116729 20062 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:07:37.116278 19964 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:37.137418 19964 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.117985 20027 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.142087 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:37.144871 17122 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.140941 20003 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.113971 20072 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:37.119467 20013 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:37.154410 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 119863us
I20260709 13:07:37.141511 20009 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:37.141079 19964 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.159307 20045 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.160555 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 510) took 4510 ms. Trace:
I20260709 13:07:37.202451 16539 rpcz_store.cc:276] 0709 13:07:32.650478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.650595 (+   117us) service_pool.cc:224] Handling call
0709 13:07:32.696841 (+ 46246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.812538 (+115697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.812570 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.866045 (+ 53475us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.002192 (+136147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:33.002234 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.002298 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.159462 (+4157164us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b24003e4d28. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444efb0 00007ffa370c5488 00007ffa370c5be8 00007ffa3709d398 00007ffa3709876a 00007ffa37097bb6
0709 13:07:37.160228 (+   766us) raft_consensus.cc:1685] finished
0709 13:07:37.160249 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.160467 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11628,"raft.queue_time_us":25668,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":15873,"spinlock_wait_cycles":99386112,"thread_start_us":236419,"threads_started":2,"wal-append.queue_time_us":233066}
I20260709 13:07:37.141784 20076 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:37.158718 20013 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:37.161783 20061 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.091s	user 0.000s	sys 0.002s
I20260709 13:07:37.163810 20027 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.164382 20055 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.221278 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.221894 16540 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.222947 17122 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:37.173871 19959 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.175978 20067 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.146638 19540 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.194878 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.195897 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.196633 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.153313 20062 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:37.215241 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.215473 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.237627 16537 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.215220 16541 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:37.215219 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.202049 20072 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:37.166388 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.240527 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.229116 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:37.234076 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.197361 20042 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.236451 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.215926 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.239655 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.243650 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.243739 16539 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:37.243913 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.242265 16615 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:37.239055 16619 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
W20260709 13:07:37.245416 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 79095.6us
I20260709 13:07:37.246860 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:37.247927 19656 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:37.248185 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.248867 19656 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:37.249375 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.249091 19885 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:37.249470 20042 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:37.249939 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.250232 19885 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:37.250679 16541 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:37.251096 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.251634 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.249202 19572 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.252159 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:37.251883 20042 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:37.251262 19885 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:37.253166 19979 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 3.295s	user 0.022s	sys 0.014s
I20260709 13:07:37.253461 19885 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.250023 16539 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.253852 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.253742 20072 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.262056 16538 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.260737 16537 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:37.263089 16539 raft_consensus.cc:2410] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:37.263525 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.253203 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:37.264710 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:37.266918 16540 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:37.237188 20062 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:37.277832 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:37.262192 20067 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.249325 19656 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:37.271379 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.271662 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:37.272513 19572 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:37.272956 17118 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.273242 19721 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.249092 20009 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:37.274499 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 586) took 3341 ms. Trace:
I20260709 13:07:37.275898 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 676) took 2292 ms. Trace:
I20260709 13:07:37.276677 20042 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:37.277832 20062 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:37.284751 16436 connection.cc:256] RPC call timeout handler was delayed by -1.2530119610000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:07:37.286088 16541 raft_consensus.cc:2410] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:37.268708 20072 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.302515 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.303623 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.306347 16538 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:37.317412 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 202363us
I20260709 13:07:37.328326 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.546104 20013 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.546752 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.547600 16465 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:37.547959 16436 connection.cc:256] RPC call timeout handler was delayed by -1.208480236000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 13:07:37.546860 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:37.548345 16436 connection.cc:256] RPC call timeout handler was delayed by -1.1733802360000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:07:37.548878 16436 connection.cc:256] RPC call timeout handler was delayed by -1.0626802360000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:07:37.475044 16462 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:37.400408 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:37.376623 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.390407 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 109734us
I20260709 13:07:37.376307 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:37.409030 16540 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:37.445786 16470 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:37.550732 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.549067 16539 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:37.551267 17126 rpcz_store.cc:276] 0709 13:07:33.932596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.932704 (+   108us) service_pool.cc:224] Handling call
0709 13:07:33.943637 (+ 10933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.450412 (+506775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.274198 (+2823786us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54005febd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:37.274431 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951655680}
I20260709 13:07:37.435339 17121 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:37.474798 16466 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.359532 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.552597 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:37.556872 16465 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:37.561501 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.447049 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.564095 16470 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:37.552981 17119 rpcz_store.cc:276] 0709 13:07:34.983928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.994304 (+ 10376us) service_pool.cc:224] Handling call
0709 13:07:34.994666 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.682239 (+687573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.682268 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:35.682311 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:35.682355 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.275705 (+1593350us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540046b254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:37.275750 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.275847 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580784512}
I20260709 13:07:37.564486 16466 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:37.443535 19984 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.290s	user 0.019s	sys 0.046s
I20260709 13:07:37.368705 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:37.298473 19959 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:37.596675 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.327970 19723 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:37.555780 19464 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:07:37.506332 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.436966 20026 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:37.565851 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.607669 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.320847 19656 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:37.570182 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.592170 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.596675 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:37.359630 20074 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:37.321199 20027 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:37.589323 20072 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:37.561126 19885 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:07:37.599520 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:37.368420 19896 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.572177 19920 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:07:37.606593 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 43601.2us
I20260709 13:07:37.608845 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:37.597337 19984 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.535s	user 0.023s	sys 0.049s
I20260709 13:07:37.565817 19991 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:37.566761 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:37.600643 16511 leader_election.cc:400] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:37.612936 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.568564 20009 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:37.601756 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.556001 20003 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:07:37.565629 20012 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:07:37.611200 19868 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:07:37.758487 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 202810us
W20260709 13:07:37.618335 16585 connection.cc:256] RPC call timeout handler was delayed by -2.158542695000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
I20260709 13:07:37.806769 16462 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:37.635887 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:37.680119 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 116221us
I20260709 13:07:37.808249 16541 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.807713 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:37.807466 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 207166us
I20260709 13:07:37.646229 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.671095 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1652) took 3443 ms. Trace:
I20260709 13:07:37.823552 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1649) took 3596 ms. Trace:
I20260709 13:07:37.826148 16536 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:37.720759 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.825927 16466 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:37.826531 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:37.831271 17125 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:37.806640 16585 connection.cc:256] RPC call timeout handler was delayed by -2.1432426950000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 13:07:37.837738 16585 connection.cc:256] RPC call timeout handler was delayed by -2.0793426950000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:07:37.838167 16585 connection.cc:256] RPC call timeout handler was delayed by -1.6005426950000583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2595s for a response
I20260709 13:07:37.826907 16470 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:37.838744 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:37.842623 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.843317 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:37.843333 16462 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:07:37.706146 20077 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:07:37.828104 16544 rpcz_store.cc:276] 0709 13:07:34.226838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.227797 (+   959us) service_pool.cc:224] Handling call
0709 13:07:34.228113 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.270044 (+ 41931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.270079 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.283067 (+3012988us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:07:37.283635 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.323134 (+ 39499us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:37.323184 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.323278 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.823229 (+499951us) raft_consensus.cc:1685] finished
0709 13:07:37.823249 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.823486 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":290530,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":40122,"spinlock_wait_cycles":16115456,"thread_start_us":80525,"threads_started":2,"wal-append.queue_time_us":367550}
W20260709 13:07:37.651314 20081 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:07:37.602653 19959 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:07:37.643718 19978 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 3.522s	user 0.012s	sys 0.020s
I20260709 13:07:37.614482 20074 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.826527 16542 rpcz_store.cc:276] 0709 13:07:34.227783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.229167 (+  1384us) service_pool.cc:224] Handling call
0709 13:07:34.229451 (+   284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.287228 (+ 57777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.287256 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:37.150650 (+2863394us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:07:37.151262 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.323759 (+172497us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:37.341760 (+ 18001us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.436712 (+ 94952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.456798 (+ 20086us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.670648 (+213850us) raft_consensus.cc:1685] finished
0709 13:07:37.670802 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.671016 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28402,"prepare.queue_time_us":241290,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2648,"raft.queue_time_us":293382,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":79488,"spinlock_wait_cycles":4533504,"thread_start_us":206138,"threads_started":3,"wal-append.queue_time_us":411749}
I20260709 13:07:37.851756 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.903301 16544 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:37.855654 20001 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 3.661s	user 0.006s	sys 0.029s
I20260709 13:07:37.855751 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.857517 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.903330 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.869935 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:37.904955 16542 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:37.905107 16539 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:37.871721 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.905897 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.906652 16542 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:37.906840 16537 raft_consensus.cc:2410] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:07:37.890651 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84391.8us
I20260709 13:07:37.907976 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.826589 19896 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:37.806162 19991 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:37.664053 20013 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:37.760612 20038 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:37.925153 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.904476 16538 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:37.893165 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:37.926175 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.648422 19939 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:37.911068 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.927214 16540 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:37.914709 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59084.2us
I20260709 13:07:37.928560 16585 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:37.900457 16536 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:37.913812 16542 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:37.889554 19947 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.850837 20067 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:37.628367 20027 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:37.939499 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 112356us
I20260709 13:07:37.901925 19885 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:37.943089 19885 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:37.942643 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.944125 19885 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.945593 19885 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.944271 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.948486 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.950711 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.961295 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:37.909075 20104 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.967733 16539 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:37.967658 16541 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:37.969503 16463 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:37.969949 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:37.922114 19991 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.909912 20074 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:37.997380 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.098608 16540 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:37.915696 19878 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.914850 20094 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.007107 16538 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:38.018405 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:38.020107 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:38.109762 16465 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:38.008571 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.110224 16541 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:37.935037 19994 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:38.085671 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:38.113612 16469 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
W20260709 13:07:37.998850 20001 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:38.091818 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:37.963033 19868 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:38.128582 16539 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 4.
I20260709 13:07:38.019346 20012 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.177309 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:38.178016 20012 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.121860 20067 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.178447 20012 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.178784 20067 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:37.911972 19964 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:07:38.182737 19868 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.183275 19868 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.185376 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 418) took 3408 ms. Trace:
I20260709 13:07:38.185756 16468 rpcz_store.cc:276] 0709 13:07:34.777977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.665683 (+887706us) service_pool.cc:224] Handling call
0709 13:07:35.681097 (+ 15414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:35.990121 (+309024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.185161 (+2195040us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002a7bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:38.185322 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441362176}
I20260709 13:07:38.124795 19994 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.175542 20106 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.113517 19464 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:38.190654 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.085129 19953 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:38.093415 20079 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.187649 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:38.263725 16543 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:38.187835 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 271261us
I20260709 13:07:38.188496 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:38.092801 20111 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:38.177412 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.191373 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:37.941216 20038 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.264526 16540 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.123044 20088 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:38.105942 19976 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:38.372992 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:38.373782 16613 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:38.333369 16462 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:38.126472 20042 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.277568 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:38.258852 19595 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.005921 20009 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.392839 16538 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.274106 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 415) took 4031 ms. Trace:
W20260709 13:07:38.394687 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 433443us
W20260709 13:07:38.265535 20085 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
W20260709 13:07:38.405375 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 476843us
I20260709 13:07:38.399343 16461 rpcz_store.cc:276] 0709 13:07:34.242960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.243106 (+   146us) service_pool.cc:224] Handling call
0709 13:07:34.267808 (+ 24702us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.291130 (+ 23322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.291170 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:34.291715 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 13:07:37.163981 (+2872266us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b18000d6060. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:37.289333 (+125352us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.614437 (+325104us) log.cc:844] Serialized 14 byte log entry
0709 13:07:37.753611 (+139174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.753733 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.115065 (+361332us) raft_consensus.cc:1685] finished
0709 13:07:38.125082 (+ 10017us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.274017 (+148935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202018,"prepare.queue_time_us":157149,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":183771,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":13472,"spinlock_wait_cycles":3111296,"thread_start_us":380101,"threads_started":2,"wal-append.queue_time_us":3158109}
I20260709 13:07:38.402279 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:38.411075 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:38.408617 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:38.123860 19878 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.266826 20111 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.265560 20106 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:38.084973 20104 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.124019 20094 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:38.095811 19896 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.328414 19464 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:38.464146 20107 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.364s	user 0.000s	sys 0.000s
I20260709 13:07:38.429359 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:38.398248 16511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.009s	sys 0.011s
W20260709 13:07:38.942934 16511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.022s	sys 0.027s
W20260709 13:07:38.943678 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 1.10038e+06us
I20260709 13:07:38.944593 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:38.465711 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:38.947064 16539 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:38.455950 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 161943us
I20260709 13:07:38.412655 16538 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:38.948817 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2096) took 1596 ms. Trace:
I20260709 13:07:38.949136 16538 rpcz_store.cc:276] 0709 13:07:37.352255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.267464 (+915209us) service_pool.cc:224] Handling call
0709 13:07:38.948740 (+681276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.949206 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.468391 16543 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:38.950385 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:38.950850 16543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 515) took 1759 ms (client timeout 2084 ms). Trace:
I20260709 13:07:38.950980 16538 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:38.951226 16543 rpcz_store.cc:269] 0709 13:07:37.191911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.102299 (+910388us) service_pool.cc:224] Handling call
0709 13:07:38.950797 (+848498us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.951452 16538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1674) took 1762 ms (client timeout 2345 ms). Trace:
W20260709 13:07:38.951843 16538 rpcz_store.cc:269] 0709 13:07:37.188944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.950147 (+1761203us) service_pool.cc:224] Handling call
0709 13:07:38.951405 (+  1258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.374346 19976 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:38.953689 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2103) took 1599 ms (client timeout 1951 ms). Trace:
W20260709 13:07:38.957109 16462 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.015s
I20260709 13:07:38.438174 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:38.956983 16540 rpcz_store.cc:269] 0709 13:07:37.354304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.099293 (+744989us) service_pool.cc:224] Handling call
0709 13:07:38.953630 (+854337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.958597 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.945865 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:07:38.956343 16433 connection.cc:256] RPC call timeout handler was delayed by -1.8697789880000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
I20260709 13:07:38.957700 16462 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:38.434067 16467 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.005s	sys 0.018s
W20260709 13:07:38.959779 16433 connection.cc:256] RPC call timeout handler was delayed by -1.8337789879999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:07:38.960036 16467 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.005s	sys 0.021s
W20260709 13:07:38.960202 16433 connection.cc:256] RPC call timeout handler was delayed by -1.8319789879999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:07:38.380228 20088 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.962141 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.965946 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:38.966125 16543 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:38.966499 16538 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:38.966589 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2092) took 1631 ms. Trace:
W20260709 13:07:38.967185 16463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.002s
W20260709 13:07:38.967525 16463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.010s	sys 0.002s
W20260709 13:07:38.622964 19984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.003s	sys 0.009s
I20260709 13:07:38.966940 16543 rpcz_store.cc:276] 0709 13:07:37.335436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.961878 (+1626442us) service_pool.cc:224] Handling call
0709 13:07:38.966539 (+  4661us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.630710 19974 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 4.695s	user 0.025s	sys 0.026s
W20260709 13:07:38.968317 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 539017us
W20260709 13:07:38.421239 19721 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.053s	user 0.005s	sys 0.005s
I20260709 13:07:38.393203 20042 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:38.364132 20027 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:38.467283 20057 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 2.072s	user 0.004s	sys 0.008s
I20260709 13:07:38.969558 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:38.962985 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1875) took 1496 ms. Trace:
W20260709 13:07:38.461320 19656 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.003s
I20260709 13:07:38.955420 20026 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:38.401656 19595 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:38.989866 19974 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 5.101s	user 0.030s	sys 0.036s
I20260709 13:07:38.997290 19938 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:38.969746 20088 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:38.999163 19991 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.900s	user 0.006s	sys 0.003s
I20260709 13:07:38.399374 19885 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.578s
I20260709 13:07:39.006384 20075 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.183913 16540 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 12 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:39.154314 19896 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.139214 16539 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:39.193372 16539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2097) took 1840 ms (client timeout 2050 ms). Trace:
W20260709 13:07:39.193862 16539 rpcz_store.cc:269] 0709 13:07:37.352521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.465378 (+1112857us) service_pool.cc:224] Handling call
0709 13:07:39.193290 (+727912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.442931 19959 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:39.142498 16543 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:38.473537 19994 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:38.422390 20067 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:38.970577 19984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.003s	sys 0.010s
I20260709 13:07:39.182343 20075 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:38.462209 20074 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:38.422577 20098 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:38.963157 19976 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.142421 16467 rpcz_store.cc:276] 0709 13:07:37.464678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.464843 (+   165us) service_pool.cc:224] Handling call
0709 13:07:37.521702 (+ 56859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.521991 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:37.569699 (+ 47708us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.960713 (+1391014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.960807 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:38.960865 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.960952 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.961098 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114970,"prepare.queue_time_us":80168,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":135067,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8713,"spinlock_wait_cycles":2432,"thread_start_us":1269707,"threads_started":2,"wal-append.queue_time_us":830363}
I20260709 13:07:38.946727 20111 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:39.144824 20107 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:07:39.142997 20042 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.143337 19721 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.469941 19868 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:39.156114 20012 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.977s	user 0.012s	sys 0.000s
I20260709 13:07:39.181414 19993 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:38.437891 20109 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:39.157748 20026 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:39.164669 19867 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.011s	sys 0.023s
I20260709 13:07:39.202749 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:39.246549 16539 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.205818 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.151517 16538 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:39.247391 16538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2088) took 1913 ms (client timeout 2526 ms). Trace:
W20260709 13:07:39.247949 16538 rpcz_store.cc:269] 0709 13:07:37.334249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.963259 (+1629010us) service_pool.cc:224] Handling call
0709 13:07:39.247329 (+284070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.165673 19920 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.187294 19938 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.215190 20067 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.185005 19991 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.222793 20098 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:39.221280 19987 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 5.202s	user 0.022s	sys 0.028s
I20260709 13:07:39.246572 17126 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:07:39.247900 19867 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.011s	sys 0.024s
I20260709 13:07:39.336241 19885 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:39.339175 20140 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.250777 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2100) took 1897 ms. Trace:
I20260709 13:07:39.339771 16543 rpcz_store.cc:276] 0709 13:07:37.353381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.205517 (+1852136us) service_pool.cc:224] Handling call
0709 13:07:39.250703 (+ 45186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:39.339944 17090 connection.cc:256] RPC call timeout handler was delayed by -1.9138343859999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 13:07:39.340410 17090 connection.cc:256] RPC call timeout handler was delayed by -1.8930528629999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:07:39.340687 17090 connection.cc:256] RPC call timeout handler was delayed by -1.5941274719999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:07:39.340758 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.157616 19656 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.251605 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.342695 16538 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:39.224422 19994 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.250241 20075 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.253257 16470 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:39.247997 20026 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:39.331370 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 893520us
W20260709 13:07:39.296792 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 350979us
W20260709 13:07:39.310379 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 349269us
W20260709 13:07:39.297825 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 290765us
W20260709 13:07:39.304101 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 146572us
I20260709 13:07:39.342268 19878 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:39.351519 20131 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:07:39.355159 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:39.355288 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:39.251961 20109 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.209066 20106 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.243993 20012 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.254987 20074 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.321722 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:39.368047 16619 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.315896 16539 raft_consensus.cc:2410] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:39.341360 16543 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:39.370167 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.253857 19920 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.338984 19885 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.345381 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:39.374655 16538 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.374820 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:39.350653 20128 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:07:39.198427 19464 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.356005 16461 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:39.395183 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:39.395887 16461 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.355396 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:39.356694 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:39.356091 16433 connection.cc:256] RPC call timeout handler was delayed by -1.732078988000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:07:39.398463 16433 connection.cc:256] RPC call timeout handler was delayed by -1.6834789879999335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:07:39.344974 20133 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:07:39.363606 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1653) took 5135 ms. Trace:
I20260709 13:07:39.363592 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:39.402956 16465 raft_consensus.cc:2368] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:07:39.365561 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:39.364681 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 429) took 1341 ms. Trace:
W20260709 13:07:39.371953 16511 connection.cc:256] RPC call timeout handler was delayed by -1.6060203920000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:07:39.404959 16511 connection.cc:256] RPC call timeout handler was delayed by -1.5871203919999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:07:39.405447 16511 connection.cc:256] RPC call timeout handler was delayed by -1.5367203920000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:07:39.405772 16511 connection.cc:256] RPC call timeout handler was delayed by -1.3828203919999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 13:07:39.375586 16467 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
W20260709 13:07:39.406061 16511 connection.cc:256] RPC call timeout handler was delayed by -1.2568203920000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
I20260709 13:07:39.378916 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2091) took 2043 ms. Trace:
I20260709 13:07:39.379273 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:39.406479 16539 rpcz_store.cc:276] 0709 13:07:37.335089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.202430 (+1867341us) service_pool.cc:224] Handling call
0709 13:07:39.378857 (+176427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.407768 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.379457 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.409148 17125 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:39.404417 16463 rpcz_store.cc:276] 0709 13:07:38.024357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.099009 (+ 74652us) service_pool.cc:224] Handling call
0709 13:07:38.099312 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.099626 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.099653 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.100070 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.462618 (+362548us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b18000a0780. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:38.968081 (+505463us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:39.321475 (+353394us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.323470 (+  1995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.323573 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.354489 (+ 30916us) raft_consensus.cc:1685] finished
0709 13:07:39.364512 (+ 10023us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.364631 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141070,"raft.queue_time_us":13095,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":11012,"spinlock_wait_cycles":22343040,"thread_start_us":679945,"threads_started":2,"wal-append.queue_time_us":1128109}
I20260709 13:07:39.379601 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.378944 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.380110 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:39.410310 16469 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.345050 19994 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:39.343839 20067 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:07:39.417900 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62608.7us
I20260709 13:07:39.418593 16461 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:39.391147 16538 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:39.357991 19985 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 5.213s	user 0.031s	sys 0.029s
I20260709 13:07:39.361274 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:39.402631 16545 rpcz_store.cc:276] 0709 13:07:34.228103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.236873 (+  8770us) service_pool.cc:224] Handling call
0709 13:07:34.237234 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:34.337011 (+ 99777us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:35.794295 (+1457284us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.199148 (+404853us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.228840 (+ 29692us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:36.229576 (+   736us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.229749 (+   173us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:36.234445 (+  4696us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.234712 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.234815 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.252616 (+ 17801us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b480021e058. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:07:37.544103 (+1291487us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b180034e9a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:38.181634 (+637531us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b480021e058. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:07:38.466691 (+285057us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:39.363395 (+896704us) raft_consensus.cc:1685] finished
0709 13:07:39.363415 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.363555 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49636,"prepare.queue_time_us":1674290,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":6648,"raft.queue_time_us":315966,"raft.run_cpu_time_us":37719,"raft.run_wall_time_us":3679959,"spinlock_wait_cycles":61032704,"thread_start_us":1784638,"threads_started":3,"wal-append.queue_time_us":569641}
W20260709 13:07:39.398908 16433 connection.cc:256] RPC call timeout handler was delayed by -1.6132789879999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:07:39.419781 16433 connection.cc:256] RPC call timeout handler was delayed by -1.6123789879999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:07:39.419934 17122 raft_consensus.cc:2410] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:07:39.420131 16433 connection.cc:256] RPC call timeout handler was delayed by -1.569178987999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260709 13:07:39.420392 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:39.420423 16433 connection.cc:256] RPC call timeout handler was delayed by -1.3549789879999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:07:39.421509 16433 connection.cc:256] RPC call timeout handler was delayed by -1.3306789879999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:07:39.421519 16545 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:39.342049 19721 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.408560 16619 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:39.378746 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.409868 16511 leader_election.cc:400] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8.
I20260709 13:07:39.414091 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:39.414557 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.381376 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.422991 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:39.421799 16433 connection.cc:256] RPC call timeout handler was delayed by -1.2343499059999203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:07:39.423594 16433 connection.cc:256] RPC call timeout handler was delayed by -1.2243425620000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21610000000000001s for a response
I20260709 13:07:39.382565 20074 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.429629 17127 raft_consensus.cc:2410] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:39.380668 19595 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.430145 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:39.430985 16433 connection.cc:256] RPC call timeout handler was delayed by -1.1508643079999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:07:39.431378 16433 connection.cc:256] RPC call timeout handler was delayed by -1.1267227029999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260709 13:07:39.431694 16433 connection.cc:256] RPC call timeout handler was delayed by -1.0570789879999438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2526s for a response
I20260709 13:07:39.434195 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.435918 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:39.437395 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.439050 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.440265 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.442505 17119 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:39.443109 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.348541 20140 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.411324 20094 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:39.423185 19985 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 5.437s	user 0.031s	sys 0.029s
W20260709 13:07:39.451334 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 93102.3us
I20260709 13:07:39.417186 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:39.439949 20137 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.418699 20125 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.436685 19867 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.452311 19595 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.443763 16545 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 4.
I20260709 13:07:39.481638 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.358036 20098 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.477084 16543 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:39.442752 19868 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:39.455788 16469 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:39.489243 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:39.489682 17120 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:39.453321 20027 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.445468 19959 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:39.524571 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.524714 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 105906us
I20260709 13:07:39.429636 19721 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:39.528513 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 105584us
W20260709 13:07:39.546764 20127 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:07:39.530208 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.569798 16545 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:39.571147 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.474076 19991 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.429966 20067 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.575305 20067 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:39.536307 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.577111 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:39.578470 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.579147 17120 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:39.496795 19595 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.582715 19595 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:39.504659 20094 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:07:39.477840 20137 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.584460 20137 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.477931 20012 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.412794 19938 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.482785 17118 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.545179 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.593734 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.594225 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.489348 20139 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.595093 20139 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:39.595631 20139 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.469626 19984 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:39.548208 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 109238us
I20260709 13:07:39.604079 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.496986 20136 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.494679 20104 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.566851 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.607780 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.611490 16511 leader_election.cc:400] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:07:39.611846 16511 leader_election.cc:403] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:39.441854 20074 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:39.567627 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 193862us
I20260709 13:07:39.487826 19867 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.614444 20074 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:39.543403 20157 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.491773 20148 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:07:39.618036 16545 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:39.623899 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1681) took 2433 ms. Trace:
I20260709 13:07:39.623745 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.624529 16545 rpcz_store.cc:276] 0709 13:07:37.190416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.572389 (+2381973us) service_pool.cc:224] Handling call
0709 13:07:39.572734 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.623560 (+ 50826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.623826 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.625788 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.626503 16545 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:39.627403 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 513) took 2435 ms. Trace:
I20260709 13:07:39.628216 16545 rpcz_store.cc:276] 0709 13:07:37.191469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.625756 (+2434287us) service_pool.cc:224] Handling call
0709 13:07:39.626207 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.627080 (+   873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.627333 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:39.547029 20149 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:39.567261 20018 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 5.048s	user 0.012s	sys 0.044s
I20260709 13:07:39.622807 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:39.630151 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 66574.7us
I20260709 13:07:39.638140 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:39.494936 20125 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.506174 19994 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.619653 19991 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.674522 17118 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:39.621459 19656 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.639068 19984 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.639305 20012 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.629654 19595 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:39.678097 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.639341 20067 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:07:39.685626 17118 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:39.688395 19937 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:07:39.684669 16433 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 2.195s (SENT)
I20260709 13:07:39.690003 17125 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:39.690023 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2066) took 1316 ms. Trace:
I20260709 13:07:39.478626 20109 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.692986 16615 rpcz_store.cc:276] 0709 13:07:38.373412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.375697 (+  2285us) service_pool.cc:224] Handling call
0709 13:07:38.375980 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.398147 (+ 22167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.398178 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.398762 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.619899 (+221137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:38.619965 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.620065 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.689812 (+1069747us) raft_consensus.cc:1685] finished
0709 13:07:39.689830 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.689964 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6735,"raft.queue_time_us":6994,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9100,"thread_start_us":187032,"threads_started":1,"wal-append.queue_time_us":834346}
I20260709 13:07:39.669148 20158 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.689355 19994 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:39.703972 20147 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:07:39.704473 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.679700 19920 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.689517 20156 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:39.681756 19984 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:39.684126 19867 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:39.706485 20145 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:39.710877 19974 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:07:39.716322 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:39.693930 19991 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:39.702898 19885 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:39.727591 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:39.705240 20158 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:39.629457 20157 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:39.720425 19984 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.702641 20148 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:07:39.713060 20156 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.740535 20158 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.742360 20075 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:39.743221 20045 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:39.743391 16582 connection.cc:256] RPC call timeout handler was delayed by -1.6697978920000196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:07:39.724403 19595 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:39.772280 16582 connection.cc:256] RPC call timeout handler was delayed by -1.586097891999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260709 13:07:39.749341 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64691.2us
I20260709 13:07:39.731763 19937 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:39.741073 20094 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.737821 20151 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:07:39.774323 16582 connection.cc:256] RPC call timeout handler was delayed by -1.1486978919999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23450000000000004s for a response
I20260709 13:07:39.740134 20121 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:39.782915 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:39.780170 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 157429us
I20260709 13:07:39.782533 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:39.710955 20138 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:07:39.749404 19721 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.732739 19991 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:39.799687 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.802932 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:39.803902 19954 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:39.775377 19937 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.804576 20026 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:39.805529 20060 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 2.894s	user 0.013s	sys 0.007s
I20260709 13:07:39.806123 20157 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.805820 19937 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.806708 20026 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.807045 19937 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.781188 20151 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:39.808037 20151 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.809239 20151 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:39.810289 19970 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:39.806720 16538 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.810561 19984 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.813378 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1677) took 2623 ms. Trace:
I20260709 13:07:39.813735 16538 rpcz_store.cc:276] 0709 13:07:37.189600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.420684 (+2231084us) service_pool.cc:224] Handling call
0709 13:07:39.420967 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:39.811162 (+390195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.813144 (+  1982us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54002904d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:39.813319 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886727936}
I20260709 13:07:39.780979 20094 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.844569 20094 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:39.800333 20150 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.104s	user 0.004s	sys 0.001s
W20260709 13:07:39.798552 20162 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.066s	user 0.004s	sys 0.004s
I20260709 13:07:39.843020 20062 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.844053 17120 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:39.861999 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:39.798110 20121 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:39.840982 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:39.865478 16538 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:39.804324 19954 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.775441 19595 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:39.843071 20164 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:39.802543 19540 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.776037 20075 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:39.868569 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:39.877470 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:39.878276 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.879084 16544 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:39.877465 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.863977 19984 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:39.867252 20121 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:39.803257 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:39.871102 19954 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.879851 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.871357 19974 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.872474 20156 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:39.874451 19540 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:40.018812 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.022665 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:40.017041 16614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2034) took 6657 ms (client timeout 1515 ms). Trace:
I20260709 13:07:39.947870 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:40.088215 16614 rpcz_store.cc:269] 0709 13:07:33.359389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.359500 (+   111us) service_pool.cc:224] Handling call
0709 13:07:40.016802 (+6657302us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54002490d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.016955 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5326539136}
I20260709 13:07:39.964349 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:39.930119 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.091102 16538 raft_consensus.cc:2376] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10. Re-sending same reply.
I20260709 13:07:40.016417 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 514) took 2824 ms. Trace:
I20260709 13:07:39.930070 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:39.911950 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:40.093487 17120 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:39.987290 17125 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:40.057423 16541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2076) took 2851 ms (client timeout 2195 ms). Trace:
W20260709 13:07:40.021708 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.955556 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:40.089649 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 125415us
I20260709 13:07:40.096747 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:40.092294 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.100575 16538 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.091789 16545 rpcz_store.cc:276] 0709 13:07:37.191690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.630178 (+2438488us) service_pool.cc:224] Handling call
0709 13:07:39.630501 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:39.729330 (+ 98829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.729377 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:39.737388 (+  8011us) log.cc:844] Serialized 52 byte log entry
0709 13:07:39.875223 (+137835us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:39.911248 (+ 36025us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.911556 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.911664 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.016189 (+104525us) raft_consensus.cc:1685] finished
0709 13:07:40.016209 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.016354 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32889,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":103642,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":17146,"thread_start_us":159138,"threads_started":2,"wal-append.queue_time_us":226934}
I20260709 13:07:40.103365 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.103893 16545 raft_consensus.cc:2376] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8. Re-sending same reply.
I20260709 13:07:40.089607 16536 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:40.020872 16583 connection.cc:256] RPC call timeout handler was delayed by -1.4632989039999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:07:40.105584 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:40.105765 16583 connection.cc:256] RPC call timeout handler was delayed by -1.3300989040000104s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:07:40.106225 16583 connection.cc:256] RPC call timeout handler was delayed by -1.0537989040000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:07:40.106321 16545 raft_consensus.cc:2376] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7. Re-sending same reply.
W20260709 13:07:40.106685 16583 connection.cc:256] RPC call timeout handler was delayed by -1.0042989039999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:07:40.094861 16541 rpcz_store.cc:269] 0709 13:07:37.205651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.057203 (+2851552us) service_pool.cc:211] Skipping call since client already timed out
0709 13:07:40.057336 (+   133us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:07:40.108062 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:40.112165 17118 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:40.108994 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:40.114575 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:40.109405 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.930269 20154 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:07:39.968538 20163 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:40.107594 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:39.959252 20164 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:40.121666 16614 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:40.018489 20108 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 1.833s	user 0.000s	sys 0.009s
I20260709 13:07:39.880517 19595 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:39.937105 20026 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.882318 20140 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:39.883378 20125 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.142198 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.142817 16541 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 4.
I20260709 13:07:39.880976 20168 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.885255 20088 consensus_meta.cc:287] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.700s	user 0.007s	sys 0.003s
I20260709 13:07:40.022444 20138 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.132018 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:40.108783 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:40.109473 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:40.137239 17120 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:40.138048 16583 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:40.136677 16536 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:40.131047 16614 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:40.150406 16618 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:40.138970 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:39.961265 19984 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:40.003391 19719 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.091324 19723 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:40.140293 17118 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.151221 16545 raft_consensus.cc:2376] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8. Re-sending same reply.
I20260709 13:07:40.157891 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.151113 16614 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.158586 16545 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:40.127100 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.122215 20003 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.129526 20167 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:40.153366 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.153393 16538 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:40.152344 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:39.885164 20174 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.269s
I20260709 13:07:40.161592 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.156128 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.158735 16614 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.166085 16538 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:40.167213 16545 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:40.167526 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 516) took 2975 ms. Trace:
I20260709 13:07:40.167898 16538 rpcz_store.cc:276] 0709 13:07:37.192118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.165423 (+2973305us) service_pool.cc:224] Handling call
0709 13:07:40.165803 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.167276 (+  1473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.167456 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.108922 19974 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.162940 16541 raft_consensus.cc:2376] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10. Re-sending same reply.
I20260709 13:07:40.180052 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 517) took 2987 ms. Trace:
I20260709 13:07:40.179373 17120 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.180553 16545 rpcz_store.cc:276] 0709 13:07:37.192324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.166680 (+2974356us) service_pool.cc:224] Handling call
0709 13:07:40.166991 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.169549 (+  2558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.179979 (+ 10430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.157202 19719 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.139513 20013 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:40.158171 19991 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.193310 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.200410 16538 raft_consensus.cc:2376] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7. Re-sending same reply.
I20260709 13:07:40.195528 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2067) took 1821 ms. Trace:
I20260709 13:07:40.202324 16617 rpcz_store.cc:276] 0709 13:07:38.373709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.373899 (+   190us) service_pool.cc:224] Handling call
0709 13:07:38.411339 (+ 37440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.146614 (+735275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:39.146652 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.147201 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.382264 (+235063us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:39.382319 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.169315 (+786996us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:40.169387 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.169471 (+    84us) raft_consensus.cc:1685] finished
0709 13:07:40.169491 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.195443 (+ 25952us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59625,"raft.queue_time_us":101131,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":8507,"spinlock_wait_cycles":1552630656,"thread_start_us":194920,"threads_started":1,"wal-append.queue_time_us":305552}
I20260709 13:07:40.207433 20038 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.208379 19940 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:40.210760 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 431) took 2100 ms (client timeout 2009 ms). Trace:
W20260709 13:07:40.211272 16470 rpcz_store.cc:269] 0709 13:07:38.111349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.112168 (+   819us) service_pool.cc:224] Handling call
0709 13:07:40.210498 (+2098330us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002a94d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.210674 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462907264}
I20260709 13:07:40.146432 20173 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:07:40.196759 16541 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:40.145496 20026 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.146682 19938 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:40.213685 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 519) took 3020 ms. Trace:
I20260709 13:07:40.168183 20098 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:40.157776 20138 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:40.218277 16541 rpcz_store.cc:276] 0709 13:07:37.192745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.180384 (+2987639us) service_pool.cc:224] Handling call
0709 13:07:40.196541 (+ 16157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.213433 (+ 16892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.213636 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.221678 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.191140 20075 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.152640 20088 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.151794 20168 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.164368 20094 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.164139 20003 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.169878 19984 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:40.235582 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 269063us
I20260709 13:07:40.234047 16544 raft_consensus.cc:2410] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:07:40.263177 16582 leader_election.cc:336] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.992s (SENT)
I20260709 13:07:40.257359 20106 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:40.289295 19896 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.087s	user 0.013s	sys 0.000s
I20260709 13:07:40.322906 19974 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:40.325075 19976 consensus_meta.cc:287] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.087s	user 0.006s	sys 0.006s
I20260709 13:07:40.555125 20013 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.556095 19976 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.517872 16538 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:40.521740 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:40.520290 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1688) took 3096 ms (client timeout 2455 ms). Trace:
W20260709 13:07:40.514671 16462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 425) took 2545 ms (client timeout 1534 ms). Trace:
I20260709 13:07:40.246495 16610 raft_consensus.cc:2410] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:40.556316 20013 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:40.559960 16462 rpcz_store.cc:269] 0709 13:07:37.969452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.969646 (+   194us) service_pool.cc:224] Handling call
0709 13:07:40.514115 (+2544469us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540030b1d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.514382 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717824256}
I20260709 13:07:40.217702 20148 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:07:40.267058 19997 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.323997 20003 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:40.349902 20042 consensus_meta.cc:287] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.109s	user 0.009s	sys 0.004s
I20260709 13:07:40.573793 20042 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.576404 20106 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.577224 20042 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:40.369361 20045 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.589s	user 0.000s	sys 0.018s
W20260709 13:07:40.376632 20062 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.510s	user 0.016s	sys 0.007s
I20260709 13:07:40.578125 20140 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:40.514328 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1786) took 1140 ms. Trace:
I20260709 13:07:40.579391 20140 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.579763 19954 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.579578 16468 rpcz_store.cc:276] 0709 13:07:39.373818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.404385 (+ 30567us) service_pool.cc:224] Handling call
0709 13:07:39.422669 (+ 18284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:39.423006 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:39.504032 (+ 81026us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.700522 (+196490us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:39.711868 (+ 11346us) log.cc:844] Serialized 26 byte log entry
0709 13:07:39.712075 (+   207us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:39.713247 (+  1172us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.715974 (+  2727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.716047 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:40.058278 (+342231us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b18002514a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:40.513306 (+455028us) raft_consensus.cc:1685] finished
0709 13:07:40.513405 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.513907 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23691,"prepare.queue_time_us":60482,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":5080,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":23516,"spinlock_wait_cycles":13227776,"thread_start_us":179800,"threads_started":2,"wal-append.queue_time_us":212997}
I20260709 13:07:40.582947 16539 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:40.584367 19954 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.395644 20137 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.413497 20156 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:40.270892 20139 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.011s
I20260709 13:07:40.365635 20094 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:40.274668 20111 consensus_meta.cc:287] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.034s	user 0.007s	sys 0.010s
I20260709 13:07:40.635025 20111 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.366170 20121 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:40.637663 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.640033 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:40.274916 20149 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.008s
I20260709 13:07:40.642969 20149 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:40.278481 20158 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:07:40.645020 20158 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.370867 20168 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.408823 20169 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:40.656129 17124 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:40.656654 20169 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:40.309703 20177 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:40.661504 20111 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:40.407857 20179 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:07:40.663491 16543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2109) took 2005 ms (client timeout 2216 ms). Trace:
W20260709 13:07:40.663995 16543 rpcz_store.cc:269] 0709 13:07:38.641186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.369898 (+728712us) service_pool.cc:224] Handling call
0709 13:07:40.641756 (+1271858us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002b5554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.646619 (+  4863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244196608}
I20260709 13:07:40.434118 20088 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:40.383450 20101 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 2.201s	user 0.006s	sys 0.004s
I20260709 13:07:40.665604 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.666260 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:40.410797 20105 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 2.233s	user 0.012s	sys 0.011s
I20260709 13:07:40.666751 16543 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:40.387699 20115 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:40.391822 20126 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.153s	user 0.002s	sys 0.000s
I20260709 13:07:40.411705 20079 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:40.253768 20075 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:07:40.532364 16537 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:40.545089 20076 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.313477 19540 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.541433 20174 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.559505 16540 rpcz_store.cc:269] 0709 13:07:37.423388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.958315 (+1534927us) service_pool.cc:224] Handling call
0709 13:07:40.519516 (+1561201us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b5400380c54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.519900 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515368320}
W20260709 13:07:40.577703 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.577912 20118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.347s	user 0.006s	sys 0.006s
I20260709 13:07:40.581776 16545 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 12. Ops: []
I20260709 13:07:40.409273 20138 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:40.590418 19748 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:40.677306 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.677573 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:40.678210 16542 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:40.679118 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.679358 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.680151 16542 raft_consensus.cc:2376] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8. Re-sending same reply.
I20260709 13:07:40.590236 19997 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.683187 19997 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.590794 16541 raft_consensus.cc:2376] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10. Re-sending same reply.
I20260709 13:07:40.685039 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.685815 16541 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:40.686678 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.686924 20106 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:40.687098 16539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2112) took 1739 ms (client timeout 1966 ms). Trace:
I20260709 13:07:40.578289 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:40.595284 17126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 595) took 3096 ms (client timeout 2049 ms). Trace:
W20260709 13:07:40.687906 17126 rpcz_store.cc:269] 0709 13:07:37.498543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.563434 (+ 64891us) service_pool.cc:224] Handling call
0709 13:07:40.594732 (+3031298us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540070f654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.594967 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3759294720}
W20260709 13:07:40.688514 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 425324us
I20260709 13:07:40.689414 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.689545 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.690286 16470 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 6.
I20260709 13:07:40.690552 17126 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:40.690482 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:40.690914 20168 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:40.691494 16465 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:40.597712 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:40.598219 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.568711 20013 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:40.686681 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2105) took 3330 ms (client timeout 1842 ms). Trace:
I20260709 13:07:40.692384 17127 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
W20260709 13:07:40.693163 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.692966 16537 rpcz_store.cc:269] 0709 13:07:37.356206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.925917 (+569711us) service_pool.cc:224] Handling call
0709 13:07:40.686464 (+2760547us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b54002918d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.686604 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5982978432}
I20260709 13:07:40.694000 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:40.694177 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.694449 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.694743 17127 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.694897 16540 raft_consensus.cc:2376] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10. Re-sending same reply.
I20260709 13:07:40.695685 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:40.695849 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.600905 20026 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:40.687573 16539 rpcz_store.cc:269] 0709 13:07:38.947742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.414329 (+466587us) service_pool.cc:224] Handling call
0709 13:07:40.686906 (+1272577us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400291dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.687049 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666493824}
I20260709 13:07:40.613498 20140 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.648453 19723 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:40.697862 20118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.007s	sys 0.006s
I20260709 13:07:40.698151 19723 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:40.647622 16434 connection.cc:256] RPC call timeout handler was delayed by -1.8109646270000894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 13:07:40.680367 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:40.650130 20158 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.653074 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.654866 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:40.640205 20121 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.661664 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2081) took 3439 ms. Trace:
I20260709 13:07:40.709374 17121 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:40.312971 20178 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:40.707818 19723 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.709729 20169 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.710783 19723 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.711274 20169 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:40.713311 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2116) took 1041 ms. Trace:
W20260709 13:07:40.690439 16582 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 2.063s (SENT)
I20260709 13:07:40.711289 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:40.718636 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:40.719266 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.669175 20115 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:40.709780 16538 rpcz_store.cc:276] 0709 13:07:37.222098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.201328 (+2979230us) service_pool.cc:224] Handling call
0709 13:07:40.224071 (+ 22743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.565109 (+341038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.661195 (+ 96086us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001aac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:40.661524 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673348352}
I20260709 13:07:40.670769 20079 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.667236 17118 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.688596 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.688789 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.687454 16541 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:40.698835 16434 connection.cc:256] RPC call timeout handler was delayed by -1.737537649999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 13:07:40.605559 19976 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:40.689550 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.669176 20112 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.691586 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.706048 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:40.705585 20174 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.672468 20139 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.708299 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.698719 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.719419 16464 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.616074 19719 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:40.819329 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.821050 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:40.825670 16434 connection.cc:256] RPC call timeout handler was delayed by -1.7024376499999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:07:40.826062 16434 connection.cc:256] RPC call timeout handler was delayed by -1.6789637499999799s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:07:40.826361 16434 connection.cc:256] RPC call timeout handler was delayed by -1.6097376499999427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
W20260709 13:07:40.826659 16434 connection.cc:256] RPC call timeout handler was delayed by -1.5605402589999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:07:40.793583 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123925us
I20260709 13:07:40.719442 19997 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.831472 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:40.713775 16544 rpcz_store.cc:276] 0709 13:07:39.672145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:39.879623 (+207478us) service_pool.cc:224] Handling call
0709 13:07:40.712943 (+833320us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001e2154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.713107 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336624896}
W20260709 13:07:40.826937 16434 connection.cc:256] RPC call timeout handler was delayed by -1.5431376499999487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21240000000000003s for a response
W20260709 13:07:40.835904 16434 connection.cc:256] RPC call timeout handler was delayed by -1.3592425729999604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:07:40.836339 16434 connection.cc:256] RPC call timeout handler was delayed by -1.1687376500000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.254s for a response
I20260709 13:07:40.776463 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.837152 17119 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:40.842496 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 521) took 3637 ms. Trace:
I20260709 13:07:40.842859 16545 rpcz_store.cc:276] 0709 13:07:37.205211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.181567 (+2976356us) service_pool.cc:224] Handling call
0709 13:07:40.181907 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.697555 (+515648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.842219 (+144664us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400001754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:40.842428 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":918599040}
I20260709 13:07:40.847090 16539 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:40.847711 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2084) took 3602 ms. Trace:
I20260709 13:07:40.847757 20139 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.848086 16539 rpcz_store.cc:276] 0709 13:07:37.245581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.846276 (+3600695us) service_pool.cc:224] Handling call
0709 13:07:40.846660 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.847453 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.847636 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.849025 16462 raft_consensus.cc:2410] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:40.839218 20140 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:40.854352 20051 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.854976 20051 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:40.854769 20140 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.855795 19937 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:40.856204 19937 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:40.844681 16545 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:40.687616 20106 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:40.854027 16469 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:40.862066 17121 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:40.725481 19984 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.867527 20149 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:40.868530 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2101) took 3507 ms. Trace:
I20260709 13:07:40.842108 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:40.866770 17127 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:07:40.870110 16545 rpcz_store.cc:276] 0709 13:07:37.353738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.843764 (+3490026us) service_pool.cc:224] Handling call
0709 13:07:40.844222 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.857957 (+ 13735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.861468 (+  3511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.874975 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:40.869336 16468 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:40.877161 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:40.881685 20174 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.882195 19937 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.856060 20051 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.673467 20076 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.869783 16466 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:40.864650 20106 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:40.720930 20115 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.895044 17126 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:40.859766 19997 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.902667 16543 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:40.833972 20112 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:40.903829 17124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 589) took 3575 ms (client timeout 2061 ms). Trace:
I20260709 13:07:40.889953 20140 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.901460 16461 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:40.734438 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
W20260709 13:07:40.909210 17124 rpcz_store.cc:269] 0709 13:07:37.328718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.328896 (+   178us) service_pool.cc:224] Handling call
0709 13:07:40.898597 (+3569701us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b54006e0ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:40.903688 (+  5091us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6964407552}
W20260709 13:07:40.913517 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 71634.2us
W20260709 13:07:40.915132 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 224822us
I20260709 13:07:40.916608 17122 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:40.918275 17123 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:40.920509 19595 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.010s
I20260709 13:07:40.921406 20055 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:40.921115 19595 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:40.921838 20055 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.922259 20055 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:40.922406 20149 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:40.922923 20149 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.923655 19595 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:40.932282 16539 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.940267 16544 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:07:40.929926 16537 raft_consensus.cc:606] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:40.943478 16541 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
W20260709 13:07:40.943653 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.944594 16545 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:40.945483 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2089) took 3606 ms. Trace:
I20260709 13:07:40.945896 16544 rpcz_store.cc:276] 0709 13:07:37.334530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.835273 (+3500743us) service_pool.cc:224] Handling call
0709 13:07:40.896892 (+ 61619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:40.940999 (+ 44107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.941260 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.947121 17119 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:40.948661 16537 raft_consensus.cc:614] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:40.942996 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1686) took 3515 ms. Trace:
I20260709 13:07:40.952879 16539 rpcz_store.cc:276] 0709 13:07:37.422764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.850720 (+3427956us) service_pool.cc:224] Handling call
0709 13:07:40.896511 (+ 45791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.936988 (+ 40477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.937594 (+   606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.944017 16541 pending_rounds.cc:85] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 3
I20260709 13:07:40.948203 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:40.930768 19937 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:40.959367 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.954643 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:40.966188 16462 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.954802 20172 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.967840 20172 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:40.975735 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 518) took 3692 ms. Trace:
I20260709 13:07:40.956112 16541 pending_rounds.cc:107] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:07:40.976679 16541 raft_consensus.cc:2889] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.980847 16611 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
W20260709 13:07:40.724973 20075 consensus_queue.cc:1175] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98881185daee4f13b69385e36026216c" responder_term: 8 status { last_received { term: 7 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:40.985648 16538 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:40.986327 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2085) took 3700 ms. Trace:
I20260709 13:07:40.986655 16538 rpcz_store.cc:276] 0709 13:07:37.286274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.977124 (+3690850us) service_pool.cc:224] Handling call
0709 13:07:40.985246 (+  8122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.986075 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.986272 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.987978 16538 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:40.992945 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2087) took 3659 ms. Trace:
I20260709 13:07:40.993515 16542 rpcz_store.cc:276] 0709 13:07:37.333920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.991466 (+3657546us) service_pool.cc:224] Handling call
0709 13:07:40.992064 (+   598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.992440 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.992496 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.992587 (+    91us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:40.992647 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.992729 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.992874 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:40.996016 16542 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:40.988564 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1690) took 1529 ms. Trace:
I20260709 13:07:40.997525 16538 rpcz_store.cc:276] 0709 13:07:39.459643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.987468 (+1527825us) service_pool.cc:224] Handling call
0709 13:07:40.987814 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.988348 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.988513 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:40.998852 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50411.2us
I20260709 13:07:41.006781 16544 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:41.008582 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 134848us
I20260709 13:07:41.011837 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1691) took 1527 ms. Trace:
I20260709 13:07:41.012372 16542 rpcz_store.cc:276] 0709 13:07:39.474611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.995220 (+1520609us) service_pool.cc:224] Handling call
0709 13:07:40.995696 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.001675 (+  5979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.001914 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.018242 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 524) took 1867 ms. Trace:
I20260709 13:07:41.019232 16544 rpcz_store.cc:276] 0709 13:07:39.141087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.961114 (+1820027us) service_pool.cc:224] Handling call
0709 13:07:41.001234 (+ 40120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.007253 (+  6019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.008840 (+  1587us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:41.022840 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.999717 20115 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:41.033609 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.011023 19997 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:40.976167 16536 rpcz_store.cc:276] 0709 13:07:37.192538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.166400 (+2973862us) service_pool.cc:224] Handling call
0709 13:07:40.192525 (+ 26125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.192979 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:40.202367 (+  9388us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.675232 (+472865us) log.cc:844] Serialized 14 byte log entry
0709 13:07:40.836159 (+160927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:40.839893 (+  3734us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:40.866280 (+ 26387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:40.866354 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:40.884476 (+ 18122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76843,"prepare.queue_time_us":45298,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":111,"raft.queue_time_us":39777,"raft.run_cpu_time_us":616,"raft.run_wall_time_us":161523,"thread_start_us":102464,"threads_started":1,"wal-append.queue_time_us":505175}
I20260709 13:07:40.998361 19976 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.037633 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2098) took 3678 ms. Trace:
I20260709 13:07:41.048925 16541 rpcz_store.cc:276] 0709 13:07:37.352788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.836480 (+3483692us) service_pool.cc:224] Handling call
0709 13:07:40.896934 (+ 60454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.030395 (+133461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.030671 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:41.052572 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.022450 20140 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.017889 19719 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.055821 16537 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.062232 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1694) took 1586 ms. Trace:
I20260709 13:07:41.062669 16537 rpcz_store.cc:276] 0709 13:07:39.475604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.021084 (+1545480us) service_pool.cc:224] Handling call
0709 13:07:41.051391 (+ 30307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.061952 (+ 10561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.062163 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.067802 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1687) took 3643 ms. Trace:
I20260709 13:07:41.069583 16612 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.069701 16462 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:41.071823 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:41.071918 16611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2057) took 3875 ms (client timeout 1842 ms). Trace:
I20260709 13:07:41.072513 20045 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:41.072594 16611 rpcz_store.cc:269] 0709 13:07:37.196158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.243420 (+ 47262us) service_pool.cc:224] Handling call
0709 13:07:41.071620 (+3828200us) spinlock_profiling.cc:243] Waited 3.72 s on lock 0x7b54003db154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:41.071810 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8566423936}
I20260709 13:07:41.076717 20112 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.076884 19896 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:41.081002 19896 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.035653 19595 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:41.085003 19896 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.086542 19896 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.068351 16545 rpcz_store.cc:276] 0709 13:07:37.423107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.871126 (+3448019us) service_pool.cc:224] Handling call
0709 13:07:40.907208 (+ 36082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.953992 (+ 46784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.063152 (+109160us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54002b7854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:41.066864 (+  3712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47112960}
I20260709 13:07:41.087937 16469 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:41.088128 16545 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.088909 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1700) took 1131 ms. Trace:
I20260709 13:07:41.089242 16545 rpcz_store.cc:276] 0709 13:07:39.957906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.087496 (+1129590us) service_pool.cc:224] Handling call
0709 13:07:41.087875 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.088641 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.088853 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:41.090718 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.093349 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.093871 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.094614 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.094471 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:41.096011 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.067682 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.090600 16545 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.097218 17126 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.097932 16542 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:41.029292 20106 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.102057 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.103160 16611 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:41.103119 20106 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.110723 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1701) took 1102 ms. Trace:
W20260709 13:07:41.103444 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 165209us
I20260709 13:07:41.111326 16545 rpcz_store.cc:276] 0709 13:07:40.001583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.090024 (+1088441us) service_pool.cc:224] Handling call
0709 13:07:41.090383 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.103919 (+ 13536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.104184 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.112840 16464 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
W20260709 13:07:41.114912 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.111084 19595 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:41.127179 20172 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.127399 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.127584 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.129310 16610 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:41.130442 20139 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.131265 20139 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.134187 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.135088 16469 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:41.135355 16470 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.136407 16468 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.137007 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.138134 16462 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.138969 16463 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.139801 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.137027 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.141255 16470 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:41.142072 20139 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.142982 16469 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.147984 20055 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:41.149474 16433 leader_election.cc:336] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.515s (SENT)
I20260709 13:07:41.151768 16469 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:41.158541 16536 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:41.161073 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 245495us
I20260709 13:07:41.109891 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1693) took 1634 ms. Trace:
I20260709 13:07:41.172659 16542 rpcz_store.cc:276] 0709 13:07:39.475316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.013416 (+1538100us) service_pool.cc:224] Handling call
0709 13:07:41.064205 (+ 50789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.109538 (+ 45333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.109816 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:41.172108 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 60055.1us
I20260709 13:07:41.107494 20140 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:41.180642 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1696) took 1704 ms. Trace:
I20260709 13:07:41.181162 16536 rpcz_store.cc:276] 0709 13:07:39.476166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.047057 (+1570891us) service_pool.cc:224] Handling call
0709 13:07:41.158113 (+111056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.180386 (+ 22273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.180582 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.175257 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.183454 17126 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:41.188748 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.190846 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.210068 16610 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:41.212541 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.213550 16509 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:41.215741 16541 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.216404 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1698) took 1259 ms. Trace:
I20260709 13:07:41.216728 16541 rpcz_store.cc:276] 0709 13:07:39.957226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.064004 (+1106778us) service_pool.cc:224] Handling call
0709 13:07:41.185923 (+121919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.216167 (+ 30244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.216349 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.163859 19976 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.182737 19937 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.220834 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:41.183152 20076 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.231679 16469 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:07:41.218706 20169 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.001s
I20260709 13:07:41.227833 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.234699 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1798) took 1268 ms. Trace:
W20260709 13:07:41.234776 20189 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:07:41.235461 20026 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.235913 20174 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.124686 19595 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.235785 20140 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:41.237747 16436 connection.cc:256] RPC call timeout handler was delayed by -1.8945728720000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:07:41.226714 20158 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.240087 16614 rpcz_store.cc:276] 0709 13:07:39.951521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.112185 (+160664us) service_pool.cc:224] Handling call
0709 13:07:40.121533 (+  9348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:40.675919 (+554386us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:40.879333 (+203414us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.186280 (+306947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.186351 (+    71us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:41.186423 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.204715 (+ 18292us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.219786 (+ 15071us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21252,"prepare.queue_time_us":92119,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":4353,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":16482,"thread_start_us":270379,"threads_started":1}
I20260709 13:07:41.245031 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.258796 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:41.266113 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.269971 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:41.272607 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 289691us
I20260709 13:07:41.239369 19937 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.275561 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.283301 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:41.283881 16464 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.269014 19984 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.290077 16463 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:41.285562 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 136293us
I20260709 13:07:41.291567 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.294201 16470 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:41.297906 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.263612 20174 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.282372 20026 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:41.287843 19719 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:41.276894 20169 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:07:41.308346 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.309378 16614 raft_consensus.cc:2368] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
W20260709 13:07:41.307175 17090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.602s (SENT) [suppressed 43 similar messages]
I20260709 13:07:41.316730 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.325572 16463 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.298692 19984 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.355060 19984 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.323145 19719 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:41.356758 19719 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:41.358752 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 154988us
I20260709 13:07:41.359280 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.360463 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:41.361990 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:41.362273 16368 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.363999 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:41.364981 20149 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.366677 20026 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.367413 20149 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.368420 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.369441 16611 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:41.370422 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.317106 20173 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.371240 20173 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.371773 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.373167 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.373665 20173 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:41.374913 17118 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.004s
I20260709 13:07:41.375337 17118 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:41.333284 17119 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:41.337757 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.377187 16468 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.378975 20051 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:41.380115 20051 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:41.338312 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:41.381201 20112 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.381394 17125 raft_consensus.cc:2410] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:41.381662 20112 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.382477 19937 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.383132 20055 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.382817 20112 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.384462 20112 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:41.341889 19723 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.631s	user 0.013s	sys 0.000s
W20260709 13:07:41.343739 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 136495us
I20260709 13:07:41.397650 19976 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.336612 16462 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:41.320255 16433 leader_election.cc:336] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.538s (SENT)
W20260709 13:07:41.360801 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.400059 16464 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.370487 16617 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.403695 16470 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:41.399300 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:41.409312 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.410642 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.411119 16467 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:41.381387 20190 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:07:41.339854 16465 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:07:41.329988 20137 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:07:41.414482 20137 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.414594 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2082) took 4183 ms. Trace:
I20260709 13:07:41.415107 20137 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.416919 19976 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.417495 19976 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.417661 16368 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:41.419644 16368 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.390632 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:41.460917 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 70442.7us
I20260709 13:07:41.462934 20169 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.463663 20169 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:41.463781 20111 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:41.465128 20169 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.465886 16610 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.467924 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.468815 16610 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:41.469251 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.469934 16617 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:41.392391 20174 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.303030 20079 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.471776 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.472411 20079 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.472488 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.384927 19896 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.473268 16610 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.473326 19896 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.473565 16611 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:41.474437 19896 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.475828 19896 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.412940 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:41.477413 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64588.3us
I20260709 13:07:41.478518 20111 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:41.478483 20115 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:41.479151 20111 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:41.479624 20111 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.480408 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.421434 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1692) took 1946 ms. Trace:
I20260709 13:07:41.390304 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.423538 20137 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.425624 16463 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:41.486267 20009 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:41.486747 20009 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.487152 20009 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:41.487211 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.487637 20111 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.488973 20076 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.489419 20076 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.489794 20076 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.490458 20111 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.415145 16540 rpcz_store.cc:276] 0709 13:07:37.231117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.814657 (+3583540us) service_pool.cc:224] Handling call
0709 13:07:40.868431 (+ 53774us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:40.872006 (+  3575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:40.872044 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:40.872678 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:07:41.016398 (+143720us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:07:41.016441 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.016508 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.414319 (+397811us) raft_consensus.cc:1685] finished
0709 13:07:41.414353 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.414524 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2391,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":21792,"thread_start_us":143313,"threads_started":1,"wal-append.queue_time_us":331065}
I20260709 13:07:41.429136 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:41.493525 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 104048us
I20260709 13:07:41.494248 16465 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:41.429661 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.495318 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.495393 16464 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.494926 16368 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 5 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.496194 16465 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:41.496331 20149 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.496995 20149 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.499158 20149 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.430212 16434 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:41.430377 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.501052 16470 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:41.431447 16462 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:41.431509 16468 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.432281 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.444049 19997 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.444983 19984 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:41.503146 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 73035.4us
I20260709 13:07:41.504060 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.505659 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.488548 16538 rpcz_store.cc:276] 0709 13:07:39.475009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.998299 (+1523290us) service_pool.cc:224] Handling call
0709 13:07:41.044614 (+ 46315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.102869 (+ 58255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.102927 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.103541 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.260653 (+157112us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:41.260699 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.260812 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.421215 (+160403us) raft_consensus.cc:1685] finished
0709 13:07:41.421237 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.421372 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87177,"raft.queue_time_us":45526,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":17230,"thread_start_us":98929,"threads_started":1,"wal-append.queue_time_us":200964}
I20260709 13:07:41.511555 16614 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:41.388590 17093 leader_election.cc:400] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
I20260709 13:07:41.513291 17093 leader_election.cc:403] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.358644 16469 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:41.451154 19976 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:41.470422 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.488039 16463 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:41.369469 16367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 171) took 21056 ms (client timeout 15000 ms). Trace:
W20260709 13:07:41.501438 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 137548us
I20260709 13:07:41.536273 16616 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:41.521170 16368 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.545456 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 526) took 2118 ms. Trace:
W20260709 13:07:41.545594 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 157171us
I20260709 13:07:41.550102 19954 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:41.550578 20055 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:41.551563 19954 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:41.552060 19954 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.552886 19997 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.553956 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.552983 20139 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.547132 20079 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.546015 16539 rpcz_store.cc:276] 0709 13:07:39.426900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.962720 (+1535820us) service_pool.cc:224] Handling call
0709 13:07:41.020918 (+ 58198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.059455 (+ 38537us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:41.071363 (+ 11908us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.536614 (+465251us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.545110 (+  8496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.545167 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:41.545217 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.545288 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.545402 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16406,"prepare.queue_time_us":26043,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":88,"raft.queue_time_us":55253,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1094,"thread_start_us":426849,"threads_started":2,"wal-append.queue_time_us":232911}
I20260709 13:07:41.558741 19984 raft_consensus.cc:2764] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:07:41.571251 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.566896 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 163745us
I20260709 13:07:41.574131 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.558976 20139 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:41.569181 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:41.572077 16368 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.583108 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1695) took 2107 ms. Trace:
I20260709 13:07:41.591419 20076 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.568050 20009 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.593716 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.594676 20009 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.595293 20209 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.595079 16368 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:07:41.596069 20209 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.596966 20215 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.596652 16368 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 6 to 8, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 8 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:41.599155 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1699) took 1641 ms. Trace:
I20260709 13:07:41.599534 16537 rpcz_store.cc:276] 0709 13:07:39.957540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.067715 (+1110175us) service_pool.cc:224] Handling call
0709 13:07:41.180992 (+113277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.221359 (+ 40367us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:41.254217 (+ 32858us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.598828 (+344611us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.598875 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:41.598922 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.598985 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.599090 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16038,"prepare.queue_time_us":32898,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":289237,"threads_started":1}
I20260709 13:07:41.600984 20174 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:41.601526 20174 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:41.602430 20055 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.602916 20055 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:41.602557 20174 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.598400 16368 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.604619 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.605258 16468 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:41.608286 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.608156 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.609297 16469 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.610998 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 290749us
I20260709 13:07:41.611528 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.612020 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.612826 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.613094 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.613425 16463 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:41.613806 16616 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:41.603606 20051 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:41.614694 20051 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.612609 16619 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:41.616132 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.615083 20051 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.622000 20051 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.622364 16368 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 5 to 6, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 6 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.623337 20051 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.579111 20079 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.625466 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.626644 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.627280 16616 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:41.627257 19937 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:41.626667 20079 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.628170 19937 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:41.629124 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.629808 19937 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:41.629878 20079 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.630311 19937 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:41.630851 16434 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:41.630623 20079 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.631248 20169 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:41.631700 20169 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:41.632848 20206 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:07:41.632643 20169 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.624081 16368 catalog_manager.cc:5697] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 1 to 7, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
W20260709 13:07:41.633599 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52609.7us
I20260709 13:07:41.633129 19723 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.583731 16544 rpcz_store.cc:276] 0709 13:07:39.475888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.024446 (+1548558us) service_pool.cc:224] Handling call
0709 13:07:41.067625 (+ 43179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.101980 (+ 34355us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:41.102348 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:07:41.582668 (+480320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:41.582737 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:41.582798 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.582890 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.583042 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":666,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":4091,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5958,"thread_start_us":475792,"threads_started":2,"wal-append.queue_time_us":301831}
I20260709 13:07:41.651269 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.661002 16537 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:41.663018 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.648469 20215 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.667932 16539 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.603758 20055 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.656046 19984 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:41.677474 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.677783 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 65998.5us
W20260709 13:07:41.685045 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.670675 19937 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.677026 20079 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.686491 20115 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:41.662628 20045 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:07:41.687343 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.687692 20045 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:41.688090 20045 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.688923 19976 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.689509 19976 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:41.689021 20045 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.689788 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:41.690866 19896 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:41.690583 19976 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.691392 19896 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:41.691991 19976 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.692396 19896 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.693259 17125 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:41.694191 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.695595 16616 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:41.695531 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.697445 19937 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.626986 20139 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.699615 20139 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.698278 17127 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.672802 19748 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:07:41.687731 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.674885 20200 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.088s	user 0.005s	sys 0.000s
I20260709 13:07:41.709745 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:41.727725 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.654621 19723 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:41.530164 16367 rpcz_store.cc:269] 0709 13:07:20.313035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:20.318609 (+  5574us) service_pool.cc:224] Handling call
0709 13:07:41.369154 (+21050545us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:31.741107 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:31.741783 (+   676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:31.741834 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:07:31.741851 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:31.868344 (+126493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:31.877722 (+  9378us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:31.886063 (+  8341us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:32.073237 (+187174us) tablet.cc:701] Row locks acquired
0709 13:07:32.073290 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:07:32.073494 (+   204us) write_op.cc:270] Start()
0709 13:07:32.073670 (+   176us) write_op.cc:276] Timestamp: P: 1783602452073410 usec, L: 0
0709 13:07:32.073695 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:32.074426 (+   731us) log.cc:844] Serialized 5962 byte log entry
0709 13:07:33.474136 (+1399710us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:34.409360 (+935224us) op_driver.cc:464] REPLICATION: finished
0709 13:07:36.084894 (+1675534us) write_op.cc:301] APPLY: starting
0709 13:07:36.085012 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:36.225123 (+140111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:36.260951 (+ 35828us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:36.657305 (+396354us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:36.666761 (+  9456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:07:36.666835 (+    74us) write_op.cc:312] APPLY: finished
0709 13:07:36.667403 (+   568us) log.cc:844] Serialized 107 byte log entry
0709 13:07:36.757251 (+ 89848us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:36.912469 (+155218us) write_op.cc:454] Released schema lock
0709 13:07:36.941612 (+ 29143us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:36.998450 (+ 56838us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:37.006683 (+  8233us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":605945,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":1652731,"apply.run_cpu_time_us":14389,"apply.run_wall_time_us":893360,"num_ops":15,"prepare.queue_time_us":237512,"prepare.run_cpu_time_us":22598,"prepare.run_wall_time_us":441738,"raft.queue_time_us":119196,"raft.run_cpu_time_us":139303,"raft.run_wall_time_us":1713138,"replication_time_us":2260894,"spinlock_wait_cycles":4905216,"thread_start_us":1830996,"threads_started":5,"wal-append.queue_time_us":531929,"wal-append.run_cpu_time_us":41895,"wal-append.run_wall_time_us":4068680}]]}
I20260709 13:07:41.676749 20169 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.730966 16469 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:07:41.680236 19984 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.686121 20055 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.690579 20045 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:41.734467 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.733946 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.734916 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.734239 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.744184 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:41.744201 16613 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:41.737536 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.737620 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:41.726593 20174 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.743532 16617 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:41.746445 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.746853 16433 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.504s (SENT)
I20260709 13:07:41.740084 16368 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:07:41.670159 19954 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.732435 20158 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:41.740268 19984 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.726253 20112 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260709 13:07:41.756784 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.754746 16368 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 4 to 5, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:07:41.742973 19997 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
I20260709 13:07:41.758293 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.726083 20111 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:41.764309 20201 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:41.764848 20079 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:41.764995 20201 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:41.767333 20201 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.767369 19954 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:41.772991 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 77571.5us
I20260709 13:07:41.774334 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.751621 20076 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:41.784024 17120 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:41.754596 20174 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:41.785583 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51444.1us
I20260709 13:07:41.786367 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.788242 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.789083 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:41.790503 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:41.791198 16544 raft_consensus.cc:2376] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10. Re-sending same reply.
I20260709 13:07:41.792204 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:41.792896 17127 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:07:41.797122 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.792851 16433 leader_election.cc:336] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.663s (SENT)
I20260709 13:07:41.798448 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.806357 19723 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:41.829062 16610 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:41.780620 20158 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:41.836006 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.832906 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.834226 16509 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:41.834928 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 60656us
W20260709 13:07:41.833014 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 178030us
I20260709 13:07:41.799070 19595 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.843273 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.867247 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:41.864349 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:41.869885 20222 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.843942 19954 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.873260 20223 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:41.873967 20223 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.874141 17123 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:41.875190 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.875903 16537 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.876585 20219 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.877259 20219 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:41.880419 16544 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:41.882592 16539 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.799188 20174 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:41.892201 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.892725 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:41.894239 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:41.895524 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:41.896394 16538 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:41.844555 20076 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:41.902163 16540 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:41.906002 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 129056us
W20260709 13:07:41.907737 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 119605us
I20260709 13:07:41.913681 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:41.915519 16539 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:41.924146 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.928972 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.930223 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.933463 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.934311 16469 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:41.941584 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:41.942724 16544 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:41.958856 19723 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.960052 20208 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:41.960605 20208 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:41.961084 20208 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:41.961989 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.962901 16542 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:41.971006 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.894126 19595 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:41.972286 16461 raft_consensus.cc:2410] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:41.965600 16536 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:41.972944 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.977473 16537 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:41.974709 16545 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:41.978204 16539 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:41.963618 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.979723 16466 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.981140 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 98781.2us
W20260709 13:07:41.981312 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52476.8us
I20260709 13:07:41.986735 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:41.987447 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:41.987949 16463 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:41.984427 16543 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:41.989588 16462 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:41.989987 16539 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:41.993974 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.994580 16541 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:41.992301 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:41.968365 20222 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:41.996948 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:41.998086 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:42.000185 16537 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:42.000447 20202 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:07:41.978109 20215 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.003159 17119 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:42.001395 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 159292us
I20260709 13:07:41.996477 16544 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:41.997805 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.015578 16537 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:42.018100 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.018803 16543 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:42.019014 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.019897 16540 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:42.021862 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.021986 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.022805 17126 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:42.023121 17126 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:42.018441 16536 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
W20260709 13:07:42.000875 20203 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:07:42.024480 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.022398 16542 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:42.028931 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:42.022607 16539 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:42.030067 16541 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.030800 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:42.031234 17120 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:42.034124 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:42.035218 16543 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.022529 19954 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.039656 20219 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:42.040423 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:42.041299 16536 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:42.043172 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46297.4us
I20260709 13:07:42.044416 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.047717 19954 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.048111 19954 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:42.048478 19954 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.021689 20076 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.049624 20076 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.054900 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.056058 16538 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 5.
I20260709 13:07:42.057521 16537 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:42.059544 16466 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:07:42.050668 17126 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.057206 19595 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:42.065644 16434 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:42.066553 16536 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:42.066448 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.068467 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.072741 16616 raft_consensus.cc:2410] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:42.073520 16542 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:42.077940 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.079632 17126 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.077924 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:42.080929 16538 raft_consensus.cc:2368] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
I20260709 13:07:42.085155 16468 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.086828 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.087626 20169 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:07:42.088937 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44618.6us
I20260709 13:07:42.090196 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.090981 16542 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:42.090965 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.091327 16541 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:42.091918 19595 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.092028 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.092716 16542 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:42.093024 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.093103 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.093611 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.093729 16536 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:42.093818 16541 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:42.089030 20169 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.096939 16542 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:42.078660 20223 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.105877 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:42.092382 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.101488 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.097594 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.107235 16466 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:42.107323 16539 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:42.107367 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.022310 20158 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.114064 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:42.116240 16541 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:42.121415 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.130067 17126 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:07:42.131919 17093 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.534s (SENT)
I20260709 13:07:42.132099 16544 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:42.132517 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.118201 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.102258 20169 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:42.105587 20223 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:42.115072 19748 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.114773 19723 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.126715 20215 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.110872 19976 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:07:42.142469 20169 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.109870 20076 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.145069 20223 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.155210 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.150032 19984 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.152709 20045 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:42.279817 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.197785 16536 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 10. Ops: []
W20260709 13:07:42.251637 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 136816us
W20260709 13:07:42.198442 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 80283.2us
I20260709 13:07:42.165279 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.284415 17090 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:42.194187 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 72860.8us
W20260709 13:07:42.249358 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 110696us
I20260709 13:07:42.293546 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.155369 19748 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.298960 20208 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.300815 20240 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.301407 20238 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:42.302142 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 147159us
I20260709 13:07:42.303009 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.328353 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.328951 20237 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.329519 20237 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.330423 20237 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.331238 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.328547 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.303030 20111 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.305371 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:42.306180 20051 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:42.333096 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 198204us
I20260709 13:07:42.253784 20115 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.253913 19723 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.149771 20079 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 13:07:42.198869 20055 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:42.324224 19748 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.152618 20220 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.322113 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.341037 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.187649 20215 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:42.154239 20139 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:07:42.327729 20219 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:42.347899 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.327631 20238 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.349301 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:42.349956 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44821.3us
I20260709 13:07:42.339061 20111 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.343931 20055 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:42.350019 20137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.004s	sys 0.009s
I20260709 13:07:42.340538 19976 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.360435 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.363747 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.360914 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.339746 20115 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.346644 20045 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:42.364678 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 212058us
I20260709 13:07:42.347541 19595 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.367636 17090 leader_election.cc:400] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
I20260709 13:07:42.352259 19896 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:42.362092 20137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.009s
I20260709 13:07:42.359529 20106 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.354409 20201 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.360137 19984 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.374702 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.374501 20055 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.375294 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.375523 20243 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.385571 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.368510 20045 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:42.375903 20139 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:42.358520 20111 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.348335 20241 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:42.363083 19723 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.368466 20112 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.388216 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.388862 16463 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.359802 20238 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.374073 20219 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:42.396929 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.397506 20219 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:42.398221 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 376994us
I20260709 13:07:42.399160 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.400166 20216 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.400246 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.363305 20225 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.384253 16468 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:42.390573 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.390925 20045 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.338889 20240 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.401314 16461 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:42.372979 19896 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.390954 16467 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:42.387878 17093 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.649s (SENT)
I20260709 13:07:42.372071 19976 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.380347 20201 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.392030 20208 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:42.388468 20243 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.413614 16462 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.388144 19723 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.401665 20112 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:42.378700 19595 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.418645 16468 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:42.406530 20158 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:42.466398 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 78580us
I20260709 13:07:42.471578 17120 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:42.411904 19896 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.412745 20079 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.413348 20201 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.416672 20055 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:42.482681 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 131106us
W20260709 13:07:42.484123 17093 leader_election.cc:336] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.756s (SENT)
I20260709 13:07:42.487798 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.413255 19984 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.412377 20106 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.416666 19723 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.465651 20112 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.417570 20243 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.472369 20158 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:42.500090 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.481267 19937 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.513475 16463 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
W20260709 13:07:42.515080 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 114921us
I20260709 13:07:42.462256 19954 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.509867 20051 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.415236 20115 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.527137 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.514694 20158 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.481986 20225 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:42.462507 20215 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.533077 16543 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:42.508221 20238 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:42.531420 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:42.543401 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 65249.8us
W20260709 13:07:42.561327 17093 leader_election.cc:336] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.776s (SENT)
W20260709 13:07:42.549911 20234 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.109s	user 0.001s	sys 0.004s
I20260709 13:07:42.554288 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.533638 19984 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:42.524673 20208 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:42.522398 20169 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.571297 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:42.575506 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47037.9us
I20260709 13:07:42.522492 20079 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.576974 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.557180 19937 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:42.587212 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.588670 16463 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:07:42.572438 20249 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.577172 20115 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.575039 20252 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.537297 19976 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.619516 16462 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:42.591348 20221 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:42.614331 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 90650.3us
I20260709 13:07:42.585222 20251 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.629061 20251 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.629483 20251 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.631171 20139 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:42.576918 20106 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.632519 20169 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.633236 20221 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:42.634924 17093 leader_election.cc:336] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 2.009s (SENT)
I20260709 13:07:42.643653 16463 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:42.616602 16585 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:42.608822 20079 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.617889 20250 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:42.592844 19984 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:42.621490 17126 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:42.625610 20253 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:42.626089 16468 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: [9.8-11.9]
I20260709 13:07:42.612962 20249 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.652920 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.672535 16462 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:42.657670 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.634280 20221 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.666159 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:42.666533 20245 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:07:42.613435 19937 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.619529 20137 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.617102 20252 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.682317 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.684425 16467 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:42.690555 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 288889us
I20260709 13:07:42.691326 16543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:07:42.705828 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:42.706115 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 71196us
I20260709 13:07:42.709040 16468 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:42.678798 20169 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:42.669618 20079 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.707664 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:42.679301 20240 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.684127 20139 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:42.687657 19595 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:42.719493 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.724047 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:42.726053 17093 leader_election.cc:336] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 2.194s (SENT)
I20260709 13:07:42.726575 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.726755 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.727458 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.731575 16613 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:42.733520 16616 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:42.690964 20252 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:42.737977 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51639us
I20260709 13:07:42.710227 20137 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:42.739540 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:42.738216 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.719908 20139 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.760422 20261 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.761327 20076 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.762013 20076 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.762612 20076 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.729655 19954 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:42.773658 16465 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:42.736804 19595 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:42.733094 20169 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:42.775765 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48376.5us
I20260709 13:07:42.783843 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.784675 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:42.789072 20256 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:42.761339 20238 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:42.689122 20250 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.792812 16470 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.793270 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.805274 16468 raft_consensus.cc:2376] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 6. Re-sending same reply.
W20260709 13:07:42.797356 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 438483us
I20260709 13:07:42.798767 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.799618 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.753878 20254 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.803296 20255 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.727331 20079 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.808234 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.745774 20257 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.768013 20139 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:42.766824 20237 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.842797 16543 raft_consensus.cc:606] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.814901 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.818197 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.775106 20261 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.825330 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:42.763110 20076 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.844538 20273 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.854894 20237 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.855212 20273 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.738855 19937 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.847944 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.848450 20216 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:42.857813 20216 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:42.849212 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45057.1us
I20260709 13:07:42.860153 20254 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.860598 20254 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.860795 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.861124 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.829865 20255 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.861943 16461 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:42.862154 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.862727 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.829566 19954 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.863353 20208 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:42.854336 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 128312us
W20260709 13:07:42.856499 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48360.1us
I20260709 13:07:42.855751 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:42.864960 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 140985us
I20260709 13:07:42.865628 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:42.775748 20240 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:07:42.864239 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.863819 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.870901 16461 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:42.890288 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.891776 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:42.893378 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:42.829360 20257 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.890271 16468 raft_consensus.cc:2376] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 8. Re-sending same reply.
W20260709 13:07:42.905781 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 491442us
I20260709 13:07:42.853240 19595 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.861071 20254 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.914285 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:42.852591 20238 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.776657 19984 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:42.933071 16465 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:42.933470 16465 pending_rounds.cc:85] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 8
I20260709 13:07:42.933698 16465 pending_rounds.cc:107] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:42.933907 16465 raft_consensus.cc:2889] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:42.934284 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:42.826579 20055 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:07:42.938088 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:42.859845 20216 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:42.901885 20260 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:42.902192 19954 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:42.943315 16461 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:42.948078 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 81840us
I20260709 13:07:42.948226 20208 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:42.951006 20287 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:42.951488 20253 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.859814 20045 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.983238 16463 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:42.939024 20261 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:42.913491 20257 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.953961 20260 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:42.993271 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 90527us
I20260709 13:07:42.941582 20219 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.014918 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.015750 16466 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 5: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:43.004069 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 112390us
W20260709 13:07:43.019608 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 154028us
W20260709 13:07:43.020380 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 158278us
I20260709 13:07:43.021440 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:43.022965 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:43.023617 17126 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.991212 20284 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.966478 20271 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.029686 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:42.984664 20253 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:42.941474 20238 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.033761 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.031764 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:43.036962 17126 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:43.033051 17125 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:43.038749 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.039055 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.017665 20260 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.944128 19595 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.061761 16468 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:43.055871 16470 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:43.057118 16466 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:43.058315 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.069907 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.017445 20249 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.065342 16465 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:43.068343 16616 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:43.053174 20263 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:43.044665 20284 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:42.933344 20137 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.055212 20240 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:07:43.062217 20271 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:43.064512 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:43.074684 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.076134 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:43.078613 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47037.3us
I20260709 13:07:42.995178 20208 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.078253 16463 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:43.089663 16614 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:43.091814 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 136026us
I20260709 13:07:43.018052 19954 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:07:43.056456 20253 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:43.077551 20243 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.557s	user 0.005s	sys 0.004s
I20260709 13:07:43.115969 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:43.078008 20220 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.005s
W20260709 13:07:43.106123 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 88819.6us
I20260709 13:07:42.953768 20169 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:43.109804 20276 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:07:43.079478 19595 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.032562 19976 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:07:43.078635 20219 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:43.153195 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.075106 20263 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.075318 20045 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.177587 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:43.179100 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:43.194962 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 95246.6us
I20260709 13:07:43.159613 20220 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:43.165202 20111 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.000s
I20260709 13:07:43.082177 20055 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.077037 20284 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.159413 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:43.078152 20238 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.164580 20231 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:43.174273 20219 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:43.180754 20263 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.164865 20283 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.189783 20215 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.165750 20139 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.157189 20243 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.190182 20269 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:43.237069 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82012.4us
I20260709 13:07:43.238171 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:43.185590 19595 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:43.243198 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:43.217700 20261 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:43.081281 20271 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:43.227571 20267 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:07:43.249557 16612 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:43.221046 20055 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:43.220508 20079 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.226663 20219 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:43.193619 20281 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:43.231822 20215 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.210183 20111 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.233873 20237 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.217602 20045 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:07:43.294541 20289 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:07:43.236536 20283 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:43.236059 20076 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.220836 20244 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.236s
I20260709 13:07:43.248438 20272 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:07:43.259343 20112 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.001s
I20260709 13:07:43.230271 20220 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:07:43.294688 19896 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.000s
I20260709 13:07:43.259538 16509 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:43.261550 20221 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.301311 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:43.303328 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60230.3us
I20260709 13:07:43.308025 16616 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:43.264485 20215 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.318502 20076 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.318470 20282 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:07:43.319276 20076 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:43.320191 20076 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:43.321520 20115 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.002s
W20260709 13:07:43.316668 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 57230.4us
I20260709 13:07:43.329813 20304 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:07:43.330889 20285 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:07:43.331104 20283 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.296001 20250 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.311911 20237 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:43.315259 20225 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:43.351230 20223 consensus_meta.cc:287] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.014s	user 0.013s	sys 0.000s
I20260709 13:07:43.287985 20269 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:07:43.350618 20265 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
W20260709 13:07:43.368404 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 337282us
I20260709 13:07:43.375735 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:43.381641 17127 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:43.387506 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70288.6us
W20260709 13:07:43.390025 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.389792 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 384657us
W20260709 13:07:43.390441 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.390779 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:43.388497 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:43.391396 16536 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:43.388001 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 295273us
I20260709 13:07:43.323271 20112 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.323418 19896 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.392115 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:07:43.390637 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126092us
I20260709 13:07:43.394702 20250 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:43.395215 20250 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:43.395527 20303 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:43.396072 20250 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.396674 20303 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.396394 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:43.397109 20303 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:43.397905 20303 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.398202 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:43.399163 20301 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.399822 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:43.400327 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:43.399888 20301 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.401176 20301 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:43.402184 20301 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.403550 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:43.405063 20282 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:43.405577 20282 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:43.406193 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.406409 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:43.407058 16539 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:43.407704 19954 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.407845 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:43.406409 20282 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.408393 16537 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.408202 19954 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.411262 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:43.412195 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:43.412174 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:43.413621 17124 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:43.416109 16540 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:43.315116 20272 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.418840 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:43.419286 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:43.420113 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:43.387506 20285 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:43.425539 17123 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.426507 17120 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:43.427906 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:43.430752 20295 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:43.431068 20299 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.431188 20295 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:43.431751 20299 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.432266 20295 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.433377 20295 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.434291 20243 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:43.435910 20201 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.919s	user 0.006s	sys 0.002s
I20260709 13:07:43.437180 16541 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:43.438289 19954 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.428563 17122 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:43.424460 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.444401 16537 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:43.369448 20215 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.436302 20201 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:43.468372 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56238.3us
I20260709 13:07:43.413257 20051 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:43.475416 20280 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.425036 20079 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.427071 20221 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.381580 20223 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.426059 20285 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:43.377050 20055 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.381245 20225 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.483304 20139 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.482616 20051 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:43.522711 16467 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:43.379513 20261 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.508193 19937 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.538173 17118 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.540550 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.541723 16470 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:07:43.520826 20251 consensus_meta.cc:287] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.891s	user 0.013s	sys 0.008s
I20260709 13:07:43.551457 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:43.553020 20280 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:43.553553 20280 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:43.554518 20280 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.557367 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:43.559548 20313 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.561009 20313 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:43.562377 20221 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.564528 20221 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.565583 19984 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:43.565984 19984 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:43.566866 19984 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.568161 19984 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.564843 20313 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:07:43.577149 20281 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:43.577845 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.580794 20221 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:43.586361 20112 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.587543 19896 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.540115 20111 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.588532 20251 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.547736 20285 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.590035 20263 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.590669 20251 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.592149 20263 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.523833 20269 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.594158 20223 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.539752 20169 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:43.593700 20291 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:07:43.612759 16536 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:43.634186 16618 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:07:43.637290 17118 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:43.599367 19723 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.076s	user 0.004s	sys 0.013s
I20260709 13:07:43.644532 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:43.645237 16470 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:43.649763 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:43.659621 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 135781us
I20260709 13:07:43.643129 20237 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.547977 19937 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.646423 19976 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:43.664562 20308 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:43.667449 20305 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:43.671726 20305 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.673946 20305 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.594209 20269 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.666066 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:43.660866 20275 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
W20260709 13:07:43.670455 20277 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 13:07:43.671125 20307 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:07:43.690434 20252 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.001s
I20260709 13:07:43.697993 16615 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:43.700619 20045 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:43.666854 20237 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:43.649139 19723 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.630692 20169 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:43.675511 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:43.715898 20216 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:43.716138 20249 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:43.726505 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:43.775784 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 100449us
I20260709 13:07:43.727754 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 623) took 1123 ms. Trace:
I20260709 13:07:43.729992 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 621) took 1129 ms. Trace:
I20260709 13:07:43.742491 20269 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.743083 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.664861 20051 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:43.743920 20298 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.744073 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:43.745177 20316 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:07:43.753471 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 50404.2us
W20260709 13:07:43.755532 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.774693 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.774930 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.797530 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.798240 16611 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:43.777453 17120 rpcz_store.cc:276] 0709 13:07:42.600406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.605566 (+  5160us) service_pool.cc:224] Handling call
0709 13:07:42.618691 (+ 13125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.426905 (+808214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.728759 (+301854us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b540067ded4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:43.729931 (+  1172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857260288}
I20260709 13:07:43.776422 17123 rpcz_store.cc:276] 0709 13:07:42.603844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.603993 (+   149us) service_pool.cc:224] Handling call
0709 13:07:42.604272 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.425941 (+821669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.727471 (+301530us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54006e0ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:43.727665 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888320384}
I20260709 13:07:43.801923 16613 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:43.806099 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:43.799574 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:43.768419 20216 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:43.775717 20249 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:43.769843 19984 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:43.766812 20252 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:43.947044 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 128303us
I20260709 13:07:43.833817 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.036195 16616 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:07:43.858937 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:44.037108 16611 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.825280 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:44.013592 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.033370 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:43.779201 20231 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 13:07:43.882007 20241 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.476s	user 0.012s	sys 0.001s
I20260709 13:07:43.884544 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:44.071314 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:44.073179 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:43.818234 20215 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:43.860575 20137 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.093286 20137 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:44.093602 20225 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.094274 20137 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:43.805246 20298 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.097934 20298 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:43.909813 20321 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.098553 20321 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.098922 20321 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.913265 20273 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:43.910027 20290 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.101526 20169 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.031805 20301 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.101794 20290 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.102262 20301 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:44.103029 20219 consensus_meta.cc:287] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.002s
I20260709 13:07:44.103438 20219 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.103960 20290 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.104352 20301 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:44.068181 20256 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
W20260709 13:07:44.084020 20257 consensus_meta.cc:287] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.054s	user 0.005s	sys 0.002s
I20260709 13:07:44.084578 20328 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:44.111341 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 226902us
I20260709 13:07:44.085045 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.084897 20216 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.077831 20269 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:44.086712 20330 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.268s	user 0.000s	sys 0.002s
I20260709 13:07:43.925184 20272 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.090372 20252 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.091249 19976 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:43.812361 19748 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.264s
I20260709 13:07:44.104442 16461 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:44.081022 19937 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.109644 16509 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:44.080351 20295 consensus_meta.cc:287] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.001s
I20260709 13:07:44.110816 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.094197 20174 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.072710 20106 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.866053 20112 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 13:07:44.073693 20271 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.119567 20325 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.253s	user 0.000s	sys 0.008s
W20260709 13:07:44.120046 20253 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.946s	user 0.011s	sys 0.000s
I20260709 13:07:44.120695 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:44.121672 20231 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:07:44.122809 20158 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.572s	user 0.009s	sys 0.009s
W20260709 13:07:44.128561 20254 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.163s	user 0.008s	sys 0.008s
I20260709 13:07:44.130910 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1933) took 1361 ms. Trace:
I20260709 13:07:44.132198 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:44.132874 20288 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.134042 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.136511 16611 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:44.137374 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.138239 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.141523 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.076486 20241 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:44.538830 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 406682us
W20260709 13:07:44.539777 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 434156us
I20260709 13:07:44.540508 16612 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:44.517904 16540 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.155313 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:44.542089 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 386851us
I20260709 13:07:44.543035 16585 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:44.342684 16616 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:44.153295 16613 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:44.543820 16616 pending_rounds.cc:85] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 7
I20260709 13:07:44.544119 16616 pending_rounds.cc:107] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:44.544386 16616 raft_consensus.cc:2889] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.139655 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.318509 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.150996 20324 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.394s
I20260709 13:07:44.545711 16538 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.545830 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.546514 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.547155 16538 raft_consensus.cc:2376] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9. Re-sending same reply.
W20260709 13:07:44.480535 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.518342 16537 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.538442 16611 pending_rounds.cc:85] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 8
I20260709 13:07:44.544251 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2093) took 1021 ms. Trace:
I20260709 13:07:44.559327 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:44.548856 16611 pending_rounds.cc:107] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:07:44.560168 16611 raft_consensus.cc:2889] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.545303 16544 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.558588 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1824) took 1013 ms. Trace:
I20260709 13:07:44.564280 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.565220 16538 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.567229 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:44.568104 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1936) took 1797 ms. Trace:
I20260709 13:07:44.549202 16613 rpcz_store.cc:276] 0709 13:07:43.522473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.152574 (+630101us) service_pool.cc:224] Handling call
0709 13:07:44.152936 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.543948 (+391012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.544191 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.563772 16616 rpcz_store.cc:276] 0709 13:07:43.545270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.328272 (+783002us) service_pool.cc:224] Handling call
0709 13:07:44.342231 (+ 13959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.558328 (+216097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.558527 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:44.117822 20225 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.571477 16610 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:44.571684 16612 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:44.114662 20328 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:44.509481 20280 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.353253 20269 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:44.518076 19984 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:44.575915 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.568552 16469 rpcz_store.cc:276] 0709 13:07:42.770743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.772869 (+  2126us) service_pool.cc:224] Handling call
0709 13:07:42.798067 (+ 25198us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:42.801322 (+  3255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.801368 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:42.802154 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 13:07:42.996923 (+194769us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:42.996972 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.997038 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.148822 (+1151784us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b240009fc08. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444efb0 00007ffa370c5488 00007ffa370c5be8 00007ffa3709d398 00007ffa3709876a 00007ffa37097bb6
0709 13:07:44.543624 (+394802us) raft_consensus.cc:1685] finished
0709 13:07:44.543647 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.568033 (+ 24386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7451,"raft.queue_time_us":6910,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":30448,"spinlock_wait_cycles":8939392,"thread_start_us":194362,"threads_started":1,"wal-append.queue_time_us":312274}
I20260709 13:07:44.309370 20216 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.576572 16537 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:44.605811 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:44.583096 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:44.605993 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.539330 19976 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.518412 20272 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.518309 20231 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:44.604701 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.605216 16463 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:44.606067 16468 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:44.587967 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.606732 16544 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.570844 16462 rpcz_store.cc:276] 0709 13:07:42.769781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.771846 (+  2065us) service_pool.cc:224] Handling call
0709 13:07:42.772312 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:42.783647 (+ 11335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:42.783693 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:42.797704 (+ 14011us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.982342 (+184638us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:43.421727 (+439385us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.424281 (+  2554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.426233 (+  1952us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.130157 (+703924us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b240009fb78. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa342969c4 00007ffa34294acb 00007ffa3444fdc9 00007ffa3444fa55 00007ffa3444efb0 00007ffa370c5488 00007ffa370c5be8 00007ffa3709d398 00007ffa3709876a 00007ffa37097bb6
0709 13:07:44.130631 (+   474us) raft_consensus.cc:1685] finished
0709 13:07:44.130734 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.130855 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2178,"prepare.queue_time_us":610477,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":14072,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":199,"spinlock_wait_cycles":38345984,"thread_start_us":550490,"threads_started":2,"wal-append.queue_time_us":148126}
I20260709 13:07:44.699420 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:44.699488 16540 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.700026 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:44.700425 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:44.700672 16462 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:44.559459 20298 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:44.559648 19937 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.587973 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:44.701006 16463 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:44.563236 20115 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:07:44.637439 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:44.711259 16466 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:44.637681 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.566339 20045 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:44.610486 16508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.047s
W20260709 13:07:44.713155 16508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.009s	sys 0.048s
I20260709 13:07:44.639312 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:44.714306 16470 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:44.641253 16541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.019s
W20260709 13:07:44.715067 16541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.019s
I20260709 13:07:44.573493 20295 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:44.576862 19748 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:44.117481 20257 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.643812 16538 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.577380 20215 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.603880 20282 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.647872 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:44.545293 20288 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.746527 20288 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.746621 20174 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:44.731806 19748 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.539094 20253 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.748265 19748 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.580487 20254 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.750330 20254 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.750968 16617 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:44.751473 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.751899 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.753288 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2081) took 1711 ms. Trace:
I20260709 13:07:44.603926 20201 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.754801 16545 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:44.755981 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1735) took 1350 ms. Trace:
I20260709 13:07:44.547935 20106 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:44.757965 16618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2087) took 1713 ms (client timeout 1522 ms). Trace:
I20260709 13:07:44.758178 20106 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.609855 20261 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.758340 16618 rpcz_store.cc:269] 0709 13:07:43.044052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.118576 (+ 74524us) service_pool.cc:224] Handling call
0709 13:07:44.757782 (+1639206us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b54003db154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:44.757877 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89180416}
I20260709 13:07:44.758904 20261 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.734263 20295 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.760226 20303 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.761137 20261 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.761276 20295 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.761755 16614 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:44.763296 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1831) took 1093 ms. Trace:
I20260709 13:07:44.763566 16614 rpcz_store.cc:276] 0709 13:07:43.670281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.074088 (+403807us) service_pool.cc:224] Handling call
0709 13:07:44.763149 (+689061us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540001f4d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:44.763244 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439595776}
W20260709 13:07:44.645102 20260 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.558s	user 0.014s	sys 0.000s
I20260709 13:07:44.764230 16616 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:44.610752 20280 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.765532 20208 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.766052 20208 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.766412 19976 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.767138 20280 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:44.668825 20286 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.768014 20208 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.767859 20286 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.768564 19976 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.770505 20286 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.671159 19896 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:44.771121 19896 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:44.771340 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:44.772001 19896 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.772913 20208 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.773028 19896 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.773242 16618 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:44.773475 20208 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.773056 20283 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:44.775512 20208 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:44.776063 20208 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:44.577314 20158 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:44.704879 20272 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.778450 20158 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.577467 20271 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.776687 20208 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:44.139923 20249 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.611068 20269 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:44.686730 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.779927 20208 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.637580 19984 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.708076 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:44.708365 20339 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:07:44.688760 20321 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:07:44.712544 20045 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:44.729359 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.731863 16538 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:44.756317 16545 rpcz_store.cc:276] 0709 13:07:43.405520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.405646 (+   126us) service_pool.cc:224] Handling call
0709 13:07:43.405986 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.755198 (+1349212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.755725 (+   527us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400205dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:44.755902 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3101388672}
I20260709 13:07:44.703963 20298 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.728880 20221 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.740890 20231 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:44.744338 20335 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.710s	user 0.000s	sys 0.007s
I20260709 13:07:44.652364 20323 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:44.781332 16544 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:44.713538 19937 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.782402 16464 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.803288 20286 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.764534 20260 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.784941 16537 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:44.785197 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:44.811332 20298 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:44.792028 16536 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:44.803633 17124 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:44.810262 16545 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:07:44.735567 20282 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.814108 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:44.818125 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 103440us
I20260709 13:07:44.783722 16470 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:44.819149 20323 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.820547 19937 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.873970 20272 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:44.823339 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 710873us
I20260709 13:07:44.825095 20286 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.772905 19748 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.825845 19723 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.827750 20253 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:44.828739 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2084) took 1785 ms. Trace:
I20260709 13:07:44.829250 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1944) took 1808 ms. Trace:
I20260709 13:07:44.831055 17126 raft_consensus.cc:2368] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:44.892367 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.753647 16617 rpcz_store.cc:276] 0709 13:07:43.042028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.042182 (+   154us) service_pool.cc:224] Handling call
0709 13:07:43.082710 (+ 40528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.751348 (+1668638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.753072 (+  1724us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b5400234bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:44.753231 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3836153600}
I20260709 13:07:44.834178 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:44.844795 20282 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:44.783171 20215 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.685365 20328 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.843891 20323 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:44.878320 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.884502 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.885589 16543 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:44.830507 20158 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:44.809028 20321 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.838485 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.891323 16461 rpcz_store.cc:276] 0709 13:07:43.020937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.156540 (+135603us) service_pool.cc:224] Handling call
0709 13:07:43.156840 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.538120 (+1381280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.829043 (+290923us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b54003e4754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:44.829194 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178901888}
I20260709 13:07:44.891249 16610 rpcz_store.cc:276] 0709 13:07:43.043059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.044362 (+  1303us) service_pool.cc:224] Handling call
0709 13:07:43.064750 (+ 20388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.571839 (+1507089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.828527 (+256688us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540001ead4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:44.828686 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464668544}
I20260709 13:07:44.844130 20223 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.927412 20223 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:44.901522 17122 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:44.906584 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:44.817672 20221 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:44.941133 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:44.942040 16545 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
W20260709 13:07:44.944380 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 369188us
W20260709 13:07:44.944685 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 106257us
I20260709 13:07:44.947029 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.889566 20295 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:44.950654 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:44.903553 20261 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.952867 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.943842 20283 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:44.978864 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.950986 20112 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:44.948882 20237 consensus_meta.cc:287] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.000s
I20260709 13:07:44.976626 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:44.974081 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 202782us
I20260709 13:07:44.981719 16544 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:44.983040 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.951527 20328 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.956270 20158 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.980504 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:44.967844 20220 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:44.954551 20343 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.985668 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:44.973873 20216 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.965341 20055 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:44.980959 20254 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.981891 20341 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.988930 20112 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.940471 20045 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.005158 20350 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.029011 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 248435us
I20260709 13:07:45.015889 19984 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:44.996295 20237 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.048122 16469 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:45.043677 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:45.035372 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:45.022928 20112 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.008822 20220 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.052727 19984 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:45.054088 20220 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.020417 20158 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:07:45.055135 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:45.055569 20158 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.055727 20253 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:45.056031 17119 raft_consensus.cc:2410] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:07:45.029110 20257 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:45.057516 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:45.031878 20295 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.015856 20055 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.059087 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.069973 16462 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:45.070500 16434 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:45.070972 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.062841 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.072579 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.073278 16468 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:45.021863 20298 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.019335 20254 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.009173 20343 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.065001 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:45.085207 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:45.077510 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.077872 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.081779 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.153705 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.022369 20341 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.222420 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.057026 20260 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:45.033706 20353 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:45.238612 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.250553 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 211692us
I20260709 13:07:45.347184 16468 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:07:45.291975 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 206850us
I20260709 13:07:45.058807 20358 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.342482 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.352046 17126 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:45.032192 20350 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.080825 20241 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:45.373531 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:45.383914 20260 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:45.081234 20283 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:45.403205 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:45.404541 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.405155 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.277665 19976 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:45.246532 19984 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.275815 19748 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:45.343488 20250 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:45.354283 20354 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.430371 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.362454 20106 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:45.356946 20286 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:45.389268 20215 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.083120 20303 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.316s
I20260709 13:07:45.376334 20360 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:45.354149 20290 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:45.081051 20295 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.381309 20241 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.457404 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 74435.8us
I20260709 13:07:45.458165 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.378087 20261 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:45.375037 20364 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.433552 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.405515 20321 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:45.479115 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.490136 20346 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 13:07:45.483088 16617 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.428457 20358 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.429075 19984 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:45.488449 16614 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.445811 20106 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.445482 20353 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:07:45.481869 20344 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260709 13:07:45.500600 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.463512 20221 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:45.420944 20348 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:07:45.505214 16466 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:45.421087 19976 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.505755 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.533001 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.533556 16468 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:45.505811 16469 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:45.482746 20360 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:45.494521 20241 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.459661 20250 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.525803 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.526192 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:45.542877 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 269271us
I20260709 13:07:45.543231 16470 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:45.519374 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:45.510502 20257 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:45.514617 20366 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:45.492691 20290 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.519295 20106 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.530411 19896 consensus_meta.cc:287] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.004s
I20260709 13:07:45.564268 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.505106 20261 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.536682 19976 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.568207 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.577665 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:45.578156 16617 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:45.555404 20349 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
I20260709 13:07:45.520732 20368 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:45.589499 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.590322 16619 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:45.555052 20366 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:45.592267 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.595103 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.599036 16466 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:45.463644 20362 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:07:45.575728 20201 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.576011 20055 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:45.463702 20354 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.586071 20298 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:45.615260 16619 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:45.515372 20283 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.566455 20257 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.586760 20368 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.519857 20358 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.632472 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.633018 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 140453us
I20260709 13:07:45.639438 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.664345 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:45.687203 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:45.687242 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1825) took 2045 ms. Trace:
I20260709 13:07:45.665030 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2149) took 1076 ms. Trace:
W20260709 13:07:45.625864 19937 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 13:07:45.688544 16611 rpcz_store.cc:276] 0709 13:07:43.642257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.537879 (+895622us) service_pool.cc:224] Handling call
0709 13:07:44.538257 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.560795 (+ 22538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.560840 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.561366 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.879622 (+318256us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:44.974800 (+ 95178us) log.cc:844] Serialized 14 byte log entry
0709 13:07:44.975150 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.975224 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.686995 (+711771us) raft_consensus.cc:1685] finished
0709 13:07:45.687021 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.687175 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1281,"prepare.queue_time_us":138331,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":183,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":10578,"thread_start_us":412735,"threads_started":2,"wal-append.queue_time_us":393434}
I20260709 13:07:45.691926 16618 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.687372 17119 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:45.706648 17123 raft_consensus.cc:2410] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:45.688937 16542 rpcz_store.cc:276] 0709 13:07:44.588853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.708048 (+119195us) service_pool.cc:224] Handling call
0709 13:07:44.708392 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.708727 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.708758 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:44.709278 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:07:44.950127 (+240849us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.021402 (+ 71275us) log.cc:844] Serialized 14 byte log entry
0709 13:07:45.022739 (+  1337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.022814 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.664823 (+642009us) raft_consensus.cc:1685] finished
0709 13:07:45.664844 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:45.664964 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1035,"prepare.queue_time_us":83774,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":47519,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":9335,"thread_start_us":287807,"threads_started":2,"wal-append.queue_time_us":271546}
I20260709 13:07:45.594135 19984 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.739213 17120 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:45.649048 20260 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:45.741964 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:45.633476 20343 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.653156 20254 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:45.613390 20201 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.743216 17121 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:45.664680 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.745137 17092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.005s
I20260709 13:07:45.554515 20360 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:45.747383 16583 connection.cc:256] RPC call timeout handler was delayed by -1.369581516999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 13:07:45.665666 20368 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:45.666518 20250 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.756349 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:45.756472 16583 connection.cc:256] RPC call timeout handler was delayed by -1.1844231019998688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:07:45.756989 16542 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:45.755229 17092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.001s	sys 0.006s
I20260709 13:07:45.755121 16470 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
W20260709 13:07:45.762796 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.762898 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:45.764715 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.759023 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:45.765997 16610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.002s	sys 0.006s
W20260709 13:07:45.766356 16610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.002s	sys 0.006s
I20260709 13:07:45.743788 20341 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.771808 20208 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:45.794471 20257 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.795459 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:45.796350 20358 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:45.808882 16434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.006s	sys 0.007s
W20260709 13:07:45.809249 16434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.006s	sys 0.007s
I20260709 13:07:45.777396 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:45.778333 20201 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.783443 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:45.785117 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.786648 16466 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:45.814720 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.815418 16466 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:45.817262 16544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.006s	sys 0.007s
W20260709 13:07:45.818054 16544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.006s	sys 0.008s
I20260709 13:07:45.770295 19984 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:45.810308 17121 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.726315 19937 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.783681 20360 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.810591 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:45.823865 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:45.824939 17090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.009s	sys 0.005s
W20260709 13:07:45.816852 20344 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:07:45.810083 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 739583us
W20260709 13:07:45.812252 19723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.003s	sys 0.010s
I20260709 13:07:45.792397 20363 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:07:45.847051 17090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.009s	sys 0.005s
I20260709 13:07:45.854314 20221 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.693670 20366 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:45.800504 20260 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:45.863901 16542 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:46.051935 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 550) took 1025 ms. Trace:
I20260709 13:07:45.933988 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2092) took 2412 ms. Trace:
I20260709 13:07:45.857139 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.052431 16542 rpcz_store.cc:276] 0709 13:07:45.026527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.743987 (+717460us) service_pool.cc:224] Handling call
0709 13:07:46.051869 (+307882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:45.955862 17121 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
W20260709 13:07:46.058959 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 296100us
I20260709 13:07:46.053215 16615 rpcz_store.cc:276] 0709 13:07:43.522021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.527159 (+  5138us) service_pool.cc:224] Handling call
0709 13:07:43.593455 (+ 66296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:43.765024 (+171569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.933715 (+2168691us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:45.933895 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239767808}
I20260709 13:07:46.067154 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:46.086129 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.857709 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:46.090571 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:45.831307 20309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.302s	user 0.014s	sys 0.004s
I20260709 13:07:46.092459 16434 leader_election.cc:400] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:46.092746 16434 leader_election.cc:403] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:07:45.933795 20112 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.877s	user 0.008s	sys 0.003s
I20260709 13:07:46.112090 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:46.059216 20377 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:07:46.059792 20282 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.133s	user 0.012s	sys 0.000s
I20260709 13:07:46.112962 16542 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:46.131479 20045 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:45.831002 20201 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:46.141300 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2155) took 1432 ms. Trace:
I20260709 13:07:45.922068 20290 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:46.094779 20309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.571s	user 0.022s	sys 0.007s
I20260709 13:07:46.023691 20371 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:45.933606 20269 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:46.140147 17091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.000s	sys 0.019s
W20260709 13:07:46.091776 19723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.006s	sys 0.010s
W20260709 13:07:46.137758 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45399.7us
I20260709 13:07:46.142572 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:45.854686 20353 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.278s
I20260709 13:07:46.144105 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.091657 20221 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.134783 20112 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.379863 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:46.383401 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.384963 16542 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:46.356894 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:46.081864 20261 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.120846 20208 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.141316 20363 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:46.141019 20282 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.154163 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 586) took 1090 ms. Trace:
I20260709 13:07:46.542186 16616 rpcz_store.cc:276] 0709 13:07:45.063695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.065624 (+  1929us) service_pool.cc:224] Handling call
0709 13:07:45.217601 (+151977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:45.217909 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.217945 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:45.218489 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:07:45.731803 (+513314us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:45.731848 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:45.731931 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.153871 (+421940us) raft_consensus.cc:1685] finished
0709 13:07:46.153901 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.154091 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":389809,"threads_started":1,"wal-append.queue_time_us":638711}
I20260709 13:07:46.156544 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:46.156862 20379 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:07:46.157721 20299 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.161288 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 737) took 2054 ms. Trace:
I20260709 13:07:46.162614 20384 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:46.168314 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.216251 20323 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.273s	user 0.010s	sys 0.000s
I20260709 13:07:46.176980 20271 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:45.933990 20106 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:46.185338 17091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.000s	sys 0.020s
I20260709 13:07:46.144300 20045 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.149881 20201 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.151278 20390 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:07:46.243755 20283 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:46.424358 16610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.011s	sys 0.019s
I20260709 13:07:46.544407 16469 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:46.548349 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.616386 16610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.013s	sys 0.021s
I20260709 13:07:46.589547 17119 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:46.593138 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.565109 16585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.65:40627 timed out after 1.612s (SENT) [suppressed 16 similar messages]
I20260709 13:07:46.090179 20137 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.079s
W20260709 13:07:46.617278 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52216.7us
I20260709 13:07:46.618213 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 459) took 1212 ms. Trace:
I20260709 13:07:46.618700 16469 rpcz_store.cc:276] 0709 13:07:45.406263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.156235 (+749972us) service_pool.cc:224] Handling call
0709 13:07:46.618143 (+461908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.593665 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:46.208279 20328 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.211s	user 0.006s	sys 0.003s
W20260709 13:07:46.361647 20241 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.000s
W20260709 13:07:46.196758 19976 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.001s
I20260709 13:07:46.152755 20255 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.587719 17125 rpcz_store.cc:276] 0709 13:07:44.106497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.106910 (+   413us) service_pool.cc:224] Handling call
0709 13:07:44.117229 (+ 10319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.604029 (+486800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.604060 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.604102 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:44.604132 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.161032 (+1556900us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:46.161092 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.161225 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1119041920}
I20260709 13:07:46.362283 20396 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.443351 20221 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.625156 19976 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.625444 20283 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.557330 20208 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.627372 19976 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:46.301369 20252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.001s	sys 0.040s
I20260709 13:07:46.608182 16613 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:46.494434 20269 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.585667 20220 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.008s	sys 0.032s
I20260709 13:07:46.201803 19937 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:46.144064 20317 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 2.455s	user 0.011s	sys 0.009s
I20260709 13:07:46.218544 20354 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.541986 20363 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:46.617060 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 578) took 1667 ms. Trace:
I20260709 13:07:46.640628 16610 rpcz_store.cc:276] 0709 13:07:44.949464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.949609 (+   145us) service_pool.cc:224] Handling call
0709 13:07:44.956640 (+  7031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.956928 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:45.071421 (+114493us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.616722 (+1545301us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.616788 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.616835 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.616897 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.617010 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80737,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":2012,"raft.queue_time_us":44727,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3271,"thread_start_us":1620667,"threads_started":3,"wal-append.queue_time_us":848021}
I20260709 13:07:46.619987 16542 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:46.592811 20384 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:46.205421 20348 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.409s
I20260709 13:07:46.618893 20382 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:46.602684 20290 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.763017 17118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 645) took 3371 ms (client timeout 1734 ms). Trace:
I20260709 13:07:46.629046 16466 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:46.358991 19984 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.512s	user 0.002s	sys 0.005s
I20260709 13:07:46.612013 20261 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:46.631354 20397 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.758772 20208 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:46.629761 20252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.002s	sys 0.043s
I20260709 13:07:46.767174 16470 raft_consensus.cc:2410] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:46.632220 20201 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:46.632452 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.019s
W20260709 13:07:46.769382 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.008s	sys 0.019s
I20260709 13:07:46.771312 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.629097 20241 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.773252 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:46.633739 20106 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.639134 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:46.703830 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 439) took 4012 ms (client timeout 2000 ms). Trace:
I20260709 13:07:46.698549 20382 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:46.720465 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 363680us
I20260709 13:07:46.781958 16469 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 5.
I20260709 13:07:46.782517 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 466) took 1374 ms. Trace:
I20260709 13:07:46.782837 16469 rpcz_store.cc:276] 0709 13:07:45.408216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.623500 (+1215284us) service_pool.cc:224] Handling call
0709 13:07:46.782460 (+158960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.710750 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:46.780966 16467 rpcz_store.cc:269] 0709 13:07:42.691062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.712206 (+ 21144us) service_pool.cc:224] Handling call
0709 13:07:46.703641 (+3991435us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000b3454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:46.703760 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828885376}
W20260709 13:07:46.636816 20220 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.008s	sys 0.033s
I20260709 13:07:46.701330 20281 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.639984 20269 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.663275 20389 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.632553 20045 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.610210 20323 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.753250 20384 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:46.700591 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.014s	sys 0.028s
W20260709 13:07:46.701686 16461 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.027s
I20260709 13:07:46.717180 20283 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:46.724875 20360 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.836s	user 0.009s	sys 0.001s
W20260709 13:07:46.709792 20394 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:07:46.763484 17118 rpcz_store.cc:269] 0709 13:07:43.391198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.391415 (+   217us) service_pool.cc:224] Handling call
0709 13:07:46.762797 (+3371382us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400641ed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:46.762943 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271761152}
I20260709 13:07:46.778445 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:46.779455 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:46.780056 16614 raft_consensus.cc:2393] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:46.784543 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.804582 16615 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:46.804804 16617 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:46.784811 16542 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.805006 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.787447 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:46.787758 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.806279 16467 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:46.790462 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:46.806741 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 460) took 1400 ms. Trace:
I20260709 13:07:46.793426 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.706987 20363 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.796594 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:46.811444 16469 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:46.797694 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.015s	sys 0.034s
W20260709 13:07:46.797739 16461 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.009s	sys 0.032s
W20260709 13:07:46.811888 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 722468us
I20260709 13:07:46.812316 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1960) took 1768 ms. Trace:
W20260709 13:07:46.799681 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.775987 20112 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.788689 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1738) took 3371 ms. Trace:
I20260709 13:07:46.793236 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.807122 16467 rpcz_store.cc:276] 0709 13:07:45.406543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.787164 (+1380621us) service_pool.cc:224] Handling call
0709 13:07:46.806682 (+ 19518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.808461 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:46.766559 20261 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.821619 20404 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:46.822171 20404 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.823400 20261 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.823680 20396 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:46.824136 20404 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.793944 20282 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.824709 20363 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.826207 20231 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.809845 20403 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:46.827354 20403 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.830978 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 633) took 1099 ms. Trace:
I20260709 13:07:46.831211 20241 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.831382 17119 rpcz_store.cc:276] 0709 13:07:45.731201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.752988 (+ 21787us) service_pool.cc:224] Handling call
0709 13:07:45.753395 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.618155 (+864760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.830745 (+212590us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400523854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:46.830920 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922439424}
I20260709 13:07:46.815861 16539 rpcz_store.cc:276] 0709 13:07:43.410140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.410299 (+   159us) service_pool.cc:224] Handling call
0709 13:07:43.425025 (+ 14726us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:43.425393 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.425421 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:43.431520 (+  6099us) log.cc:844] Serialized 52 byte log entry
0709 13:07:43.515217 (+ 83697us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:43.545972 (+ 30755us) log.cc:844] Serialized 14 byte log entry
0709 13:07:43.550937 (+  4965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.551026 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:45.821766 (+2270740us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:46.762097 (+940331us) raft_consensus.cc:1685] finished
0709 13:07:46.780984 (+ 18887us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.781186 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30563,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":10021,"raft.queue_time_us":1756,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":42862,"spinlock_wait_cycles":37096192,"thread_start_us":83266,"threads_started":1,"wal-append.queue_time_us":214725}
I20260709 13:07:46.817185 16611 raft_consensus.cc:2410] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:46.790935 20399 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:46.797192 20400 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:46.812646 16461 rpcz_store.cc:276] 0709 13:07:45.044099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.044223 (+   124us) service_pool.cc:224] Handling call
0709 13:07:45.044539 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:45.059489 (+ 14950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.059539 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:45.063593 (+  4054us) log.cc:844] Serialized 52 byte log entry
0709 13:07:45.822176 (+758583us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:45.881752 (+ 59576us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.812006 (+930254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.812093 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.812135 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:46.812148 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.812267 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4280,"prepare.queue_time_us":59343,"raft.queue_time_us":249062,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":9188,"spinlock_wait_cycles":55371776,"thread_start_us":1177283,"threads_started":2,"wal-append.queue_time_us":862377}
I20260709 13:07:46.849150 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:46.849602 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:46.817800 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:46.798740 20389 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:46.835084 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:46.836508 16610 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:46.864004 16610 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:46.864338 20389 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.839257 19976 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.839506 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.866209 20221 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.866919 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:46.865952 20321 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:46.867475 20321 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:46.865971 20389 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.868280 20285 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.868492 20321 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.869663 20321 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:46.874256 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.875069 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1761) took 1193 ms. Trace:
I20260709 13:07:46.875375 16541 rpcz_store.cc:276] 0709 13:07:45.681501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.873959 (+1192458us) service_pool.cc:224] Handling call
0709 13:07:46.875009 (+  1050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.876353 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.867494 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1746) took 1197 ms. Trace:
I20260709 13:07:46.877206 16545 rpcz_store.cc:276] 0709 13:07:45.669906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.839246 (+1169340us) service_pool.cc:224] Handling call
0709 13:07:46.867434 (+ 28188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.877878 20221 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.842643 20281 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:46.141805 16544 rpcz_store.cc:276] 0709 13:07:44.708760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.990935 (+282175us) service_pool.cc:224] Handling call
0709 13:07:45.007815 (+ 16880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.008006 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:45.818464 (+810458us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.140505 (+322041us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.140821 (+   316us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.140868 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:46.140920 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.140982 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:46.141233 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":48634,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":8342,"raft.queue_time_us":195,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6175,"thread_start_us":1116165,"threads_started":2}
I20260709 13:07:46.846884 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 631) took 1160 ms. Trace:
I20260709 13:07:46.881999 17123 rpcz_store.cc:276] 0709 13:07:45.686822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.686946 (+   124us) service_pool.cc:224] Handling call
0709 13:07:46.846645 (+1159699us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b540058ff54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:46.846804 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42274688}
I20260709 13:07:46.883123 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:46.847334 20269 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.766628 20397 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:46.847720 16462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1820) took 1778 ms (client timeout 1705 ms). Trace:
I20260709 13:07:46.810829 20401 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.849819 16463 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:46.887085 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1835) took 1309 ms. Trace:
I20260709 13:07:46.851078 16615 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:46.821302 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:46.888342 17118 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:46.887435 16463 rpcz_store.cc:276] 0709 13:07:45.577778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.848909 (+1271131us) service_pool.cc:224] Handling call
0709 13:07:46.887026 (+ 38117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.853012 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:46.857291 20282 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:46.810672 20384 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:46.857834 20241 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.891258 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.861595 20382 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.862138 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.892205 16539 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:46.848687 20323 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.862891 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:46.893096 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1760) took 1211 ms. Trace:
I20260709 13:07:46.893443 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1840) took 1108 ms. Trace:
I20260709 13:07:46.893784 16463 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:07:46.893836 16467 rpcz_store.cc:276] 0709 13:07:45.785087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.836202 (+1051115us) service_pool.cc:224] Handling call
0709 13:07:46.893391 (+ 57189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.864806 16610 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.894841 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1762) took 1213 ms. Trace:
I20260709 13:07:46.894996 16610 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.895200 16539 rpcz_store.cc:276] 0709 13:07:45.681767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.833499 (+1151732us) service_pool.cc:224] Handling call
0709 13:07:46.894790 (+ 61291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.836421 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1838) took 1104 ms. Trace:
I20260709 13:07:46.878095 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.879735 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:46.895985 16469 rpcz_store.cc:276] 0709 13:07:45.732353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.788657 (+1056304us) service_pool.cc:224] Handling call
0709 13:07:46.836365 (+ 47708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.784173 20290 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.893563 16544 rpcz_store.cc:276] 0709 13:07:45.681213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.889057 (+1207844us) service_pool.cc:224] Handling call
0709 13:07:46.893042 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.896862 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:46.839702 20403 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.864336 17119 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:46.885591 16462 rpcz_store.cc:269] 0709 13:07:45.068886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.070700 (+  1814us) service_pool.cc:224] Handling call
0709 13:07:46.847500 (+1776800us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400355cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:46.847620 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484710656}
I20260709 13:07:46.894459 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1818) took 1826 ms. Trace:
I20260709 13:07:46.898218 16463 rpcz_store.cc:276] 0709 13:07:45.068348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.893239 (+1824891us) service_pool.cc:224] Handling call
0709 13:07:46.893497 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.894245 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.894412 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.858093 20399 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.890762 16542 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:46.900043 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1763) took 1218 ms. Trace:
I20260709 13:07:46.890111 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:46.900739 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1750) took 1229 ms. Trace:
I20260709 13:07:46.901125 16545 rpcz_store.cc:276] 0709 13:07:45.670948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.877840 (+1206892us) service_pool.cc:224] Handling call
0709 13:07:46.900678 (+ 22838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.900158 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:46.900425 16542 rpcz_store.cc:276] 0709 13:07:45.682032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.678204 (+996172us) service_pool.cc:224] Handling call
0709 13:07:46.899990 (+221786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.903031 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:46.903259 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 180721us
I20260709 13:07:46.902673 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:46.866258 19976 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.906709 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.907358 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:46.907492 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.908020 16544 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:46.908074 16539 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.905948 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:46.892939 20324 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:46.918956 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.919790 16542 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:46.916043 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.920300 16545 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:46.884478 19937 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:07:46.919591 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:46.908969 17123 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:46.930120 17119 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:46.926403 16610 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:46.899467 20401 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.927449 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:46.930936 16610 pending_rounds.cc:85] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 9
I20260709 13:07:46.931658 16610 pending_rounds.cc:107] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:46.931953 16610 raft_consensus.cc:2889] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.899544 20282 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:46.933946 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.909386 20260 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:46.909576 20137 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:46.935344 20137 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.935712 20137 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.937160 20290 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:46.941031 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.941640 16545 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:46.948365 20399 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.933400 20281 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:46.949329 20281 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.950862 20299 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.951387 20281 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:46.951463 20299 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:46.897969 20241 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:46.952919 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.953562 16544 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:46.954108 19976 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.954408 20241 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:46.954485 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.955665 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:46.956177 16544 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.960639 20282 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:46.962668 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2143) took 2652 ms (client timeout 2175 ms). Trace:
W20260709 13:07:46.963084 16537 rpcz_store.cc:269] 0709 13:07:44.310422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.637362 (+326940us) service_pool.cc:224] Handling call
0709 13:07:46.962499 (+2325137us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54001aac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:46.962598 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167187328}
I20260709 13:07:46.964097 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.964553 20324 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:46.915736 20400 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:46.967453 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.985103 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:47.229161 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.020712 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.233886 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.011691 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:46.984994 16539 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:47.237025 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1764) took 1554 ms. Trace:
I20260709 13:07:47.237380 16539 rpcz_store.cc:276] 0709 13:07:45.682306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.895790 (+1213484us) service_pool.cc:224] Handling call
0709 13:07:47.236970 (+341180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:46.965512 20324 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:47.189322 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.779114 16536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1740) took 3645 ms (client timeout 1799 ms). Trace:
W20260709 13:07:47.781138 17119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.009s	sys 0.013s
I20260709 13:07:47.779505 16540 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:47.797502 17119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.010s	sys 0.014s
I20260709 13:07:47.015792 16544 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:47.281980 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.276533 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.918480 20106 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:47.799674 16537 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:47.698073 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.228348 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.805583 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.459657 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.806998 16539 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:47.379118 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.776098 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.809302 16542 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.001034 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:47.076041 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.796229 16536 rpcz_store.cc:269] 0709 13:07:44.133446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.137078 (+  3632us) service_pool.cc:224] Handling call
0709 13:07:47.778805 (+3641727us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54000334d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:47.779006 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536584960}
I20260709 13:07:47.799342 16545 raft_consensus.cc:2368] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:47.324874 16461 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 11 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:07:47.812903 17118 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:47.809935 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.570278 20410 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
W20260709 13:07:47.653685 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.434453 20392 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:07:47.810524 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.815960 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.817013 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:46.984413 20400 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:47.666601 20407 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.546700 20252 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:47.737833 20389 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.002s
I20260709 13:07:47.821683 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.828222 16536 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:47.804809 20323 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.295231 20225 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.018447 20397 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:47.370275 20303 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:47.825380 16537 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:47.819900 16544 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:47.838248 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.824106 20401 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:47.221441 20290 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:47.822089 20313 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.822294 20106 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.821125 20305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.015s	sys 0.012s
I20260709 13:07:47.826715 20412 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:47.827258 20051 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.312870 20219 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:47.426975 20137 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.831319 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.824327 20400 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:47.825436 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.870569 20237 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:47.870985 16545 raft_consensus.cc:2410] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:47.871196 20137 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:47.829229 20252 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:47.860527 20305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.015s	sys 0.013s
I20260709 13:07:47.845175 16544 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:47.846484 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 587) took 2267 ms. Trace:
I20260709 13:07:47.831063 20407 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.847539 20390 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:47.877481 16619 rpcz_store.cc:276] 0709 13:07:45.579488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.641532 (+ 62044us) service_pool.cc:224] Handling call
0709 13:07:45.723393 (+ 81861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.723732 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:45.752265 (+ 28533us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.777505 (+2025240us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b18003febc0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:07:47.846144 (+ 68639us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.846201 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:47.846253 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.846329 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.846434 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27078,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":989,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14501,"spinlock_wait_cycles":5419904,"thread_start_us":68373,"threads_started":1,"wal-append.queue_time_us":2116992}
I20260709 13:07:47.849438 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.879329 20252 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.880162 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.880808 20252 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:47.881264 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.881844 16537 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:47.882550 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.861467 16542 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:47.887421 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.887919 16542 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:47.862818 16539 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:47.864719 17118 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:47.832388 20323 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.871977 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.838318 20225 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.839416 20303 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.891928 16545 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:47.892867 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:47.898607 20323 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:47.892310 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:47.900488 16467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.010s	sys 0.042s
I20260709 13:07:47.901772 16544 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:47.902186 16467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.010s	sys 0.042s
I20260709 13:07:47.902684 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2156) took 3193 ms. Trace:
I20260709 13:07:47.903736 16545 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:47.906275 16544 rpcz_store.cc:276] 0709 13:07:44.709154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.901303 (+3192149us) service_pool.cc:224] Handling call
0709 13:07:47.901607 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.902363 (+   756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.902588 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.906598 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2157) took 3197 ms. Trace:
W20260709 13:07:47.907389 20370 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 2.220s	user 0.015s	sys 0.020s
I20260709 13:07:47.907193 16545 rpcz_store.cc:276] 0709 13:07:44.709478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.901218 (+3191740us) service_pool.cc:224] Handling call
0709 13:07:47.903409 (+  2191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.906343 (+  2934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.906535 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.907999 16544 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:47.860035 20313 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.908759 16537 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 5.
I20260709 13:07:47.911321 20303 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:47.908155 20368 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.850052 20401 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.861882 20290 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.862516 20106 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.872999 20412 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.916643 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:47.918992 16545 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:47.908690 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1748) took 2238 ms. Trace:
I20260709 13:07:47.920148 16539 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:47.925868 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:47.926303 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1747) took 2256 ms. Trace:
I20260709 13:07:47.919338 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:47.918418 20368 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.924996 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1749) took 2254 ms. Trace:
I20260709 13:07:47.926802 17120 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:47.913029 20323 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:47.927186 17118 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:07:47.926647 16539 rpcz_store.cc:276] 0709 13:07:45.670165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.909313 (+2239148us) service_pool.cc:224] Handling call
0709 13:07:47.919870 (+ 10557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.926082 (+  6212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.926254 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.925604 16544 rpcz_store.cc:276] 0709 13:07:45.670405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.907475 (+2237070us) service_pool.cc:224] Handling call
0709 13:07:47.907783 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.908428 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.908640 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:47.947088 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.949077 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.950073 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2096) took 3187 ms. Trace:
I20260709 13:07:47.949865 20400 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:47.950503 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.951638 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.952144 20400 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:47.899904 20390 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:47.929862 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.931972 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:47.933584 20414 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:47.917305 20225 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:47.921957 20313 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:47.922067 20106 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:47.934310 20415 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:47.935897 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.936700 16619 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:47.937443 16615 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.939723 20407 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:47.931391 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:47.942323 16614 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:47.943022 16545 rpcz_store.cc:276] 0709 13:07:45.670696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.908168 (+2237472us) service_pool.cc:224] Handling call
0709 13:07:47.918700 (+ 10532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.924697 (+  5997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.924933 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.944792 16536 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:47.950423 16613 rpcz_store.cc:276] 0709 13:07:44.762538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.763223 (+   685us) service_pool.cc:224] Handling call
0709 13:07:44.763523 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.629861 (+1866338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.949868 (+1320007us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54000d4dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:47.950021 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4241744128}
I20260709 13:07:47.953045 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.987069 16544 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:47.929631 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:47.952214 16616 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:47.953989 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 751) took 1008 ms. Trace:
I20260709 13:07:47.957520 16539 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:47.988083 17118 rpcz_store.cc:276] 0709 13:07:46.945310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.903034 (+957724us) service_pool.cc:224] Handling call
0709 13:07:47.953928 (+ 50894us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.956025 20397 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.961678 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.994244 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1752) took 2322 ms. Trace:
I20260709 13:07:47.977600 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1954) took 3316 ms. Trace:
W20260709 13:07:47.978672 16464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 1939) took 5184 ms (client timeout 2132 ms). Trace:
I20260709 13:07:47.952447 20223 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:47.981360 17127 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:47.981925 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:47.987746 16542 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:47.959008 16618 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:47.990963 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1755) took 2311 ms. Trace:
I20260709 13:07:47.997208 16544 rpcz_store.cc:276] 0709 13:07:45.679708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.989950 (+2310242us) service_pool.cc:224] Handling call
0709 13:07:47.990331 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.990554 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.990596 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.990655 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.990705 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.990777 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.990896 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.995113 16465 rpcz_store.cc:276] 0709 13:07:44.640754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.640913 (+   159us) service_pool.cc:224] Handling call
0709 13:07:44.641261 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.815053 (+173792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.815082 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.815120 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:44.815150 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.956482 (+3141332us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000b3954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:47.956527 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.956629 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399287168}
W20260709 13:07:47.995302 16464 rpcz_store.cc:269] 0709 13:07:42.771671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.774077 (+  2406us) service_pool.cc:224] Handling call
0709 13:07:47.956317 (+5182240us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000b2f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:47.956411 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4542258048}
I20260709 13:07:47.999382 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1756) took 2319 ms. Trace:
I20260709 13:07:47.999706 16544 rpcz_store.cc:276] 0709 13:07:45.680045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.998673 (+2318628us) service_pool.cc:224] Handling call
0709 13:07:47.998943 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.999090 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.999114 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.999150 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.999179 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.999226 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.999331 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.991637 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 747) took 1078 ms. Trace:
I20260709 13:07:48.000924 17120 rpcz_store.cc:276] 0709 13:07:46.906222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.981261 (+1075039us) service_pool.cc:224] Handling call
0709 13:07:47.983968 (+  2707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.984221 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.984263 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.984324 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:47.984385 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.984465 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.984634 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.992923 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 748) took 1086 ms. Trace:
I20260709 13:07:48.008569 17118 rpcz_store.cc:276] 0709 13:07:46.906813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.991810 (+1084997us) service_pool.cc:224] Handling call
0709 13:07:47.992210 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.992450 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.992491 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.992553 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:47.992603 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.992688 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.992853 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.994633 16539 rpcz_store.cc:276] 0709 13:07:45.671347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.945029 (+2273682us) service_pool.cc:224] Handling call
0709 13:07:47.957205 (+ 12176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.988427 (+ 31222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.994186 (+  5759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.013599 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1825) took 2943 ms. Trace:
I20260709 13:07:48.014051 16464 rpcz_store.cc:276] 0709 13:07:45.070085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.012830 (+2942745us) service_pool.cc:224] Handling call
0709 13:07:48.013134 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.013295 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.013319 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.013360 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.013396 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.013445 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.013545 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:47.996294 17127 pending_rounds.cc:85] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 8
I20260709 13:07:48.017951 17127 pending_rounds.cc:107] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:48.018208 17127 raft_consensus.cc:2889] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.980602 20323 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:48.026134 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.028347 16545 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:48.031036 20407 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.031548 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.024734 20313 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:48.032310 16619 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:48.031581 20407 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.032346 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1822) took 2963 ms. Trace:
I20260709 13:07:48.032616 20313 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.036003 16539 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.036842 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1758) took 2356 ms. Trace:
W20260709 13:07:48.037431 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.037992 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.037268 16539 rpcz_store.cc:276] 0709 13:07:45.680612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.010114 (+2329502us) service_pool.cc:224] Handling call
0709 13:07:48.035845 (+ 25731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.036510 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.036744 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.040455 16610 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:48.043677 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 749) took 1115 ms. Trace:
I20260709 13:07:48.050514 16464 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.053498 17120 rpcz_store.cc:276] 0709 13:07:46.928741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.028507 (+1099766us) service_pool.cc:224] Handling call
0709 13:07:48.043246 (+ 14739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.043394 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.043418 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.043456 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.043485 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.043538 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.043628 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.033253 16467 rpcz_store.cc:276] 0709 13:07:45.069362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.916042 (+1846680us) service_pool.cc:224] Handling call
0709 13:07:46.916353 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.918783 (+  2430us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:46.999660 (+ 80877us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.902713 (+903053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.904266 (+  1553us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.904419 (+   153us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.904938 (+   519us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.906128 (+  1190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.906208 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.032111 (+125903us) raft_consensus.cc:1685] finished
0709 13:07:48.032132 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.032256 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2852,"prepare.queue_time_us":831612,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":86,"raft.queue_time_us":17358,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":19595,"spinlock_wait_cycles":7225600,"thread_start_us":797950,"threads_started":2,"wal-append.queue_time_us":956709}
I20260709 13:07:48.054081 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 462) took 2647 ms. Trace:
I20260709 13:07:48.052455 16545 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:48.055595 16464 rpcz_store.cc:276] 0709 13:07:45.407095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.027295 (+2620200us) service_pool.cc:224] Handling call
0709 13:07:48.050261 (+ 22966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.053720 (+  3459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.054001 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.056200 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 559) took 1203 ms. Trace:
I20260709 13:07:48.056582 16545 rpcz_store.cc:276] 0709 13:07:46.852817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.029265 (+1176448us) service_pool.cc:224] Handling call
0709 13:07:48.052016 (+ 22751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.055968 (+  3952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.056150 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.058331 16610 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.059726 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.061154 16467 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:07:48.061259 16542 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:48.062199 20419 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.063275 20426 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.062803 20419 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.065547 20420 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.066500 20223 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.066080 20420 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.068843 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.069448 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:48.071767 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 463) took 2664 ms. Trace:
I20260709 13:07:48.072217 16467 rpcz_store.cc:276] 0709 13:07:45.407373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.060520 (+2653147us) service_pool.cc:224] Handling call
0709 13:07:48.060926 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.071528 (+ 10602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.071716 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.075106 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1824) took 3005 ms. Trace:
I20260709 13:07:48.075587 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:48.076252 16545 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:48.077673 16610 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:48.062153 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.074954 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 654) took 1288 ms. Trace:
I20260709 13:07:48.078720 16542 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
W20260709 13:07:48.086938 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 196406us
I20260709 13:07:48.008330 20397 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.094718 16539 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.095381 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1766) took 1184 ms. Trace:
I20260709 13:07:48.095705 16539 rpcz_store.cc:276] 0709 13:07:46.911296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.070047 (+1158751us) service_pool.cc:224] Handling call
0709 13:07:48.094578 (+ 24531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.095129 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.095328 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.093164 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:48.075670 16465 rpcz_store.cc:276] 0709 13:07:45.069853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.012280 (+2942427us) service_pool.cc:224] Handling call
0709 13:07:48.012788 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.031016 (+ 18228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.031053 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.031601 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.074794 (+ 43193us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:48.074831 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.074894 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.074935 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:48.074946 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.075054 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14027,"raft.queue_time_us":48817,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":42792,"threads_started":1,"wal-append.queue_time_us":32673}
I20260709 13:07:48.078758 17119 rpcz_store.cc:276] 0709 13:07:46.786675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.930689 (+144014us) service_pool.cc:224] Handling call
0709 13:07:46.955142 (+ 24453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.965006 (+  9864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.965035 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.965446 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.798193 (+832747us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:47.798244 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.798339 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.074762 (+276423us) raft_consensus.cc:1685] finished
0709 13:07:48.074782 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.074901 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9499,"raft.queue_time_us":10462,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13473,"thread_start_us":832300,"threads_started":1,"wal-append.queue_time_us":868676}
I20260709 13:07:48.067793 20426 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:48.113850 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.111994 16509 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:48.114696 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.115334 16542 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:48.108703 16545 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:48.116555 16545 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:48.117054 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1773) took 1202 ms. Trace:
I20260709 13:07:48.117332 16545 rpcz_store.cc:276] 0709 13:07:46.914785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.116114 (+1201329us) service_pool.cc:224] Handling call
0709 13:07:48.116337 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.116887 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.117014 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.126081 16539 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:48.126780 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1772) took 1212 ms. Trace:
I20260709 13:07:48.127240 16539 rpcz_store.cc:276] 0709 13:07:46.914492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.096426 (+1181934us) service_pool.cc:224] Handling call
0709 13:07:48.125778 (+ 29352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.126558 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.126729 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.074038 20250 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:48.074124 20223 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.138501 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.139557 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:48.144730 16434 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:48.145028 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1836) took 2534 ms. Trace:
I20260709 13:07:48.145543 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:48.146162 17119 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:48.145569 16464 rpcz_store.cc:276] 0709 13:07:45.610561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.125303 (+2514742us) service_pool.cc:224] Handling call
0709 13:07:48.135727 (+ 10424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.140429 (+  4702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.140478 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.144587 (+  4109us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.144658 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.144751 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.144939 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4184}
I20260709 13:07:48.118703 20401 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:48.141542 16539 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:48.155049 20259 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:48.158937 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2163) took 1127 ms. Trace:
I20260709 13:07:48.161859 16539 rpcz_store.cc:276] 0709 13:07:47.031325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.128022 (+1096697us) service_pool.cc:224] Handling call
0709 13:07:48.141290 (+ 13268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.158596 (+ 17306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.158861 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.160478 20290 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:48.142683 20421 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.196913 20421 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:48.137409 20323 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.157537 20295 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:48.268971 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 124284us
I20260709 13:07:48.269428 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:48.138130 20250 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.282588 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.284682 16619 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.285472 20421 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:48.286360 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.287045 16539 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:07:48.288141 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.294291 20223 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:48.289310 16539 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:48.297351 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1757) took 2617 ms. Trace:
I20260709 13:07:48.345199 20438 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:48.506198 16539 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:48.372925 16617 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:48.290241 16464 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:48.506963 17119 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.270540 20430 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.515542 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1839) took 2757 ms. Trace:
I20260709 13:07:48.516294 20430 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:48.487622 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.516892 16464 rpcz_store.cc:276] 0709 13:07:45.758468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.148053 (+2389585us) service_pool.cc:224] Handling call
0709 13:07:48.289924 (+141871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.515292 (+225368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.515464 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.515314 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 468) took 3106 ms. Trace:
W20260709 13:07:48.362427 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:48.508586 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.519968 16467 rpcz_store.cc:276] 0709 13:07:45.408943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.073111 (+2664168us) service_pool.cc:224] Handling call
0709 13:07:48.073393 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.182443 (+109050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.182494 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.183100 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.481036 (+297936us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:48.514797 (+ 33761us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.515017 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.515098 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.515135 (+    37us) raft_consensus.cc:1685] finished
0709 13:07:48.515148 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.515262 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63169,"prepare.queue_time_us":26868,"raft.queue_time_us":60803,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":10158,"thread_start_us":139809,"threads_started":2,"wal-append.queue_time_us":165428}
I20260709 13:07:48.270987 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:48.296228 16542 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:48.506069 16544 rpcz_store.cc:276] 0709 13:07:45.680333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.000515 (+2320182us) service_pool.cc:224] Handling call
0709 13:07:48.011293 (+ 10778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.011785 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.011823 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.025599 (+ 13776us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.154815 (+129216us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:48.154857 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.155473 (+   616us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.268527 (+113054us) raft_consensus.cc:1685] finished
0709 13:07:48.268553 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.297283 (+ 28730us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":11975,"thread_start_us":86833,"threads_started":1,"wal-append.queue_time_us":105960}
W20260709 13:07:48.431680 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 195039us
I20260709 13:07:48.515419 20421 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.522887 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2166) took 1299 ms. Trace:
I20260709 13:07:48.361526 20362 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.543689 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.529912 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.547698 16619 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:48.412698 20219 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.536216 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.563072 16544 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:48.288678 20428 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:48.346442 20420 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:48.345145 20434 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.588863 20434 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.590767 20350 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:48.584627 20428 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:48.593672 20428 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:48.559623 20362 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:48.596089 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2167) took 1372 ms. Trace:
I20260709 13:07:48.550515 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:48.531028 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.523211 20384 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:48.338012 20407 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:48.292649 20412 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:48.514591 20426 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:48.528858 20438 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:48.549564 20421 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:48.597198 16545 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:48.659765 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 543) took 5249 ms. Trace:
I20260709 13:07:48.623149 17121 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:48.638695 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 738) took 3651 ms. Trace:
I20260709 13:07:48.810603 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1831) took 3364 ms. Trace:
I20260709 13:07:48.907851 17126 rpcz_store.cc:276] 0709 13:07:44.971473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.971959 (+   486us) service_pool.cc:224] Handling call
0709 13:07:44.972229 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.358263 (+386034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.622302 (+3264039us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54004d0b54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:48.622574 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872523520}
I20260709 13:07:48.537837 16539 rpcz_store.cc:276] 0709 13:07:47.223294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.505660 (+1282366us) service_pool.cc:224] Handling call
0709 13:07:48.506036 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.522661 (+ 16625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.522837 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.596454 16537 rpcz_store.cc:276] 0709 13:07:47.223985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.882359 (+658374us) service_pool.cc:224] Handling call
0709 13:07:48.595910 (+713551us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b540031b354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:48.596030 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50209664}
I20260709 13:07:48.908016 16461 rpcz_store.cc:276] 0709 13:07:45.446521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.849392 (+1402871us) service_pool.cc:224] Handling call
0709 13:07:48.810293 (+1960901us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400379e54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:48.810522 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090209152}
W20260709 13:07:48.941792 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 670835us
I20260709 13:07:48.906459 16543 rpcz_store.cc:276] 0709 13:07:43.390025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.390210 (+   185us) service_pool.cc:224] Handling call
0709 13:07:43.416288 (+ 26078us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.944511 (+1528223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.638623 (+3694112us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000c0654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:48.638896 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364706176}
I20260709 13:07:48.973551 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 740) took 3998 ms. Trace:
I20260709 13:07:48.974591 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:48.974967 16461 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:48.976118 16461 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:48.972479 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 66684.9us
I20260709 13:07:48.973345 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 649) took 4169 ms. Trace:
I20260709 13:07:48.585412 20223 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.022950 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.024250 16614 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:48.980015 17122 rpcz_store.cc:276] 0709 13:07:44.804195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.804958 (+   763us) service_pool.cc:224] Handling call
0709 13:07:44.814769 (+  9811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.928537 (+113768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.973091 (+4044554us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b5400684554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:48.973278 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198487296}
I20260709 13:07:48.985626 16543 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:48.986645 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:48.997125 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.031302 16610 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:48.808914 20434 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.005867 20391 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:49.009948 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.012707 20426 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.586436 20219 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.013798 19984 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.596612 20362 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:48.696143 20303 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.014552 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.041923 19984 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.043493 20426 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.044361 19984 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:49.046933 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1826) took 3971 ms (client timeout 3025 ms). Trace:
I20260709 13:07:49.048233 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2148) took 4504 ms. Trace:
I20260709 13:07:49.048961 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2168) took 1824 ms. Trace:
I20260709 13:07:48.851402 20428 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:49.045068 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.048761 16540 rpcz_store.cc:276] 0709 13:07:44.544238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.706184 (+161946us) service_pool.cc:224] Handling call
0709 13:07:47.779238 (+3073054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.797914 (+ 18676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.048034 (+1250120us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b54000334d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.048173 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7011319552}
I20260709 13:07:48.685128 20397 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.037906 16537 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:49.047676 16470 rpcz_store.cc:269] 0709 13:07:45.075268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.768094 (+692826us) service_pool.cc:224] Handling call
0709 13:07:49.046724 (+3278630us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54000b4854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.046863 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232391936}
I20260709 13:07:49.050786 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.032747 20223 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.054183 16543 rpcz_store.cc:276] 0709 13:07:47.224663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.959564 (+1734901us) service_pool.cc:224] Handling call
0709 13:07:48.985470 (+ 25906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.048697 (+ 63227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.048908 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.974514 17124 rpcz_store.cc:276] 0709 13:07:44.975125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.975257 (+   132us) service_pool.cc:224] Handling call
0709 13:07:44.988034 (+ 12777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:45.585610 (+597576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:45.585639 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:45.585695 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:45.585736 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.973316 (+3387580us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b5400578ad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:48.973364 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.973495 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11516,"raft.queue_time_us":10050,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9246,"spinlock_wait_cycles":1351256320}
I20260709 13:07:49.034816 20391 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:49.057183 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2170) took 1831 ms. Trace:
I20260709 13:07:49.060940 16537 rpcz_store.cc:276] 0709 13:07:47.226087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.037443 (+1811356us) service_pool.cc:224] Handling call
0709 13:07:49.037730 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.056939 (+ 19209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.057139 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.057215 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.062773 16619 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:49.058265 16540 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:49.056728 20223 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.063819 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 561) took 1780 ms. Trace:
I20260709 13:07:49.057938 20255 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.064610 16540 rpcz_store.cc:276] 0709 13:07:47.283857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.053943 (+1770086us) service_pool.cc:224] Handling call
0709 13:07:49.058079 (+  4136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.063572 (+  5493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.063768 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.047753 20303 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.064785 16543 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:49.068184 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2151) took 4414 ms. Trace:
I20260709 13:07:49.068557 16538 rpcz_store.cc:276] 0709 13:07:44.653434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.804312 (+150878us) service_pool.cc:224] Handling call
0709 13:07:44.804621 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:44.805097 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:07:45.004087 (+198990us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.559366 (+3555279us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b1800002f80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:07:48.904368 (+345002us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.904969 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.905199 (+   230us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:49.065596 (+160397us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.065861 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.065925 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.068024 (+  2099us) raft_consensus.cc:1685] finished
0709 13:07:49.068039 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.068142 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":222242,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":4319,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":13326,"spinlock_wait_cycles":2792320,"thread_start_us":682531,"threads_started":3,"wal-append.queue_time_us":3806867}
I20260709 13:07:49.071782 16538 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:49.072566 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1779) took 1224 ms. Trace:
I20260709 13:07:49.072796 20299 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.072983 16538 rpcz_store.cc:276] 0709 13:07:47.848328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.071174 (+1222846us) service_pool.cc:224] Handling call
0709 13:07:49.071530 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.072309 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.072512 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:49.074101 16466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1832) took 3587 ms (client timeout 2846 ms). Trace:
W20260709 13:07:49.074486 16466 rpcz_store.cc:269] 0709 13:07:45.486842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.130827 (+643985us) service_pool.cc:224] Handling call
0709 13:07:49.073913 (+2943086us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.074036 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204354816}
I20260709 13:07:49.074965 20259 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.074648 16538 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:49.075467 20259 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.075959 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1780) took 1199 ms. Trace:
I20260709 13:07:49.076339 16538 rpcz_store.cc:276] 0709 13:07:47.876845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.073990 (+1197145us) service_pool.cc:224] Handling call
0709 13:07:49.074325 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.075724 (+  1399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.075907 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.078387 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2173) took 1769 ms. Trace:
I20260709 13:07:49.067234 20255 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.080988 20391 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.082113 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1834) took 3543 ms. Trace:
I20260709 13:07:49.082489 16465 rpcz_store.cc:276] 0709 13:07:45.538554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.104719 (+2566165us) service_pool.cc:224] Handling call
0709 13:07:48.105066 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:48.261273 (+156207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.261313 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:48.280648 (+ 19335us) log.cc:844] Serialized 52 byte log entry
0709 13:07:48.498995 (+218347us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:48.659908 (+160913us) log.cc:844] Serialized 14 byte log entry
0709 13:07:48.660512 (+   604us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.080354 (+419842us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18003f9460. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa370b3d70 00007ffa370a7293 00007ffa3709ccea 00007ffa3709d23a 00007ffa37507a2a 00007ffa375170bf 00007ffa37517038
0709 13:07:49.080586 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.081846 (+  1260us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54000b3e54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:49.081891 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.081933 (+    42us) raft_consensus.cc:1685] finished
0709 13:07:49.081943 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.082063 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150991,"prepare.queue_time_us":38276,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":103334,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":18404,"spinlock_wait_cycles":199762944,"thread_start_us":313322,"threads_started":2,"wal-append.queue_time_us":214694}
I20260709 13:07:49.078709 16543 rpcz_store.cc:276] 0709 13:07:47.308717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.059876 (+1751159us) service_pool.cc:224] Handling call
0709 13:07:49.064601 (+  4725us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.069846 (+  5245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.078338 (+  8492us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:49.084609 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.085374 16543 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:49.086669 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1969) took 1022 ms. Trace:
I20260709 13:07:49.087571 20223 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.088464 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2178) took 1048 ms. Trace:
I20260709 13:07:49.089017 16538 rpcz_store.cc:276] 0709 13:07:48.039942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.087674 (+1047732us) service_pool.cc:224] Handling call
0709 13:07:49.087962 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.088147 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.088177 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.088221 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:49.088264 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.088316 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.088410 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.090273 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1774) took 2175 ms. Trace:
I20260709 13:07:49.087064 16464 rpcz_store.cc:276] 0709 13:07:48.064614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.517761 (+453147us) service_pool.cc:224] Handling call
0709 13:07:48.518110 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.530125 (+ 12015us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.530172 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.553072 (+ 22900us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.052287 (+499215us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.052332 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.052551 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.086468 (+ 33917us) raft_consensus.cc:1685] finished
0709 13:07:49.086488 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.086614 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5364,"raft.queue_time_us":24521,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":41571,"thread_start_us":356601,"threads_started":1,"wal-append.queue_time_us":442458}
I20260709 13:07:49.090646 16545 rpcz_store.cc:276] 0709 13:07:46.915063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.117904 (+1202841us) service_pool.cc:224] Handling call
0709 13:07:48.596881 (+478977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.906038 (+309157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.090086 (+184048us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540031b350. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.090218 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067888896}
I20260709 13:07:49.091179 20223 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.098090 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:49.082154 20391 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:49.116290 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.117379 20438 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.122195 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.123132 16539 raft_consensus.cc:2410] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:07:49.132403 16538 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:49.134763 16545 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:49.138324 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.138381 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.140216 20255 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.147850 20428 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.150082 20249 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.153380 20303 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.131420 19937 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:07:49.158964 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.159472 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 739) took 4187 ms. Trace:
I20260709 13:07:49.159672 17124 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:49.159894 17127 rpcz_store.cc:276] 0709 13:07:44.971748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.976263 (+  4515us) service_pool.cc:224] Handling call
0709 13:07:44.996067 (+ 19804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.037825 (+3041758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.159206 (+1121381us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b5400551754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:49.159411 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6862014336}
I20260709 13:07:49.177959 20426 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.179386 20419 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:49.183784 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.184839 20375 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.185503 20375 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:49.188664 20448 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:49.190982 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1971) took 1125 ms. Trace:
I20260709 13:07:49.191350 16462 rpcz_store.cc:276] 0709 13:07:48.065191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.559679 (+494488us) service_pool.cc:224] Handling call
0709 13:07:48.560151 (+   472us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:48.587134 (+ 26983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.587183 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:48.588048 (+   865us) log.cc:844] Serialized 78 byte log entry
0709 13:07:49.052448 (+464400us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:49.061011 (+  8563us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.061713 (+   702us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.061911 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.061979 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.188314 (+126335us) spinlock_profiling.cc:243] Waited 924 us on lock 0x7b1800403d80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:49.190761 (+  2447us) raft_consensus.cc:1685] finished
0709 13:07:49.190783 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.190928 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":320,"prepare.queue_time_us":16732,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":14930,"raft.queue_time_us":34940,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":4696,"spinlock_wait_cycles":5354368,"thread_start_us":389688,"threads_started":1,"wal-append.queue_time_us":401412}
I20260709 13:07:49.209250 20371 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:49.209810 20371 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.211462 20259 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.213721 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2117) took 1282 ms. Trace:
I20260709 13:07:49.214241 20259 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:49.216367 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.214063 16617 rpcz_store.cc:276] 0709 13:07:47.931056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.931176 (+   120us) service_pool.cc:224] Handling call
0709 13:07:49.213566 (+1282390us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54002490d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.213663 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890362752}
I20260709 13:07:49.218907 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.219575 16612 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:49.209425 20375 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.221925 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.222074 20260 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.222224 20304 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:49.229202 20260 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.222613 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.230619 16545 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:49.222110 19937 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.231494 19937 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.231879 19937 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.223181 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.223735 19748 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:49.227012 20303 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:49.227844 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.243072 19937 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.245234 19937 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:49.245754 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.246421 16544 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:07:49.247319 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.253837 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.257360 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.257771 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.257797 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.258173 16468 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:49.258507 16464 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.258730 16465 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
W20260709 13:07:49.257241 17093 connection.cc:256] RPC call timeout handler was delayed by -2.9417657669999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:07:49.256163 20393 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:49.260416 20393 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.263298 20393 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:49.264605 16466 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:49.267416 20390 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.268473 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.269577 16616 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:49.270730 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.271492 16619 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:49.272655 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.273460 16615 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
W20260709 13:07:49.275554 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 298181us
I20260709 13:07:49.277221 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.277923 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 634) took 3537 ms. Trace:
I20260709 13:07:49.277987 16468 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:49.278429 17121 rpcz_store.cc:276] 0709 13:07:45.740850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.131252 (+390402us) service_pool.cc:224] Handling call
0709 13:07:48.622897 (+2491645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.906789 (+283892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.277730 (+370941us) spinlock_profiling.cc:243] Waited 2.49 s on lock 0x7b54004d0b50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.277868 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5729333504}
I20260709 13:07:49.279279 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:44.827463 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:49.280570 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.281140 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:49.282528 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.268641 20430 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.285019 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.288173 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.285573 16469 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:49.290586 20299 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.290807 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.291611 16463 raft_consensus.cc:2410] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:07:49.291291 20299 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.292394 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.290592 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.293910 16461 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:07:49.256470 20311 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.298955 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.299710 16470 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:49.301993 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.310067 20354 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:49.309757 20311 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.310478 20354 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:49.311333 20354 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.312364 20354 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.313766 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.295209 16468 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:49.292933 16463 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 5.
I20260709 13:07:49.296200 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.316948 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:49.317512 17124 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.318122 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.318674 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:49.318900 17093 connection.cc:256] RPC call timeout handler was delayed by -2.8258672639999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:07:49.319144 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:49.319267 17093 connection.cc:256] RPC call timeout handler was delayed by -2.7536657670000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260709 13:07:49.319389 16469 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:49.293213 20051 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:49.295136 19984 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.297317 20286 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:49.227566 20371 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.330597 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.331138 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.320283 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:49.321364 16536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2176) took 1518 ms (client timeout 1862 ms). Trace:
I20260709 13:07:49.321457 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.332561 16469 raft_consensus.cc:2410] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:07:49.332267 16536 rpcz_store.cc:269] 0709 13:07:47.802791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.831063 (+ 28272us) service_pool.cc:224] Handling call
0709 13:07:49.321175 (+1490112us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b5400381154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.321303 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172588928}
W20260709 13:07:49.322284 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94510us
I20260709 13:07:49.322664 17127 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:49.323868 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.324628 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.331140 16466 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.334328 16538 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:49.325239 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.326382 16464 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:49.327343 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.335438 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:49.335809 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.297468 20419 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:49.328238 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.328783 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.340189 16463 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:07:49.340277 17123 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:49.329921 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.341337 17118 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:49.319772 17093 connection.cc:256] RPC call timeout handler was delayed by -2.61956576700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260709 13:07:49.330226 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:49.336129 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 79290.4us
I20260709 13:07:49.342327 16461 raft_consensus.cc:2410] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:49.334057 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.337589 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.342921 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.311930 20311 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.339408 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.341172 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:49.347065 17127 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.345386 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:49.344020 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.331907 17120 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:49.358294 19937 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:49.358903 19937 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:49.343255 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.364039 16461 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:07:49.364916 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.365288 16470 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:49.362584 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.366731 17123 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:49.367868 19937 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.342170 20390 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:49.361020 20311 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.371196 20401 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.366329 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.378281 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.379129 17120 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:49.337280 20303 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.387956 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.388564 16464 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.389766 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.375594 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.391523 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:49.377017 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:49.392865 17093 connection.cc:256] RPC call timeout handler was delayed by -2.5718657670000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:07:49.393251 17093 connection.cc:256] RPC call timeout handler was delayed by -2.5718657670000766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
I20260709 13:07:49.393332 17090 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:49.393559 17093 connection.cc:256] RPC call timeout handler was delayed by -2.4527592460000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 13:07:49.394014 17093 connection.cc:256] RPC call timeout handler was delayed by -2.3443672639999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:07:49.394340 17093 connection.cc:256] RPC call timeout handler was delayed by -1.9965512080000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17600000000000002s for a response
I20260709 13:07:49.394398 20461 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:49.394755 17093 connection.cc:256] RPC call timeout handler was delayed by -1.7189700470000844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 13:07:49.394888 20461 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.395085 17093 connection.cc:256] RPC call timeout handler was delayed by -1.7053501599999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:07:49.395316 20461 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:49.395409 17093 connection.cc:256] RPC call timeout handler was delayed by -1.6430657670000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2952s for a response
W20260709 13:07:49.395798 17093 connection.cc:256] RPC call timeout handler was delayed by -1.6352700470000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:07:49.396081 17093 connection.cc:256] RPC call timeout handler was delayed by -1.5701657670000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3033s for a response
W20260709 13:07:49.396356 17093 connection.cc:256] RPC call timeout handler was delayed by -1.5254540460000499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
I20260709 13:07:49.399026 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:49.398605 17127 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:07:49.380957 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.332507 19984 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:49.400815 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 100719us
W20260709 13:07:49.401448 16511 connection.cc:256] RPC call timeout handler was delayed by -3.6686093700000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24009999999999998s for a response
W20260709 13:07:49.401814 16511 connection.cc:256] RPC call timeout handler was delayed by -3.6686093700000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24009999999999998s for a response
W20260709 13:07:49.402112 16511 connection.cc:256] RPC call timeout handler was delayed by -3.6223588109999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
I20260709 13:07:49.402325 19984 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.371894 20311 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:49.402413 16511 connection.cc:256] RPC call timeout handler was delayed by -3.5827841850000368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2543s for a response
I20260709 13:07:49.381873 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.404973 16468 raft_consensus.cc:2376] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11. Re-sending same reply.
I20260709 13:07:49.406044 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.406808 16468 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:07:49.407040 16511 connection.cc:256] RPC call timeout handler was delayed by -3.4153588109999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:07:49.407433 16511 connection.cc:256] RPC call timeout handler was delayed by -3.4153588109999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:07:49.407563 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.409879 20323 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.409787 16511 connection.cc:256] RPC call timeout handler was delayed by -3.3388841849999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
W20260709 13:07:49.410708 16511 connection.cc:256] RPC call timeout handler was delayed by -3.3388841849999835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28140000000000004s for a response
I20260709 13:07:49.410594 20323 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.412263 20259 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:49.412809 20259 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.328604 20393 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:49.379299 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.383651 17124 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:07:49.427965 16466 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:07:49.415583 16511 connection.cc:256] RPC call timeout handler was delayed by -3.1070093700000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3025s for a response
W20260709 13:07:49.456261 16511 connection.cc:256] RPC call timeout handler was delayed by -3.1070093700000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3025s for a response
I20260709 13:07:49.432957 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.456990 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.457700 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.458372 16541 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:49.458452 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.434227 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:49.456625 16511 connection.cc:256] RPC call timeout handler was delayed by -3.0349270340000203s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:07:49.435096 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:49.459836 16511 connection.cc:256] RPC call timeout handler was delayed by -3.0067588109999406s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:07:49.460204 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6449977359999366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 13:07:49.436687 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.330770 20051 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:49.439574 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.461441 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.461988 16466 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:49.462957 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.464177 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.440734 20286 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.468415 20219 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.468353 20304 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:49.469463 20313 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.436371 20350 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.472283 20350 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:49.473011 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.473608 16543 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:49.474324 20350 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.475134 20371 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.475853 20368 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:49.441284 20259 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.441887 20250 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.477408 20299 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.478425 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1778) took 1642 ms. Trace:
I20260709 13:07:49.437755 20253 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:07:49.478781 16540 rpcz_store.cc:276] 0709 13:07:47.836248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.065471 (+1229223us) service_pool.cc:224] Handling call
0709 13:07:49.321771 (+256300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.321945 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.321967 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.322008 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:49.322046 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.322097 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.478275 (+156178us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b5400381150. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.478367 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587296128}
I20260709 13:07:49.442759 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 742) took 2719 ms. Trace:
I20260709 13:07:49.479918 17125 rpcz_store.cc:276] 0709 13:07:46.723388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.723520 (+   132us) service_pool.cc:224] Handling call
0709 13:07:46.736020 (+ 12500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.828094 (+ 92074us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:46.828398 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.905480 (+ 77082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.905534 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:46.905583 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.442538 (+2536955us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54005537d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:49.442583 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.442703 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10008,"prepare.queue_time_us":4627,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":3951,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14377,"spinlock_wait_cycles":211214720,"thread_start_us":76701,"threads_started":1,"wal-append.queue_time_us":174469,"wal-append.run_cpu_time_us":19417,"wal-append.run_wall_time_us":1805468}
I20260709 13:07:49.481276 20366 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:49.482765 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 581) took 4515 ms (client timeout 1920 ms). Trace:
W20260709 13:07:49.483170 16612 rpcz_store.cc:269] 0709 13:07:44.967492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.967619 (+   127us) service_pool.cc:224] Handling call
0709 13:07:49.482576 (+4514957us) spinlock_profiling.cc:243] Waited 4.22 s on lock 0x7b540019f5d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.482678 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9706940160}
I20260709 13:07:49.438848 20390 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.485049 20323 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.485241 20390 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:49.486207 20390 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.486677 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.487435 16465 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:49.488157 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.489264 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.489777 16461 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.385151 20303 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:49.441967 20393 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.493052 20303 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.493152 20393 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.493665 20393 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.494046 16465 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 7: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:49.494846 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.496137 16465 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:49.416822 20252 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.441277 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.446058 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.452288 16464 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:49.415210 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1775) took 1596 ms. Trace:
I20260709 13:07:49.516952 16537 rpcz_store.cc:276] 0709 13:07:47.819632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.061913 (+1242281us) service_pool.cc:224] Handling call
0709 13:07:49.091884 (+ 29971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.092151 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:49.106691 (+ 14540us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.141418 (+ 34727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.141470 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.141508 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.141554 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.415049 (+273495us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b54002909d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:49.415158 (+   109us) inbound_call.cc:177] Queueing success response
0709 13:07:49.471148 (+ 55990us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800003040. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
Metrics: {"prepare.queue_time_us":41646,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":92,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":605,"spinlock_wait_cycles":108589056,"thread_start_us":48604,"threads_started":2,"wal-append.queue_time_us":42751}
I20260709 13:07:49.433827 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.519088 16536 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:49.466656 16466 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:49.467528 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 74249.5us
I20260709 13:07:49.520798 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:49.461887 16433 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 2.175s (SENT)
I20260709 13:07:49.497768 16470 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:49.521395 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:49.521975 16464 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:49.522194 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60323.9us
I20260709 13:07:49.498788 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.523134 16470 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:07:49.523229 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.378074 20401 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:49.513237 16511 connection.cc:256] RPC call timeout handler was delayed by -2.5522977359999004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 13:07:49.525719 16511 connection.cc:256] RPC call timeout handler was delayed by -2.4235588109999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2846s for a response
W20260709 13:07:49.526142 16511 connection.cc:256] RPC call timeout handler was delayed by -2.4235588109999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2846s for a response
W20260709 13:07:49.526520 16511 connection.cc:256] RPC call timeout handler was delayed by -1.9406979010000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 13:07:49.526887 16511 connection.cc:256] RPC call timeout handler was delayed by -1.9406979010000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 13:07:49.527277 16511 connection.cc:256] RPC call timeout handler was delayed by -1.8481224249999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:07:49.527073 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:49.527731 16511 connection.cc:256] RPC call timeout handler was delayed by -1.3970979010000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3246s for a response
W20260709 13:07:49.528172 16511 connection.cc:256] RPC call timeout handler was delayed by -1.3970979010000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3246s for a response
I20260709 13:07:49.520895 16466 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:07:49.531653 16466 pending_rounds.cc:85] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:07:49.531895 16466 pending_rounds.cc:107] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:49.532135 16466 raft_consensus.cc:2889] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.533675 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.503898 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:49.534281 16536 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:49.534416 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:49.535404 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:49.530840 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.525274 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:49.540449 16468 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:49.540938 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:49.539729 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:49.543264 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 225650us
I20260709 13:07:49.545742 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:49.552460 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.552713 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:49.556130 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.515132 20252 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:49.556589 16461 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:49.553124 16612 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:49.553341 17125 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:49.559674 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:49.530566 20401 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.524959 20313 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.539419 20304 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.566674 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.590308 16536 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.567849 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.573625 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.564635 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:49.574910 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.591691 16611 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:49.557046 20286 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.590914 16538 raft_consensus.cc:2376] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8. Re-sending same reply.
W20260709 13:07:49.578537 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.563424 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:49.566927 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 170129us
I20260709 13:07:49.593792 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.585498 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.594144 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:49.593343 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.553402 20350 raft_consensus.cc:2764] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:49.598598 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:49.595153 16540 raft_consensus.cc:2376] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12. Re-sending same reply.
I20260709 13:07:49.598811 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:49.595786 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:49.517530 20371 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:07:49.538959 20463 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.597486 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.642964 16538 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.584556 20294 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.575151 20419 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:49.648687 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.544292 20375 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:07:49.554201 20255 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:49.558234 19748 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:07:49.596549 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:49.764405 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 167906us
I20260709 13:07:49.765334 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.641778 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:49.644814 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46108.5us
I20260709 13:07:49.766637 16541 raft_consensus.cc:2376] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9. Re-sending same reply.
I20260709 13:07:49.767515 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:49.602449 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:49.768021 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:49.768996 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 166612us
I20260709 13:07:49.770417 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:49.568779 20241 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.562319 19984 raft_consensus.cc:2764] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:49.575002 20362 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.649348 16540 raft_consensus.cc:2376] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11. Re-sending same reply.
I20260709 13:07:49.784314 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.562294 20106 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.536892 20391 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:07:49.651336 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.652233 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.789207 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:49.652460 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 53919.9us
I20260709 13:07:49.653124 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.654040 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.641995 20397 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:49.595491 20304 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:49.589227 20328 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.771340 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:49.592952 20286 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.749418 16536 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:49.661487 20313 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.563024 20250 raft_consensus.cc:2764] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:49.597036 20384 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 13:07:49.786161 20438 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:49.794495 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.648797 20294 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.789907 16613 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:49.805977 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.797850 20368 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:49.644685 20448 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:49.813685 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.844832 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.845093 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.845460 16617 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:07:49.812950 20304 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.846133 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:49.759064 20354 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.791893 20443 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.846750 20421 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:49.846922 20354 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.847558 20354 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.600754 20430 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:49.818874 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.849217 20430 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.849615 20430 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:49.814018 20428 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.642380 20463 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.866557 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.789922 16615 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:49.650166 20364 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.828120 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.784004 20241 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.772337 20419 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:49.891925 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 126673us
I20260709 13:07:49.892612 16616 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:49.839797 20368 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.832681 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.900148 16610 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:49.860689 20313 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.836339 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:49.837052 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.840526 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.813112 20286 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.601112 20219 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.228s
I20260709 13:07:49.812352 20328 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.907205 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:49.848876 20443 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:49.783892 20259 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:49.795871 20464 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:49.863521 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 281189us
I20260709 13:07:49.643025 20461 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.820516 16538 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:49.826678 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.818123 20397 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:49.879940 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.880964 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:49.882334 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:49.797659 20362 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:49.886901 20428 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:49.839217 20294 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.829839 20438 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.972354 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:49.831149 16541 raft_consensus.cc:2376] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10. Re-sending same reply.
I20260709 13:07:49.664287 20350 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.225s
I20260709 13:07:49.809198 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:49.982154 16618 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:49.908180 17127 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:49.902979 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:49.983583 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 80722.3us
I20260709 13:07:49.908892 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:49.792459 20252 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:49.871825 20463 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.907966 20328 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:49.884202 20364 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:49.664000 20460 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:49.892156 20241 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.905268 20368 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.953027 20260 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:49.950376 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69499.9us
I20260709 13:07:49.969851 19748 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:49.950433 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:49.952394 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:49.953213 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:50.031306 16469 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:49.914207 20443 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:49.978406 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.645514 20299 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:49.977664 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:49.914173 20051 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:49.986949 16540 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:49.997081 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 77630.4us
I20260709 13:07:49.934525 16536 raft_consensus.cc:2376] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10. Re-sending same reply.
I20260709 13:07:49.986373 20438 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.018433 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:50.019248 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 247948us
I20260709 13:07:50.012389 20364 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.995412 20313 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:07:50.048086 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 97734.6us
I20260709 13:07:50.038478 20299 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:50.051591 20299 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.046317 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:50.058434 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:50.058670 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:50.059415 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 81859.6us
I20260709 13:07:50.060176 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:50.093088 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:50.059433 20465 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 13:07:50.108242 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.004s
W20260709 13:07:50.108572 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.004s
W20260709 13:07:50.108866 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 564883us
W20260709 13:07:50.112299 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52217.9us
I20260709 13:07:50.091342 20375 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:50.115814 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 348343us
I20260709 13:07:50.091600 19748 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.095094 20250 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:50.107847 20371 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:50.122273 16470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.003s	sys 0.002s
I20260709 13:07:50.119398 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:50.127056 16470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.003s	sys 0.002s
W20260709 13:07:50.115058 20366 consensus_meta.cc:287] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.005s
I20260709 13:07:50.129447 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:50.130856 16540 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.049448 20397 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.045877 20470 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 13:07:50.120962 20303 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.002s
W20260709 13:07:50.146834 20393 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 13:07:50.123442 20250 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.155704 20250 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.155622 20393 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.157133 20299 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.157892 20393 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.158603 20393 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:50.159355 20299 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.159796 20419 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:50.160073 20299 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:50.117936 20249 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.154883 20461 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.114164 20260 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:07:50.160744 20481 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:50.163272 20311 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.092504 20428 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.144172 20479 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:50.123364 20478 raft_consensus.cc:2764] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:50.170120 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.143278 16540 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:50.159426 20427 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.126451 20384 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.127605 20375 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:50.182518 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 172841us
W20260709 13:07:50.174182 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123015us
W20260709 13:07:50.184345 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59813.6us
I20260709 13:07:50.203351 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:50.124478 20477 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.142498 20371 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.198498 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:50.143682 20475 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.177791 20390 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:50.180171 20366 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.181741 20223 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.204136 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:50.185207 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126599us
I20260709 13:07:50.225126 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:50.210844 20438 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.177488 20299 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:50.227977 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:50.138773 16544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.005s	sys 0.004s
I20260709 13:07:50.197074 20479 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:50.228745 17121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.007s	sys 0.007s
W20260709 13:07:50.237317 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 117977us
I20260709 13:07:50.176344 20303 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.242795 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:50.196257 20219 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:07:50.257622 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:50.218672 20477 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:50.220465 20475 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.194002 20249 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.265317 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:50.196723 20354 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.236304 20478 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.236117 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:50.197777 20304 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:50.259768 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 142682us
I20260709 13:07:50.220191 20391 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:07:50.278779 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:50.281778 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:50.257462 20481 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.249716 20051 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.249253 20384 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:50.228032 20366 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.284261 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:50.284286 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48386.7us
W20260709 13:07:50.274318 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 67075.2us
W20260709 13:07:50.286928 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61919.7us
I20260709 13:07:50.296022 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:50.264986 20475 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.217149 19748 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.276324 20390 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.293098 16466 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:50.218253 20427 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.299094 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:50.265434 20477 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.303782 20391 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:50.303872 20473 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:07:50.285827 20375 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.307214 20303 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.309576 20366 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:50.310093 20421 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:50.311862 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.312901 20494 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:07:50.291435 20371 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.322712 20497 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:50.289112 20384 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:50.286751 20478 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:50.325574 20438 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.288862 20474 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.408565 20474 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.409098 20474 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.288465 20461 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.282297 20362 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.330700 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:50.275447 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:50.372268 20223 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.372498 20259 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.372730 20393 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.330757 20487 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:50.493000 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 217603us
I20260709 13:07:50.345705 20390 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.373584 20219 consensus_queue.cc:1059] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:50.293453 20299 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:50.347555 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51613us
I20260709 13:07:50.622568 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:50.416996 20461 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:50.623703 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:50.349301 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 50335us
I20260709 13:07:50.331053 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:50.362601 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.367189 20481 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:50.341956 20401 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.000s
I20260709 13:07:50.329960 20354 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:50.331159 20260 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:50.406585 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 163859us
W20260709 13:07:50.417647 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 87012.8us
I20260709 13:07:50.429157 20259 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:50.489763 20393 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.330459 20253 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:07:50.329661 20286 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.429800 20460 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:50.563115 20362 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.419296 20485 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:50.345134 20480 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:50.560629 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:50.642678 19937 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:50.657248 20493 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:07:50.655366 20259 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.328733 20443 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:50.500337 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 216124us
W20260709 13:07:50.567114 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.637460 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:50.643729 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:50.430234 20303 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:50.644654 17124 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:50.420269 20223 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.349833 20391 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.648212 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:50.701926 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53811.7us
I20260709 13:07:50.453569 20467 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:50.427067 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 295029us
I20260709 13:07:50.651492 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:07:50.621160 20368 consensus_meta.cc:287] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.001s
W20260709 13:07:50.642576 20328 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.024s
I20260709 13:07:50.418346 20364 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:50.621471 20463 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.011s
I20260709 13:07:50.384477 20498 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:50.645162 20461 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.383783 20421 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:07:50.675405 20483 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:50.387743 20479 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:50.505327 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.684732 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82612.9us
I20260709 13:07:50.336040 20430 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.658802 20393 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.687887 20313 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:50.562935 20250 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.743746 19937 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:50.678393 20480 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.669404 20496 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:50.646582 20401 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.678423 20485 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.672504 20362 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:50.670497 20481 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:50.712653 20407 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:50.701687 20223 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.711761 16509 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:50.885629 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 173826us
I20260709 13:07:50.783776 20364 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.674660 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 474) took 1423 ms. Trace:
W20260709 13:07:50.863662 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 176853us
I20260709 13:07:50.771920 19937 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.743070 20368 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.708091 20106 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:50.888892 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:50.889721 20106 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:50.687386 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 193640us
I20260709 13:07:50.892247 20368 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.869315 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1793) took 1303 ms. Trace:
I20260709 13:07:50.789868 20401 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:50.888306 16462 rpcz_store.cc:276] 0709 13:07:49.251657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.251801 (+   144us) service_pool.cc:224] Handling call
0709 13:07:49.252104 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.413217 (+1161113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.413253 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.413298 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.413333 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.674413 (+261080us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003561d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:50.674462 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.674597 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84591,"raft.queue_time_us":71947,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":73575,"spinlock_wait_cycles":2516077312,"thread_start_us":66638,"threads_started":1}
I20260709 13:07:50.900236 16542 rpcz_store.cc:276] 0709 13:07:49.566051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.566160 (+   109us) service_pool.cc:224] Handling call
0709 13:07:49.597052 (+ 30892us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:49.650406 (+ 53354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.650451 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:49.769986 (+119535us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.129108 (+359122us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:50.295991 (+166883us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.419037 (+123046us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.638525 (+219488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.638634 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.868667 (+230033us) raft_consensus.cc:1685] finished
0709 13:07:50.868708 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.869119 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279943,"prepare.queue_time_us":74030,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":22720,"raft.queue_time_us":733923,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":53318,"thread_start_us":606483,"threads_started":3,"wal-append.queue_time_us":606661}
I20260709 13:07:50.871033 20286 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:50.768467 20294 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.772s	user 0.007s	sys 0.004s
I20260709 13:07:50.904294 20294 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.907191 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:50.907605 20294 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:50.770666 20241 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.003s
I20260709 13:07:50.909276 20241 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.912032 20241 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:50.692417 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48752.8us
W20260709 13:07:50.714774 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63351.9us
W20260709 13:07:50.873893 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.769346 20313 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:50.917157 16619 raft_consensus.cc:2368] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:50.917954 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 660) took 1617 ms. Trace:
I20260709 13:07:50.917487 20313 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.785678 20304 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.749378 20328 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:50.700188 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62810.8us
I20260709 13:07:50.876739 20252 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.922158 17123 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.925176 17119 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:50.924562 17126 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:50.925475 20328 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.926437 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.926566 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.863678 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1797) took 1295 ms. Trace:
I20260709 13:07:50.925483 16612 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:50.883123 20219 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:50.887426 16509 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:50.710421 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:50.891707 20106 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.868990 20250 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.661089 20260 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.711647 20303 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.957365 20499 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.958197 20499 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.958765 20499 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:50.958392 20303 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.772207 20391 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.775573 20362 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.961944 20391 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.961422 20524 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:50.748270 20249 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.892695 16436 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:50.893289 20354 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:50.891732 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:50.895725 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:50.888602 19937 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:50.897045 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:50.870601 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1791) took 1305 ms. Trace:
I20260709 13:07:50.908398 17125 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:50.669220 20384 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.881904 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.791988 20419 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:50.798224 20427 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:50.800118 20430 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.798260 20461 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.801685 20443 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:50.990643 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 280194us
I20260709 13:07:50.992233 20461 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.781584 20475 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.992565 20260 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.993824 17123 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:50.996124 20475 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:50.824155 20477 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.779600 20407 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:50.777907 20421 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.001701 20438 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:51.002287 20438 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.002751 20438 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.003062 20421 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.003252 20477 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:50.786537 20460 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:50.972292 16545 rpcz_store.cc:276] 0709 13:07:49.565433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.565559 (+   126us) service_pool.cc:224] Handling call
0709 13:07:49.596734 (+ 31175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.649436 (+ 52702us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:07:49.763629 (+114193us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.286328 (+522699us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.417906 (+131578us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.418381 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.418550 (+   169us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.418588 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.418683 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.869980 (+451297us) raft_consensus.cc:1685] finished
0709 13:07:50.870035 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.870366 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197943,"prepare.queue_time_us":183176,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":647813,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":102727,"spinlock_wait_cycles":15104,"thread_start_us":460525,"threads_started":2,"wal-append.queue_time_us":392781}
I20260709 13:07:51.005241 20460 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:51.005578 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.006229 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.750342 20463 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.751868 20464 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:50.712992 20467 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:51.009300 20467 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.009529 20463 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.010697 20470 raft_consensus.cc:2764] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:07:50.797076 20468 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.676s	user 0.003s	sys 0.009s
W20260709 13:07:51.013567 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 126431us
I20260709 13:07:50.819145 20474 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.014765 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:51.015421 16509 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:50.775601 20485 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:50.677979 20478 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.025764 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 576) took 1492 ms. Trace:
W20260709 13:07:50.794651 20491 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:07:51.026338 16539 rpcz_store.cc:276] 0709 13:07:49.533238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.533368 (+   130us) service_pool.cc:224] Handling call
0709 13:07:49.537595 (+  4227us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:49.553835 (+ 16240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.553864 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:49.564396 (+ 10532us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.558967 (+994571us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18004621c0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:07:50.870647 (+311680us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.871595 (+   948us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.904536 (+ 32941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.904708 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.025026 (+120318us) raft_consensus.cc:1685] finished
0709 13:07:51.025198 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.025489 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61346,"prepare.queue_time_us":66064,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":10662,"raft.queue_time_us":142946,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":42915,"spinlock_wait_cycles":59583104,"thread_start_us":310927,"threads_started":1,"wal-append.queue_time_us":1230906}
I20260709 13:07:50.780045 20496 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.773028 20480 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.809347 20481 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:50.982048 20524 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.759613 20498 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:50.825750 20522 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:50.714680 20503 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:50.785490 20506 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 13:07:50.918437 17121 rpcz_store.cc:276] 0709 13:07:49.300896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.301011 (+   115us) service_pool.cc:224] Handling call
0709 13:07:49.321626 (+ 20615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.537082 (+215456us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:49.652158 (+115076us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.243546 (+591388us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:50.243600 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.243656 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.917421 (+673765us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54004b1754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:50.917485 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.917739 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1236,"prepare.queue_time_us":279701,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":2930,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8688,"spinlock_wait_cycles":495006592,"thread_start_us":679132,"threads_started":2,"wal-append.queue_time_us":766137}
I20260709 13:07:50.949855 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1854) took 1126 ms. Trace:
I20260709 13:07:50.934357 20393 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:50.974164 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.973534 17118 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.973567 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:50.927165 16544 rpcz_store.cc:276] 0709 13:07:49.568421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.568885 (+   464us) service_pool.cc:224] Handling call
0709 13:07:49.569214 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.237495 (+668281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.237526 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.245265 (+  7739us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.745025 (+499760us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:50.745075 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.745154 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.862821 (+117667us) raft_consensus.cc:1685] finished
0709 13:07:50.862921 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.863409 (+   488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98796,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":8798,"thread_start_us":1130503,"threads_started":2,"wal-append.queue_time_us":508410}
I20260709 13:07:50.971853 20354 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.985060 20419 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:50.985785 20509 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:50.986446 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.987319 17120 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:50.988478 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:50.988838 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 97282.7us
I20260709 13:07:50.984472 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:50.992370 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:50.988886 16536 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:07:50.998723 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 106401us
I20260709 13:07:51.005327 17127 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:51.035075 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 1985) took 1667 ms. Trace:
W20260709 13:07:50.795830 20507 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:07:51.043323 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:51.045146 20474 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:51.047504 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1847) took 1397 ms (client timeout 1645 ms). Trace:
I20260709 13:07:51.013499 20407 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:51.048935 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.061399 19984 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:51.065346 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1792) took 1499 ms. Trace:
W20260709 13:07:51.065804 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60313us
W20260709 13:07:51.095484 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 80206.2us
I20260709 13:07:51.110081 20524 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:51.080466 20498 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:51.575179 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.573318 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 200146us
W20260709 13:07:51.232054 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.119609 16368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 271) took 39590 ms (client timeout 15000 ms). Trace:
W20260709 13:07:51.588349 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.589437 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.583161 16619 rpcz_store.cc:276] 0709 13:07:49.801352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.801466 (+   114us) service_pool.cc:224] Handling call
0709 13:07:50.920604 (+1119138us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003e6a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:50.928024 (+  7420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301636352}
I20260709 13:07:51.135226 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.121622 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:51.582376 16612 rpcz_store.cc:269] 0709 13:07:49.650578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.650715 (+   137us) service_pool.cc:224] Handling call
0709 13:07:51.047271 (+1396556us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002477d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:51.047431 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2622075264}
W20260709 13:07:51.593218 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.115195 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:51.119364 20259 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.598016 17125 raft_consensus.cc:2368] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13.
I20260709 13:07:51.598531 20384 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.599193 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.599850 20259 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.597913 20479 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.114043 20219 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.608659 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 616465us
I20260709 13:07:51.581918 16465 rpcz_store.cc:276] 0709 13:07:49.367381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.496806 (+129425us) service_pool.cc:224] Handling call
0709 13:07:49.497062 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.497398 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.497425 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.516895 (+ 19470us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.781011 (+264116us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:49.781065 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.781162 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.796321 (+1015159us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:51.034275 (+237954us) raft_consensus.cc:1685] finished
0709 13:07:51.034359 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.034759 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8760,"raft.queue_time_us":3470,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9671,"spinlock_wait_cycles":6533888,"thread_start_us":217929,"threads_started":1,"wal-append.queue_time_us":485396}
W20260709 13:07:51.609369 20362 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.626s	user 0.017s	sys 0.009s
I20260709 13:07:51.241935 20516 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.582573 16543 rpcz_store.cc:276] 0709 13:07:49.565758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.565867 (+   109us) service_pool.cc:224] Handling call
0709 13:07:49.566197 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.795809 (+229612us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:49.841086 (+ 45277us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.280216 (+439130us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.417835 (+137619us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.419450 (+  1615us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.419589 (+   139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:50.491257 (+ 71668us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.563179 (+ 71922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.563308 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.794158 (+230850us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:50.812023 (+ 17865us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b180035ce60. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:07:51.064899 (+252876us) raft_consensus.cc:1685] finished
0709 13:07:51.064936 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.065144 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":560783,"prepare.queue_time_us":120386,"prepare.run_cpu_time_us":166,"prepare.run_wall_time_us":50169,"raft.queue_time_us":576107,"raft.run_cpu_time_us":536,"raft.run_wall_time_us":43277,"spinlock_wait_cycles":95534848,"thread_start_us":576476,"threads_started":3,"wal-append.queue_time_us":483825}
I20260709 13:07:51.611213 20525 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.600606 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:51.541579 20391 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.007s
I20260709 13:07:51.584546 20354 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:51.617146 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.612366 20524 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:51.619192 17119 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:51.621294 20362 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.622287 20516 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.623680 20503 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.624492 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.624724 17122 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.625097 20299 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:51.624500 20219 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.625712 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.509714 20460 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.626076 20393 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:51.629204 19748 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.628997 19984 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:51.630307 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 515391us
I20260709 13:07:51.630826 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 673) took 1461 ms. Trace:
I20260709 13:07:51.630842 20477 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:51.634132 20526 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.520s	user 0.025s	sys 0.033s
W20260709 13:07:51.636610 20485 consensus_meta.cc:287] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:07:51.566134 20223 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.637529 20419 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:51.639071 19937 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.004s
I20260709 13:07:51.639228 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.644100 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.616534 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.660885 20503 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:51.649085 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.649041 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 43892.4us
I20260709 13:07:51.656565 17125 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:51.649398 20260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.019s	sys 0.032s
I20260709 13:07:51.662828 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.665195 17127 rpcz_store.cc:276] 0709 13:07:50.169616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.169852 (+   236us) service_pool.cc:224] Handling call
0709 13:07:51.630579 (+1460727us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b540047bb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:51.630747 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842942720}
I20260709 13:07:51.669057 17126 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:51.653570 20313 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.681098 20419 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:51.682687 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.683701 17120 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:51.667402 16583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.886s (SENT) [suppressed 39 similar messages]
I20260709 13:07:51.672863 20485 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.138497 20464 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.685659 20485 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.686576 20241 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.687161 17125 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:51.678716 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.680478 17121 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.689311 17118 raft_consensus.cc:2410] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:51.690594 17118 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.687219 20241 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.679913 20223 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.681293 19937 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.693162 20241 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:51.694036 17118 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.694152 19984 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:51.695021 19937 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:51.684486 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:51.682060 20260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.019s	sys 0.033s
I20260709 13:07:51.700238 17121 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:51.701190 16583 leader_election.cc:336] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.500s (SENT)
I20260709 13:07:51.702435 20460 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.134447 20496 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.703147 17122 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:51.668282 19748 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.706522 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:51.703199 16583 leader_election.cc:336] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.838s (SENT)
I20260709 13:07:51.706923 19748 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:51.707253 16619 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:51.707760 16583 leader_election.cc:336] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.852s (SENT)
I20260709 13:07:51.708173 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:51.709029 19748 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:51.709263 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:51.710191 20393 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.714507 20516 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.715044 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:51.716647 20524 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.722886 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:51.723879 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:51.725911 16467 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.727041 20259 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:51.729336 20499 consensus_meta.cc:287] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.007s
I20260709 13:07:51.729874 20499 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.733197 16545 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:51.738274 20219 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:51.738590 20480 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.000s
I20260709 13:07:51.739007 20480 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:51.741047 20467 consensus_meta.cc:287] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.000s
I20260709 13:07:51.741227 20362 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.741478 20467 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.744359 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:51.745982 16462 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:07:51.749949 17122 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:51.751895 20497 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.752497 20497 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:51.755654 17123 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:51.732615 20499 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:51.755306 20497 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.757817 17127 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:51.760942 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:51.756744 16536 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:51.773299 17123 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:51.778899 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:51.779682 17121 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:51.782359 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:51.782265 20460 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.761200 20525 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.758299 20516 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.759949 20438 consensus_meta.cc:287] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.757s	user 0.013s	sys 0.000s
I20260709 13:07:51.784025 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:51.792528 16470 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:51.765017 20467 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.797036 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:51.772431 20480 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:51.765470 20391 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:51.802366 16612 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:07:51.806445 16612 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:51.806401 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:51.810767 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:51.811455 16463 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.809337 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:51.817539 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 102666us
W20260709 13:07:51.818734 16583 leader_election.cc:336] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 2.246s (SENT)
I20260709 13:07:51.819247 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:51.819630 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.814769 20485 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.793897 20438 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.841740 16470 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:51.807426 20407 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.795351 20525 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:51.852761 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 93769.3us
I20260709 13:07:51.827512 20467 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:51.854768 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:51.831034 20252 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.844270 20478 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.035s	sys 0.073s
W20260709 13:07:51.589191 16368 rpcz_store.cc:269] 0709 13:07:11.617687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.627266 (+  9579us) service_pool.cc:224] Handling call
0709 13:07:51.119300 (+39492034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:42.038018 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:42.038667 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:42.038719 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:07:42.038736 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:42.039986 (+  1250us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:42.040064 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:42.040100 (+    36us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:42.045751 (+  5651us) tablet.cc:701] Row locks acquired
0709 13:07:42.045798 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:07:42.045986 (+   188us) write_op.cc:270] Start()
0709 13:07:42.046127 (+   141us) write_op.cc:276] Timestamp: P: 1783602462045916 usec, L: 0
0709 13:07:42.046145 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:07:42.046827 (+   682us) log.cc:844] Serialized 5174 byte log entry
0709 13:07:42.398758 (+351931us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:42.741522 (+342764us) op_driver.cc:464] REPLICATION: finished
0709 13:07:43.030216 (+288694us) write_op.cc:301] APPLY: starting
0709 13:07:43.060085 (+ 29869us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:43.078826 (+ 18741us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:43.078867 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:43.080569 (+  1702us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:43.185941 (+105372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:07:43.195896 (+  9955us) write_op.cc:312] APPLY: finished
0709 13:07:43.312127 (+116231us) log.cc:844] Serialized 95 byte log entry
0709 13:07:43.353902 (+ 41775us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.369860 (+ 15958us) write_op.cc:454] Released schema lock
0709 13:07:43.384361 (+ 14501us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:43.471424 (+ 87063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:43.477086 (+  5662us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":321796,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":240075,"apply.run_cpu_time_us":5190,"apply.run_wall_time_us":413947,"num_ops":13,"prepare.queue_time_us":216874,"prepare.run_cpu_time_us":12113,"prepare.run_wall_time_us":87409,"raft.queue_time_us":107015,"raft.run_cpu_time_us":39679,"raft.run_wall_time_us":181919,"replication_time_us":695185,"spinlock_wait_cycles":6119808,"thread_start_us":445486,"threads_started":4,"wal-append.queue_time_us":211303,"wal-append.run_cpu_time_us":22345,"wal-append.run_wall_time_us":2239015}]]}
I20260709 13:07:51.863770 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:51.877926 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.881017 20241 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.881245 20260 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.883765 16539 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.856421 20467 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:07:51.873481 20478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.035s	sys 0.073s
I20260709 13:07:51.831737 16367 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 7 to 10, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 10 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:51.917443 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:51.943727 16619 raft_consensus.cc:2368] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
W20260709 13:07:51.881742 20421 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.002s
I20260709 13:07:51.950982 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:51.956696 16544 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
W20260709 13:07:51.969280 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 348136us
I20260709 13:07:51.969182 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:07:51.975593 20303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.000s	sys 0.035s
W20260709 13:07:51.976157 20303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.000s	sys 0.035s
W20260709 13:07:51.978089 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 202718us
W20260709 13:07:51.919030 20475 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.845s	user 0.025s	sys 0.036s
I20260709 13:07:51.983619 16612 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:51.988356 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45724.1us
I20260709 13:07:51.988085 20252 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.995406 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 176708us
W20260709 13:07:51.986714 20475 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.025s	sys 0.036s
I20260709 13:07:51.881774 20241 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:51.997877 17124 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:07:52.002362 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.004168 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 174915us
I20260709 13:07:51.989040 16367 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:51.898782 20260 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:52.005911 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.006562 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:52.009872 16467 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.015007 16538 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:52.015110 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:51.908222 20354 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.024999 16618 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:51.982049 20499 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:07:52.003979 20463 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.027889 16463 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:07:52.027843 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 112571us
I20260709 13:07:52.016708 20371 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.036437 16462 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:07:52.044756 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 138764us
I20260709 13:07:52.045984 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.048019 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:52.048942 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:52.049674 16469 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:52.050359 20469 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:52.051491 20469 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.051842 20469 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:52.053489 20535 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.053100 16367 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.053855 20535 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:52.054833 20535 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.054989 16367 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.055910 20498 consensus_queue.cc:1059] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:52.056842 20498 raft_consensus.cc:3055] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.057196 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.056559 16367 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 8, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.057770 16612 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.058405 16367 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.059877 20354 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:52.056684 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.062695 17119 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:52.060559 20354 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:52.084263 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.019454 20252 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:52.057641 20241 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:52.059898 16367 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 8, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.037657 20478 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.090703 16367 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 9, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 9 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.057216 20498 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:52.093030 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:52.087817 20485 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.095749 16367 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 7 to 10, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.098675 20421 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:52.099238 20421 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:52.100145 16367 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 8 to 12, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 12 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.101840 16367 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:52.102640 20533 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:52.095840 20407 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:52.104074 16463 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.105752 16367 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.107509 16436 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:52.107944 16367 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 7, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 7 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.114464 20485 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.114907 20485 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.115288 20485 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.115873 16538 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:52.115540 16367 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:07:52.039129 20542 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:07:52.117123 16544 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:52.118207 20544 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:07:52.118412 16542 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.118906 20421 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:52.119549 20481 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:52.036204 20463 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.121294 16468 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:52.121248 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:52.122125 16541 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:52.123472 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:52.124086 16537 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.124202 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.126017 20473 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.126398 20473 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:52.089344 20496 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:52.090865 20371 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:52.108961 20509 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:52.120249 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:52.119634 16536 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.052704 20469 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:52.153317 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60177.7us
I20260709 13:07:52.162148 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.092981 20438 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:52.140201 20497 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:52.187289 16539 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
W20260709 13:07:52.188184 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 191701us
I20260709 13:07:52.133701 16612 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:52.137252 20478 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:52.176066 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.153561 20541 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 13:07:52.178413 20509 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.178992 16540 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.154685 19984 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:52.195479 16467 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:52.234869 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:52.234823 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 200600us
I20260709 13:07:52.236639 20469 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.237058 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 112929us
I20260709 13:07:52.238955 16436 leader_election.cc:400] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:52.239439 16436 leader_election.cc:403] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:52.242359 16537 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
W20260709 13:07:52.243065 20522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.018s	sys 0.016s
W20260709 13:07:52.244099 20522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.019s	sys 0.017s
I20260709 13:07:52.244542 20522 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:52.245894 20522 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:52.249527 16583 leader_election.cc:336] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 2.199s (SENT)
I20260709 13:07:52.232791 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:52.165592 20525 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:52.183033 20497 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:52.254621 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:52.260455 16467 raft_consensus.cc:2410] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:52.255998 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:52.256460 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 208501us
I20260709 13:07:52.258939 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.261173 17118 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:52.232642 20260 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:52.268934 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.269901 20503 consensus_meta.cc:287] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.574s	user 0.001s	sys 0.008s
I20260709 13:07:52.270361 20503 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:52.273487 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.264887 16465 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.265758 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:52.267055 20371 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:52.276953 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:52.262725 20497 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:52.272650 20503 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:52.286996 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:52.263818 16537 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:52.288817 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.263058 20362 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.277040 20384 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:52.293869 17119 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:52.296705 17127 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:52.287070 20485 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:52.297593 16461 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.299105 20485 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:52.301251 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.304823 16613 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:07:52.305040 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 71454.3us
I20260709 13:07:52.305514 19984 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.306578 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.308247 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:52.309069 16536 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:07:52.310563 20313 consensus_meta.cc:287] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.627s	user 0.005s	sys 0.006s
I20260709 13:07:52.276849 20478 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.311642 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:52.312347 16610 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:52.286861 20421 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.314007 20509 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:52.320369 16616 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:52.326534 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.327340 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:52.291293 20548 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.339169 16540 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:07:52.395327 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 64606.7us
W20260709 13:07:52.411330 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.421990 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 115511us
W20260709 13:07:52.428321 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.428512 20555 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:52.433176 16536 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:52.365123 20469 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:52.445374 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 189281us
I20260709 13:07:52.601068 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:52.608729 16543 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:52.330660 20485 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.315482 20362 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:52.603156 16357 maintenance_manager.cc:419] P e0b8327892f143ffba83cd5a4c97d808: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033400
I20260709 13:07:52.615149 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:52.634146 16544 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.712590 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:52.759838 16543 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:52.610241 20485 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.763918 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:52.749361 16545 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:52.767220 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:52.768536 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 487074us
W20260709 13:07:52.761998 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 439715us
I20260709 13:07:52.774107 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.774937 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:52.778761 16614 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.776693 16542 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:52.786814 17118 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:52.783674 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:52.789319 17125 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:07:52.790514 16537 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:52.791431 16541 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:52.811771 16536 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:52.814798 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:52.786362 20260 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:52.785542 20509 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.783875 20106 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:52.785970 19984 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.835848 16544 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:52.836514 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.843232 17121 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:52.814116 20469 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:52.837893 20106 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.840416 20485 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:52.838596 20525 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.820922 20313 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:07:52.847327 20503 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:52.883643 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:52.890915 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 104649us
W20260709 13:07:52.915030 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.882757 20106 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.916465 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:52.840799 20509 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.871590 19984 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:52.896530 20485 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:52.916251 20304 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.635s	user 0.017s	sys 0.024s
I20260709 13:07:52.900386 20503 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:52.884114 20391 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:07:53.178750 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.900177 20525 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:53.005105 16583 leader_election.cc:336] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.523s (SENT)
W20260709 13:07:53.392462 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.390206 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 510794us
W20260709 13:07:53.003523 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 78561.9us
W20260709 13:07:53.419973 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 579798us
W20260709 13:07:53.389844 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.008s
W20260709 13:07:53.062345 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.427006 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.008s
W20260709 13:07:53.060021 20556 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
W20260709 13:07:53.427676 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 591237us
W20260709 13:07:53.082020 20544 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:07:53.309628 20563 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.386s	user 0.000s	sys 0.000s
W20260709 13:07:53.378968 20304 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.242s	user 0.023s	sys 0.034s
I20260709 13:07:53.064962 20565 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.437934 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:52.933930 20362 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:53.405397 20497 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 1.110s	user 0.010s	sys 0.010s
I20260709 13:07:53.434691 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.441336 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:53.444722 17121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.018s
W20260709 13:07:53.445226 17121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.018s
W20260709 13:07:53.391939 20407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.000s	sys 0.013s
I20260709 13:07:53.445845 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:53.446038 20503 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:53.446995 16582 connection.cc:256] RPC call timeout handler was delayed by -1.0371676260000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:07:53.450304 17126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 774) took 1013 ms. Trace:
I20260709 13:07:53.451629 20509 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:53.452093 20575 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.428824 20555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.025s
W20260709 13:07:53.461737 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 456650us
I20260709 13:07:53.478722 16544 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:53.479144 16583 leader_election.cc:336] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.525s (SENT)
I20260709 13:07:53.479508 16583 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:53.469726 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.482859 16611 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:53.066605 20469 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:53.469288 17126 rpcz_store.cc:276] 0709 13:07:52.436462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.436728 (+   266us) service_pool.cc:224] Handling call
0709 13:07:52.784037 (+347309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.811630 (+ 27593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.811651 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.825205 (+ 13554us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.074715 (+249510us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:53.074774 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.074883 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.450035 (+375152us) raft_consensus.cc:1685] finished
0709 13:07:53.450061 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.450229 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31307,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14188,"thread_start_us":198443,"threads_started":1,"wal-append.queue_time_us":605656}
W20260709 13:07:53.470539 20407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.011s	sys 0.029s
I20260709 13:07:53.494951 16612 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:53.478775 20555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.026s
I20260709 13:07:53.496706 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.497915 20581 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:53.498725 20581 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.501600 20581 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:53.502708 20574 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.503191 19984 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:53.503254 20574 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.505672 20574 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:53.484899 20575 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:53.506659 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 71619.1us
I20260709 13:07:53.509205 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.460134 20497 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.482115 20362 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.513684 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:53.513760 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.515112 16614 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:53.510684 20391 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:53.516897 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.517342 20560 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.508566 20575 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:53.518831 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.519795 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:53.521582 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91065.1us
I20260709 13:07:53.522642 16436 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:53.529229 17123 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:53.523692 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:53.544507 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:53.518338 19984 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:53.562723 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.522213 20407 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:53.572717 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.573027 16544 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:53.573530 16537 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:53.566862 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:53.569693 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.573388 16541 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:07:53.567898 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.574983 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.575897 16612 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:53.542174 20575 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:53.577001 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.580423 16612 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:53.579924 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 93089.2us
I20260709 13:07:53.583587 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.567215 20362 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:53.567330 19984 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:53.585320 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:53.586301 16611 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:53.585747 16615 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:07:53.594298 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 108796us
I20260709 13:07:53.580185 20575 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:53.598287 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.606968 16537 raft_consensus.cc:2368] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:53.589124 19984 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:53.588958 20106 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.663s	user 0.013s	sys 0.001s
W20260709 13:07:53.609125 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 129963us
I20260709 13:07:53.588260 20362 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.613894 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.617797 16540 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:53.624300 16612 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:53.623706 20362 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.625638 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:53.626232 16544 raft_consensus.cc:2376] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8. Re-sending same reply.
I20260709 13:07:53.626894 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 584) took 1834 ms. Trace:
I20260709 13:07:53.627226 16539 rpcz_store.cc:276] 0709 13:07:51.783278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.788246 (+  4968us) service_pool.cc:224] Handling call
0709 13:07:53.617190 (+1828944us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b54002b7854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:53.617300 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197878016}
I20260709 13:07:53.627652 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:53.629850 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.631982 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.636044 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.636693 16539 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:53.640950 20525 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:53.641146 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:53.641911 20585 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.642578 20585 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:53.645835 20577 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:07:53.647516 20582 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:07:53.648703 20587 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.649470 20587 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:53.651042 20579 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:53.659861 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:53.623641 20106 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.747754 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:53.748061 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:53.748641 16542 raft_consensus.cc:2368] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:53.748912 16545 raft_consensus.cc:2410] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:07:53.749533 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:53.913554 16542 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:53.916210 20592 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:07:53.917652 20592 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:53.918151 20592 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:53.919275 20592 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.750926 20574 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.924567 20574 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:53.750698 16543 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:07:53.752420 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 91646.5us
W20260709 13:07:53.940825 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 304879us
W20260709 13:07:53.943459 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.944034 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.969110 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2038) took 1679 ms. Trace:
I20260709 13:07:54.042248 20469 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 13:07:54.011579 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.050858 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.751088 20590 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:54.052402 20590 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.038906 20535 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.052953 20592 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.040447 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2031) took 2007 ms. Trace:
I20260709 13:07:54.080062 16468 rpcz_store.cc:276] 0709 13:07:52.033292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.045767 (+ 12475us) service_pool.cc:224] Handling call
0709 13:07:52.046132 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.121835 (+ 75703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.040191 (+1918356us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b540037a354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:54.040376 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171792128}
W20260709 13:07:53.996016 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 72268.5us
I20260709 13:07:54.014430 20362 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:53.870803 20585 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:53.749871 20106 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:53.656030 20485 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:53.870733 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 326346us
I20260709 13:07:53.750144 16545 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:53.804925 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:54.063885 20532 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 2.076s	user 0.019s	sys 0.011s
I20260709 13:07:54.066322 20590 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.049623 16466 rpcz_store.cc:276] 0709 13:07:52.273043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.287265 (+ 14222us) service_pool.cc:224] Handling call
0709 13:07:52.295692 (+  8427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.774990 (+479298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.775019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.821334 (+ 46315us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.933520 (+112186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:52.934274 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.934380 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.647090 (+712710us) raft_consensus.cc:1685] finished
0709 13:07:53.647108 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.952811 (+305703us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8168,"raft.queue_time_us":452278,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":38647,"thread_start_us":54809,"threads_started":1,"wal-append.queue_time_us":681408}
W20260709 13:07:54.102771 16434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.010s
I20260709 13:07:54.035799 20602 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:53.838445 16544 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:54.036796 20581 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:54.068748 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.069208 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.068413 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.069314 20467 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:53.994120 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:53.969204 20586 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.071056 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.071326 16537 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:54.071473 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.110369 16539 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:53.997997 20560 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:07:54.001878 20304 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:07:54.072157 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.124003 16543 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.072814 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.074738 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.125111 16542 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.125242 16540 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:53.996068 20260 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:07:53.641024 20584 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:53.804057 20525 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:54.103209 16434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.006s	sys 0.010s
I20260709 13:07:54.104012 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.109313 16465 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:54.102595 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.110286 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.114786 16464 raft_consensus.cc:2410] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:54.071692 20574 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:54.119026 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.119270 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.119577 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.136101 17121 raft_consensus.cc:2376] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9. Re-sending same reply.
I20260709 13:07:54.122320 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.126766 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.128531 17126 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:54.110155 20603 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:54.130985 16541 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:54.131210 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.103179 20585 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.143046 16468 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.119148 16617 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:54.150103 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2027) took 2178 ms. Trace:
I20260709 13:07:54.150487 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.150673 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.150756 16470 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:54.151175 17118 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.151561 16617 raft_consensus.cc:2410] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:54.151801 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.152398 16470 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.118156 20581 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.135648 16545 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:54.156980 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.150701 16461 rpcz_store.cc:276] 0709 13:07:51.971851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.009176 (+ 37325us) service_pool.cc:224] Handling call
0709 13:07:52.023873 (+ 14697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.298035 (+274162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.136512 (+1838477us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b54003566d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:54.138662 (+  2150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572995968}
I20260709 13:07:54.158996 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.159636 16461 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.149995 20606 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:54.142360 20525 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.161062 20581 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.151129 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.161194 20606 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.161885 16541 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:54.162144 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.142613 20584 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:54.162750 17126 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:54.163746 20606 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:54.164208 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.163949 20584 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.159068 20463 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.127117 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.166320 16466 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.155815 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.140717 17120 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:54.143811 16463 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.162742 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.171375 16540 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:07:54.173627 16461 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:54.176963 16470 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:54.177079 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.178081 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:54.177435 16583 leader_election.cc:336] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.654s (SENT)
I20260709 13:07:54.179008 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.180301 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.140848 20467 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.134837 20587 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.182291 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:07:54.183966 19984 consensus_meta.cc:287] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
I20260709 13:07:54.183864 20463 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:54.174621 20603 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.128067 20590 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:07:54.121320 20586 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.127878 20391 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:07:54.188724 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.198292 16461 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.188891 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.189378 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.199026 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.199337 16468 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.190028 17118 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:54.199627 16540 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.191357 16543 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:54.194985 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.201328 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.201941 16541 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:54.202709 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.198320 20464 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.203569 20464 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:54.204056 20464 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.209205 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 91191.3us
I20260709 13:07:54.209997 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.177945 19748 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:54.212890 20362 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.213865 17126 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.202644 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.203567 16541 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:54.216939 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.219691 16543 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:54.224035 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.224246 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.225349 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.225987 17122 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:54.213173 19748 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:54.192225 20607 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:07:54.229774 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 100670us
I20260709 13:07:54.234361 16545 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:54.125722 20602 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.234803 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.235773 16469 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:54.181031 20574 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:07:54.236320 20587 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.230922 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.240015 16541 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.213429 20581 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.175343 20585 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.194526 20496 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:07:54.213815 19984 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.279218 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.244712 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.293614 16463 raft_consensus.cc:2410] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:54.293705 16543 raft_consensus.cc:2376] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8. Re-sending same reply.
I20260709 13:07:54.283973 16542 raft_consensus.cc:2410] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:54.290936 16540 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:54.244923 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.296133 16536 raft_consensus.cc:2376] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11. Re-sending same reply.
W20260709 13:07:54.288744 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78853.4us
I20260709 13:07:54.297861 16466 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
W20260709 13:07:54.285717 16613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2157) took 2146 ms (client timeout 2043 ms). Trace:
I20260709 13:07:54.299671 16541 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:54.300102 16468 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:07:54.303740 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.304710 16540 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:54.305222 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.305824 16542 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 7.
I20260709 13:07:54.306455 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.307581 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:54.299842 16613 rpcz_store.cc:269] 0709 13:07:52.139727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.175604 (+ 35877us) service_pool.cc:224] Handling call
0709 13:07:54.285460 (+2109856us) spinlock_profiling.cc:243] Waited 93.9 ms on lock 0x7b54003f07d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:54.285614 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215965440}
I20260709 13:07:54.310000 16542 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:54.310617 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.310724 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.311908 16469 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.311852 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:54.312220 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 134803us
I20260709 13:07:54.312623 16543 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:54.312897 16583 leader_election.cc:336] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.670s (SENT)
I20260709 13:07:54.313421 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.281805 20106 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:54.311554 20590 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:07:54.314481 16541 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:54.236320 20574 consensus_queue.cc:1243] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:07:54.315322 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.315537 19984 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.315663 16541 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:54.315773 16433 leader_election.cc:400] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:54.274537 20581 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.318207 20581 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.320407 20581 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.320878 20463 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:54.321406 20463 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.322449 20602 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.286531 20473 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.323642 20463 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:54.323825 16463 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:07:54.324087 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 775) took 1538 ms. Trace:
I20260709 13:07:54.324209 16463 pending_rounds.cc:85] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 3
I20260709 13:07:54.324631 16463 pending_rounds.cc:107] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:07:54.325019 16463 raft_consensus.cc:2889] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.326395 16463 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.326709 20498 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.327548 16463 raft_consensus.cc:1240] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:54.327790 20498 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.322525 20252 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:54.331950 16463 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:54.324506 17123 rpcz_store.cc:276] 0709 13:07:52.785976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.786134 (+   158us) service_pool.cc:224] Handling call
0709 13:07:52.814329 (+ 28195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:53.542615 (+728286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.323870 (+781255us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54005537d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:54.324034 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643568512}
I20260709 13:07:54.332468 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.334676 16536 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:54.335305 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.335983 16540 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 6: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:54.304487 20585 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.336946 16617 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 6.
I20260709 13:07:54.341380 16543 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:54.344564 16463 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.345187 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.345994 16542 raft_consensus.cc:2410] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:54.345461 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1829) took 1914 ms. Trace:
I20260709 13:07:54.324254 20473 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:54.349149 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.349887 16463 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:07:54.347013 16538 rpcz_store.cc:276] 0709 13:07:52.431033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.443856 (+ 12823us) service_pool.cc:224] Handling call
0709 13:07:52.784605 (+340749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.837054 (+ 52449us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:52.875810 (+ 38756us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.186932 (+1311122us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b18003a5e20. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:07:54.342589 (+155657us) log.cc:844] Serialized 14 byte log entry
0709 13:07:54.345155 (+  2566us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:54.345210 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:54.345252 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.345313 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.345414 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36477,"prepare.queue_time_us":38853,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":47400,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":9684,"spinlock_wait_cycles":44302592,"thread_start_us":151052,"threads_started":1}
W20260709 13:07:54.352716 16583 leader_election.cc:336] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.787s (SENT)
I20260709 13:07:54.353449 16583 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.337530 20419 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.356292 20419 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:54.357092 20304 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.360831 20464 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.363780 20464 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.367901 16470 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:54.346792 20467 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:54.369405 20467 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.370618 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.371363 16464 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.372932 20590 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.375773 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.376650 17123 raft_consensus.cc:2410] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:07:54.360030 20419 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:54.379078 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 62387.1us
I20260709 13:07:54.380947 16433 leader_election.cc:400] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11.
I20260709 13:07:54.238904 20607 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.384933 20616 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.385353 20616 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:54.386188 20616 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.367381 20241 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:07:54.397076 16468 pending_rounds.cc:85] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:07:54.397405 16468 pending_rounds.cc:107] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:07:54.397630 16468 raft_consensus.cc:2889] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.398355 20607 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.399526 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.399995 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:54.401508 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:54.398988 20616 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.406773 20574 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:07:54.409334 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:54.409387 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 447247us
W20260709 13:07:54.411458 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 58788.1us
I20260709 13:07:54.420919 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:54.422513 20304 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:54.423034 20304 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:54.424584 16583 leader_election.cc:336] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.886s (SENT)
I20260709 13:07:54.425675 16583 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.406531 20241 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.398981 20572 raft_consensus.cc:3055] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:54.425689 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.368194 20586 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:54.428211 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.407126 20106 raft_consensus.cc:2764] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:54.427356 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.431133 16436 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:54.426785 20241 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.432129 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.423470 20304 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.428714 20590 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:54.440574 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.439226 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:54.445161 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.447561 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.448688 16537 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.430181 20572 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:54.419867 20560 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:07:54.452486 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.452749 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.438009 20241 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.438052 19984 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:54.437107 20602 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:54.455410 16541 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:54.456359 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.456626 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.440831 20303 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:54.457064 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.465392 16542 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:54.457165 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.462779 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.441596 20467 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.435109 20607 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:54.445365 20584 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:54.476797 16541 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:54.474895 16543 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:54.475495 16538 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:07:54.454622 20612 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.466379 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.439719 20252 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:07:54.482244 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 183459us
I20260709 13:07:54.441473 20574 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:07:54.503178 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.450176 20362 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:54.508564 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.509596 16470 raft_consensus.cc:2410] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:54.514137 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.514936 20464 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:54.515959 20587 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.465903 20542 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:07:54.517294 20542 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:54.517619 20542 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:54.518428 20542 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.518822 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:54.519562 20464 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:54.516738 16463 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:54.519937 20464 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.519567 20542 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.477991 20259 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.475253 20590 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:54.523797 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 85535us
W20260709 13:07:54.528708 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.502081 20612 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:54.534111 20612 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.534343 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.534554 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.482618 19984 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:54.523958 20615 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:07:54.532272 20479 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:54.533385 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.533109 20590 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.535686 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.562364 20479 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:54.562376 20576 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.563413 20479 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.564657 20479 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.563169 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:54.565270 17124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 651) took 3619 ms (client timeout 1886 ms). Trace:
I20260709 13:07:54.565536 20576 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:54.565706 17124 rpcz_store.cc:269] 0709 13:07:50.945909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.988104 (+ 42195us) service_pool.cc:224] Handling call
0709 13:07:54.565085 (+3576981us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54006be254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:54.565180 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944228608}
I20260709 13:07:54.566823 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.566977 20499 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:54.563202 16540 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.535715 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.547957 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.569438 16466 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.569658 16461 raft_consensus.cc:2376] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 13. Re-sending same reply.
I20260709 13:07:54.546074 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.546542 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:54.570674 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.570845 16465 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:54.523954 20464 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.535760 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:54.576509 16614 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:54.577440 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.581907 16537 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:54.525111 20106 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.586738 20541 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.586858 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.582122 20605 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:07:54.561255 20391 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:54.542982 20303 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:54.596946 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 132701us
W20260709 13:07:54.600736 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.617784 20460 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:54.618974 20460 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:54.619457 20460 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:54.536374 20259 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.567397 20499 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:54.622025 20460 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.623733 20460 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:54.553169 20592 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:54.625051 20592 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:54.626212 20592 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.627539 20592 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.631757 17124 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:54.634009 20485 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:54.634819 20485 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.636977 20438 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.637672 20438 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.640359 20438 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.642529 20485 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.644389 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.653470 16541 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:54.646392 20576 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:54.666967 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 236764us
W20260709 13:07:54.671317 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.613282 20391 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:54.591015 20304 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.673827 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:54.674557 16610 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:54.674408 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:54.675304 16537 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:54.675429 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.614907 20548 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.678928 16537 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.590147 20106 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:07:54.684532 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 272228us
W20260709 13:07:54.685403 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.693455 16618 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.696718 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:54.539953 20572 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:54.705710 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 139004us
W20260709 13:07:54.705832 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 131792us
I20260709 13:07:54.707726 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.709607 16540 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:54.711113 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.711702 17124 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:54.725087 16618 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.672798 20391 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.591956 20241 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.726768 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.731155 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:54.733347 16536 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:54.683164 20496 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:54.737763 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:54.708711 20260 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:54.738663 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.739298 16610 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:54.744858 17124 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:54.731355 20485 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.754681 16538 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:54.704628 20371 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:54.734465 20477 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:54.740952 20260 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.742040 20299 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:54.769984 20304 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:54.771162 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:54.772408 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 71400.7us
I20260709 13:07:54.773659 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:54.759130 20628 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.750219 20581 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:54.775810 20603 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:54.772589 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.828292 16538 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:54.764568 20391 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:54.759482 20605 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.768090 20260 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:54.837137 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.733121 19984 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.760967 20485 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.814296 20299 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:54.850054 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.750667 20106 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.816207 20576 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:54.848946 16464 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:54.857483 16538 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:54.834961 20628 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.832332 20615 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:54.758736 20631 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:07:54.870927 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.829160 20535 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:07:54.868691 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 96192.8us
I20260709 13:07:54.867717 16614 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:07:54.875082 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:54.836949 20616 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:54.857887 20603 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.877437 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.877780 16618 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.879590 16541 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.876597 16619 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:54.881707 16614 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:54.884657 16464 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:54.886835 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.887501 16466 raft_consensus.cc:2376] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 12. Re-sending same reply.
I20260709 13:07:54.872447 20628 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:54.888319 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 149723us
I20260709 13:07:54.901115 16541 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:54.904982 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:54.905501 16466 raft_consensus.cc:2376] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 8. Re-sending same reply.
I20260709 13:07:54.904496 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:54.880978 20106 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:54.908209 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:54.906888 16464 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:54.889276 20603 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.977845 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:54.974494 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:55.221452 16466 raft_consensus.cc:2376] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 13. Re-sending same reply.
I20260709 13:07:55.222448 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.223116 16614 raft_consensus.cc:2410] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:55.205431 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.908818 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:54.937563 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.974776 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 85260.2us
W20260709 13:07:54.951387 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.979176 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:55.085359 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.226498 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.900975 20628 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.933492 20485 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.932845 20241 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:54.968255 20464 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.971079 20260 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.010583 20612 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.025491 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:54.996933 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.936751 20583 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:54.950698 20499 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.202459 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2223) took 1105 ms. Trace:
W20260709 13:07:55.203038 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.932934 20299 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:54.909278 17126 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:54.943466 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:54.980705 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:55.248595 16545 rpcz_store.cc:276] 0709 13:07:54.097470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.156690 (+ 59220us) service_pool.cc:224] Handling call
0709 13:07:55.153159 (+996469us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b540007a154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:55.202385 (+ 49226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176451840}
I20260709 13:07:55.205303 17124 raft_consensus.cc:2376] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10. Re-sending same reply.
I20260709 13:07:55.205421 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.219125 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:54.978768 16618 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:55.225129 16616 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:55.217614 20460 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.235458 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.027583 20497 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.236171 20583 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:54.902740 20548 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.234870 20464 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.232702 16615 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.234874 20260 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:55.235678 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 238851us
I20260709 13:07:55.256568 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:55.231935 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.240082 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2048) took 1046 ms. Trace:
W20260709 13:07:55.257706 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.258165 17122 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:55.242587 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2042) took 1098 ms. Trace:
I20260709 13:07:55.258867 16468 rpcz_store.cc:276] 0709 13:07:54.144073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.307427 (+163354us) service_pool.cc:224] Handling call
0709 13:07:54.307732 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.398122 (+ 90390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.398173 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.398594 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.441454 (+ 42860us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:54.441490 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.242058 (+800568us) spinlock_profiling.cc:243] Waited 89.1 ms on lock 0x7b5400355cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:55.242123 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.242191 (+    68us) raft_consensus.cc:1685] finished
0709 13:07:55.242211 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.242510 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205038848,"thread_start_us":42503,"threads_started":1,"wal-append.queue_time_us":64796}
I20260709 13:07:55.244195 20603 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.255342 20641 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:55.252987 20421 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:55.261164 20421 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:55.261623 20421 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.213172 20407 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.265141 20407 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.267422 20407 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:55.267822 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:55.240402 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:55.269886 16467 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:07:55.257949 16463 rpcz_store.cc:276] 0709 13:07:54.193264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.350600 (+157336us) service_pool.cc:224] Handling call
0709 13:07:54.350925 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.520320 (+169395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.239827 (+719507us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003b9554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:55.240002 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380902784}
W20260709 13:07:55.248926 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 305547us
I20260709 13:07:55.217911 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 656) took 4157 ms. Trace:
I20260709 13:07:55.250411 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.250002 17120 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:55.253432 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 604) took 1808 ms. Trace:
I20260709 13:07:55.255352 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:55.274119 16537 raft_consensus.cc:1217] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Deduplicated request from leader. Original: 8.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:07:55.274808 16537 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:55.276382 16462 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:55.277709 16465 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:07:55.278844 20464 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:55.279389 20464 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:55.252657 20473 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.255751 20460 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.281136 17124 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:07:55.281596 20460 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.282063 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:55.282603 16540 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:07:55.282932 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.283289 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.283666 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.283993 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.285048 20419 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.285077 20573 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.286216 17120 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:55.272022 16616 rpcz_store.cc:276] 0709 13:07:53.444954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.164489 (+1719535us) service_pool.cc:224] Handling call
0709 13:07:55.253379 (+ 88890us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:55.287304 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:55.287640 16544 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:07:55.267973 20499 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.264281 20628 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.285840 20573 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.303655 16582 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:55.271390 17125 rpcz_store.cc:276] 0709 13:07:51.050016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.688127 (+638111us) service_pool.cc:224] Handling call
0709 13:07:51.688477 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.789739 (+1101262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.115980 (+2326241us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400523854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:55.207083 (+ 91103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2530834176}
I20260709 13:07:55.294175 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.302047 16540 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:55.280272 20464 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:55.303385 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 322765us
I20260709 13:07:55.306795 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:54.938865 20575 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.308970 20407 raft_consensus.cc:2764] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:55.315060 20473 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.315495 20473 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.315819 20473 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.315881 19748 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.316169 20421 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.317013 19748 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:55.318404 20421 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:55.319952 20588 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:55.320515 20588 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:55.325006 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:55.330363 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:55.338517 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44418us
I20260709 13:07:55.339607 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:55.342401 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:55.331735 20627 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.858s	user 0.008s	sys 0.000s
I20260709 13:07:55.372702 16582 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:55.351898 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 111553us
I20260709 13:07:55.365623 17125 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:55.365566 16433 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.368224 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.325031 20588 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.383553 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:55.387831 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.340792 20575 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.329178 20463 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.344671 20421 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.406827 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.396129 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.399619 20407 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:55.369400 20485 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.350275 20303 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.372984 20497 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:55.411439 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:55.382426 20391 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:55.419631 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60419.3us
I20260709 13:07:55.431445 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:07:55.421336 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.421772 17120 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:55.432832 20313 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.433418 20622 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.433645 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.433842 20622 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:55.391377 20393 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.435326 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.435489 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:55.421772 20603 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:55.422057 20574 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:55.437621 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49888.4us
I20260709 13:07:55.406629 20509 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.444068 20480 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:55.445298 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:55.469645 20622 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.441285 20393 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:55.444523 20606 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:55.511760 20647 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:07:55.514993 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 69802.3us
I20260709 13:07:55.526197 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:55.469395 20421 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:55.519395 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:55.430006 20485 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:55.521432 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:55.467505 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56238.9us
I20260709 13:07:55.525657 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:55.526487 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:55.526810 16618 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.531257 16616 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.532558 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:55.463037 20241 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:55.441855 20497 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:55.533289 20241 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.533728 20241 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.533962 20497 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.470330 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.470572 20391 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:55.536900 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.540323 16618 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:55.530126 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:55.532490 20106 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:55.450062 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.520869 20393 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.530017 20421 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.543202 20391 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.520630 20480 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:55.516940 20574 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:55.544584 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:55.541471 16470 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.545315 17125 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:55.549592 16616 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:55.520321 20503 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.530252 20606 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:55.556453 20480 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.564703 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:55.558808 20421 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.567390 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:55.573161 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:55.544310 20467 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:55.579190 16470 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:55.544883 20622 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.537158 20583 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.580385 16540 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:55.581736 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2040) took 1441 ms. Trace:
I20260709 13:07:55.582545 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.549407 20603 raft_consensus.cc:2764] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:55.567361 20592 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.571806 19748 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:07:55.584894 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2180) took 1157 ms. Trace:
W20260709 13:07:55.703414 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.667309 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:55.702316 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:55.571806 20313 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:55.741806 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.634250 20583 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.586350 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:55.643235 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 135152us
I20260709 13:07:55.585680 16469 rpcz_store.cc:276] 0709 13:07:54.140634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.237743 (+ 97109us) service_pool.cc:224] Handling call
0709 13:07:54.238017 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.312485 (+ 74468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.581503 (+1269018us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54001081d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:55.581674 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169513344}
I20260709 13:07:55.568534 20503 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.633490 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:55.775352 19748 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:55.775785 19748 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:55.776539 19748 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.777702 19748 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:55.734598 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.753129 20313 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.779798 20313 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:55.605444 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:55.711423 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:55.782313 16468 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:55.705875 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 615) took 1473 ms. Trace:
I20260709 13:07:55.740272 16610 rpcz_store.cc:276] 0709 13:07:54.427802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.692838 (+265036us) service_pool.cc:224] Handling call
0709 13:07:54.727574 (+ 34736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.739534 (+ 11960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.582393 (+842859us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54000d66d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:55.584835 (+  2442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26213248}
I20260709 13:07:55.604599 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:55.784186 16470 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:55.749480 17124 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
W20260709 13:07:55.725152 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.577006 20573 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:55.790661 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.688993 20299 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.801658 20299 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:55.802934 20299 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.805024 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:55.806108 20524 raft_consensus.cc:2764] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:55.676450 20485 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.807399 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:55.805606 20473 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.687738 20606 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.811769 20473 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:55.812496 20612 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:55.583001 20303 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.201s
I20260709 13:07:55.741086 20592 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:55.813347 20473 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.813630 20592 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.813858 20473 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:55.753342 20583 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:55.815850 20583 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.815243 20473 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:55.773589 20649 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:07:55.817312 20499 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.004s
W20260709 13:07:55.773381 20650 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:07:55.825529 20652 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:55.721855 20574 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:55.781127 20503 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.816602 20603 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.810299 20419 consensus_meta.cc:287] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:07:55.576045 20628 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:55.799649 16470 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:55.782701 16617 rpcz_store.cc:276] 0709 13:07:54.227534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.362238 (+134704us) service_pool.cc:224] Handling call
0709 13:07:54.362666 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.362910 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.362945 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.363627 (+   682us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.479583 (+115956us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.479619 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.479678 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.114967 (+635289us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:07:55.697312 (+582345us) raft_consensus.cc:1685] finished
0709 13:07:55.697339 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.700741 (+  3402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12647808,"thread_start_us":115512,"threads_started":1,"wal-append.queue_time_us":109670}
W20260709 13:07:56.096385 20661 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:07:57.245499 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.673s	user 0.026s	sys 0.034s
W20260709 13:07:57.542730 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.971s	user 0.027s	sys 0.035s
W20260709 13:07:57.543061 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.97553e+06us
I20260709 13:07:57.274474 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2060) took 2019 ms. Trace:
I20260709 13:07:57.544073 16470 rpcz_store.cc:276] 0709 13:07:55.254977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.798790 (+543813us) service_pool.cc:224] Handling call
0709 13:07:55.799201 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.274103 (+1474902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.274399 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:57.365890 20663 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.811s	user 0.004s	sys 0.003s
I20260709 13:07:55.934407 20393 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.550577 20393 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:55.997784 20588 consensus_meta.cc:287] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.003s
I20260709 13:07:57.574816 20588 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:56.945242 20590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.005s	sys 0.005s
W20260709 13:07:57.585883 20590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.491s	user 0.008s	sys 0.005s
W20260709 13:07:57.585172 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.892130 20241 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.587587 20681 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.588155 20681 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:55.931023 20421 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:56.940797 20313 consensus_meta.cc:287] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.160s	user 0.012s	sys 0.003s
I20260709 13:07:57.590462 20313 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.591169 20421 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.592728 20313 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:55.835049 20473 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:56.830668 20480 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.003s	sys 0.009s
W20260709 13:07:57.597702 20480 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.604s	user 0.005s	sys 0.009s
W20260709 13:07:56.942909 20503 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.100s	user 0.006s	sys 0.006s
I20260709 13:07:57.599244 20503 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.600489 16469 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.601792 20503 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.602722 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2059) took 2348 ms. Trace:
I20260709 13:07:57.603147 16469 rpcz_store.cc:276] 0709 13:07:55.254721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.785666 (+530945us) service_pool.cc:224] Handling call
0709 13:07:55.789430 (+  3764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.600961 (+1811531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.602484 (+  1523us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400378a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:57.602662 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4164457344}
I20260709 13:07:57.329295 20572 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:55.950465 20575 consensus_meta.cc:287] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.005s
W20260709 13:07:56.943277 20583 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 1.127s	user 0.014s	sys 0.000s
I20260709 13:07:57.607853 20583 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.608420 16619 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:57.610234 20583 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:57.610584 16367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 172) took 14984 ms (client timeout 15000 ms). Trace:
I20260709 13:07:55.843575 20603 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.614245 20603 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:55.825546 20653 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:07:56.095438 20656 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:07:57.373662 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.619621 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.381906 17092 connection.cc:256] RPC call timeout handler was delayed by -1.2795247709999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:07:55.808697 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:57.398402 20670 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.403492 17090 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.824s	user 0.013s	sys 0.025s
W20260709 13:07:57.392377 17120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 689) took 1991 ms (client timeout 2449 ms). Trace:
W20260709 13:07:57.404845 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.420842 20668 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.425524 20672 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:57.622545 17090 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.043s	user 0.013s	sys 0.025s
W20260709 13:07:57.623286 17090 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 2.838s (SENT) [suppressed 30 similar messages]
W20260709 13:07:57.445389 16541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.900s	user 0.013s	sys 0.030s
W20260709 13:07:57.624217 16541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.079s	user 0.014s	sys 0.030s
W20260709 13:07:57.447826 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.872s	user 0.009s	sys 0.020s
I20260709 13:07:57.450496 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:57.462774 20569 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.631932 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.058s	user 0.010s	sys 0.021s
W20260709 13:07:57.632478 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 2.05914e+06us
W20260709 13:07:57.473567 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.485633 20673 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:57.486855 20678 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.486963 16436 connection.cc:256] RPC call timeout handler was delayed by -1.709348738000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:07:57.633783 16436 connection.cc:256] RPC call timeout handler was delayed by -1.3646487380000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:07:57.634301 16436 connection.cc:256] RPC call timeout handler was delayed by -1.3475487380000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:07:57.634727 16436 connection.cc:256] RPC call timeout handler was delayed by -1.2904820230000951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 13:07:57.635141 16436 connection.cc:256] RPC call timeout handler was delayed by -1.2665487379999831s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:07:57.635716 16436 connection.cc:256] RPC call timeout handler was delayed by -1.18194873799996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 13:07:57.636121 16436 connection.cc:256] RPC call timeout handler was delayed by -1.0964487380000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 13:07:57.476970 19984 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.491722 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.641134 20681 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:57.502111 16468 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.641753 20681 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:57.641366 19984 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.642199 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2061) took 2385 ms. Trace:
I20260709 13:07:57.642241 20681 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.642740 16468 rpcz_store.cc:276] 0709 13:07:55.256564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.800083 (+543519us) service_pool.cc:224] Handling call
0709 13:07:57.501943 (+1701860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.641931 (+139988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.642144 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:57.532940 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.552342 20393 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:07:57.643857 19984 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.558931 20682 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.559770 20555 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:57.562064 20581 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.569211 20467 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:57.568720 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:57.645109 20682 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:57.645833 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 77191.2us
I20260709 13:07:57.645476 20678 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.646538 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:57.569856 20683 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:57.578313 20588 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:07:57.580817 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.005s	user 0.011s	sys 0.021s
I20260709 13:07:57.582829 20548 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:07:57.586632 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.594641 20241 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:57.596634 20680 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:55.959704 20509 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:56.940277 20592 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 1.126s	user 0.011s	sys 0.002s
W20260709 13:07:57.614705 16619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2191) took 2636 ms (client timeout 3199 ms). Trace:
W20260709 13:07:57.611038 16367 rpcz_store.cc:269] 0709 13:07:42.626457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:42.626669 (+   212us) service_pool.cc:224] Handling call
0709 13:07:57.610501 (+14983832us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:52.720510 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:52.721300 (+   790us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:52.721345 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:07:52.721362 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:52.722681 (+  1319us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:52.722766 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:52.722794 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:07:52.723952 (+  1158us) tablet.cc:701] Row locks acquired
0709 13:07:52.724003 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:52.724180 (+   177us) write_op.cc:270] Start()
0709 13:07:52.724333 (+   153us) write_op.cc:276] Timestamp: P: 1783602472724114 usec, L: 0
0709 13:07:52.724354 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:07:52.813502 (+ 89148us) log.cc:844] Serialized 5579 byte log entry
0709 13:07:53.905874 (+1092372us) op_driver.cc:464] REPLICATION: finished
0709 13:07:54.235894 (+330020us) write_op.cc:301] APPLY: starting
0709 13:07:54.235994 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:54.237516 (+  1522us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:54.237636 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:54.242664 (+  5028us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:54.243060 (+   396us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:07:54.243113 (+    53us) write_op.cc:312] APPLY: finished
0709 13:07:54.243619 (+   506us) log.cc:844] Serialized 101 byte log entry
0709 13:07:54.243857 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.244041 (+   184us) write_op.cc:454] Released schema lock
0709 13:07:54.244121 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:54.333582 (+ 89461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:54.336745 (+  3163us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3790,"reported_tablets":30,"spinlock_wait_cycles":8064,"child_traces":[["op",{"apply.queue_time_us":328058,"apply.run_cpu_time_us":5489,"apply.run_wall_time_us":63472,"num_ops":14,"prepare.queue_time_us":449261,"prepare.run_cpu_time_us":37753,"prepare.run_wall_time_us":371076,"raft.queue_time_us":298609,"raft.run_cpu_time_us":10184,"raft.run_wall_time_us":257579,"replication_time_us":1145959,"thread_start_us":383763,"threads_started":4,"wal-append.queue_time_us":607100,"wal-append.run_cpu_time_us":18678,"wal-append.run_wall_time_us":1849521}]]}
W20260709 13:07:57.444437 16544 consensus_meta.cc:287] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 1.670s	user 0.004s	sys 0.017s
I20260709 13:07:57.827649 16544 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
W20260709 13:07:57.625824 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 175360us
W20260709 13:07:57.621585 17120 rpcz_store.cc:269] 0709 13:07:55.400560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.400707 (+   147us) service_pool.cc:224] Handling call
0709 13:07:57.392155 (+1991448us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400120054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:57.392314 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32590208}
I20260709 13:07:57.470527 17125 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:57.636533 16436 connection.cc:256] RPC call timeout handler was delayed by -1.0946487380000463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:07:57.649242 16434 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:57.694437 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45660.4us
W20260709 13:07:57.722999 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.831947 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 182778us
I20260709 13:07:57.644553 20681 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.738556 20686 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.739863 20685 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:57.740945 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.165s	user 0.019s	sys 0.025s
W20260709 13:07:57.835716 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 2.2611e+06us
I20260709 13:07:57.726111 20548 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:57.635501 20603 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:57.741690 20260 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.650200 20480 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.740638 20575 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.722575 20674 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.671741 20473 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.848248 20473 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:57.650133 20673 consensus_queue.cc:1243] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:57.849352 20673 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:57.838294 20681 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.647742 20503 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.850180 20681 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.850700 20503 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.852229 20681 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.671988 20313 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.726732 20672 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.778026 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 154763us
I20260709 13:07:57.741906 20572 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.722972 20391 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:57.621196 20670 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.759330 20241 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.852622 20503 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:57.826591 20592 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.757333 20684 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.645172 20555 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.740449 20680 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.782280 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:57.782820 20393 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:57.645141 20569 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.645505 20467 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.784956 20588 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:57.634904 20668 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.790038 20678 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:57.650661 20583 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:07:57.793015 20687 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.806679 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 160194us
W20260709 13:07:57.808481 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.825731 20691 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:07:57.832695 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:07:57.939182 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 106543us
W20260709 13:07:57.826570 16619 rpcz_store.cc:269] 0709 13:07:54.977982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.978940 (+   958us) service_pool.cc:224] Handling call
0709 13:07:57.614535 (+2635595us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54003dbb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:07:57.614647 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5474231168}
I20260709 13:07:57.831840 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:57.842758 20603 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:07:57.836892 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 789) took 2117 ms. Trace:
I20260709 13:07:57.942801 17125 rpcz_store.cc:276] 0709 13:07:55.719694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.719822 (+   128us) service_pool.cc:224] Handling call
0709 13:07:55.742270 (+ 22448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.830785 (+2088515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.836639 (+  5854us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54004d0b54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:07:57.836828 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3974023040}
I20260709 13:07:57.826860 16366 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.841842 16436 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:57.855841 20313 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.827966 20689 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.844374 20692 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:57.846632 20695 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.847137 20480 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.833983 20509 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.841322 20524 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.942848 20503 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.672101 20581 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.970293 20695 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.977380 20581 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.977660 20695 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:57.977943 20581 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:57.978930 20581 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:57.979338 20581 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:57.981141 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:57.742027 20682 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:57.880856 20241 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.984324 20241 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:57.877161 20572 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.882202 20590 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:57.845496 20686 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.884585 20670 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:57.877768 20681 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.940805 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 109007us
W20260709 13:07:57.834417 16544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 593) took 2248 ms (client timeout 1615 ms). Trace:
I20260709 13:07:57.956720 20678 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:57.843830 20683 consensus_queue.cc:1243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:57.839615 20693 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:07:57.845950 20260 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.854763 20575 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.962857 16434 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:57.855352 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1865) took 2579 ms. Trace:
I20260709 13:07:58.027304 16541 rpcz_store.cc:276] 0709 13:07:55.274312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.274414 (+   102us) service_pool.cc:224] Handling call
0709 13:07:55.274703 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.294996 (+ 20293us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:55.514943 (+219947us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.781159 (+2266216us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.839449 (+ 58290us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.839926 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.840083 (+   157us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:57.840115 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.840202 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.853438 (+ 13236us) raft_consensus.cc:1685] finished
0709 13:07:57.853454 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.853618 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19266,"prepare.queue_time_us":584003,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":3565,"raft.queue_time_us":269055,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":12032,"thread_start_us":2462533,"threads_started":4,"wal-append.queue_time_us":466237}
I20260709 13:07:57.890255 20697 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.941963 20421 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:57.852802 20674 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.946336 19984 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:57.878257 20391 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.986083 16366 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 7 to 9, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:58.010464 16544 rpcz_store.cc:269] 0709 13:07:55.580065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.580857 (+   792us) service_pool.cc:224] Handling call
0709 13:07:57.828113 (+2247256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:57.945207 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 103466us
I20260709 13:07:57.970702 20684 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:58.015879 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:57.944447 20687 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.856154 20672 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:07:58.018440 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 2.20956e+06us
I20260709 13:07:58.022147 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:07:58.023101 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.001885 20685 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:58.031262 20705 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.003491 20590 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:57.980288 20581 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.945665 20588 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:57.944224 20691 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.965548 20692 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:57.963605 20689 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:58.217656 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.038272 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.228199 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:58.228322 17123 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
W20260709 13:07:58.131033 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 294712us
I20260709 13:07:58.230043 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:58.081183 20467 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.076447 20680 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.231359 20693 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:58.232825 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 217066us
W20260709 13:07:58.235702 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.236142 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.231412 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.237151 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 274331us
I20260709 13:07:58.241796 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:07:58.042261 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 212169us
W20260709 13:07:58.250927 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.259027 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:07:58.324681 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58730.6us
W20260709 13:07:58.313324 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.306576 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47656us
I20260709 13:07:58.327869 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:58.328961 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 61776.6us
I20260709 13:07:58.078991 20702 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.231711 20603 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.075201 20555 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.053851 20569 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.351812 16366 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.373551 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.077445 20668 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.013276 20681 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.358821 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.360101 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.361582 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.362926 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.364066 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.011739 20699 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.347s
I20260709 13:07:58.366909 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.391379 16536 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.395288 17122 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:58.391798 16539 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.394980 16543 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:58.369014 16542 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:07:58.370204 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 140047us
I20260709 13:07:58.265790 20678 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:58.397281 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:58.392108 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.392108 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:58.391009 16545 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.232880 20592 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.248579 20509 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.374158 16544 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:58.391206 16537 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.072726 20480 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.259986 20393 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:07:58.257655 20572 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.074198 20260 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:58.354195 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 89642.8us
I20260709 13:07:58.365447 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.054729 20703 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:58.352417 20670 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.376737 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:58.376159 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:58.375571 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.373193 17148 debug-util.cc:398] Leaking SignalData structure 0x7b080027c8a0 after lost signal to thread 15324
I20260709 13:07:58.391584 16538 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:07:58.326305 20583 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:07:58.397676 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:07:58.396687 20603 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:58.326485 20503 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:07:58.406507 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.408628 20480 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.410645 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.249094 20697 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.416041 16366 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:58.452055 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52700.7us
W20260709 13:07:58.439376 17148 debug-util.cc:398] Leaking SignalData structure 0x7b08001bffa0 after lost signal to thread 16402
W20260709 13:07:58.461663 17148 debug-util.cc:398] Leaking SignalData structure 0x7b0800239640 after lost signal to thread 16494
I20260709 13:07:58.465526 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.465700 20710 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.466167 16538 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:58.466296 20710 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.467125 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.467628 16536 raft_consensus.cc:2410] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:07:58.455821 20716 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.471675 20575 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.248783 20705 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.472606 17124 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.473157 20393 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.473932 20705 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.386914 20715 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:58.467659 16538 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:07:58.477118 17148 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7780 after lost signal to thread 16569
W20260709 13:07:58.477555 17148 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8e80 after lost signal to thread 16570
I20260709 13:07:58.454520 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.438298 16541 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.478538 16543 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:58.398850 20678 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:58.455634 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:58.478719 17148 debug-util.cc:398] Leaking SignalData structure 0x7b080038efa0 after lost signal to thread 16643
I20260709 13:07:58.444281 17119 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.411352 20699 consensus_queue.cc:1243] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 98881185daee4f13b69385e36026216c log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:58.480471 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.481182 16540 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:07:58.481437 17148 debug-util.cc:398] Leaking SignalData structure 0x7b080037c0e0 after lost signal to thread 17151
W20260709 13:07:58.481967 17148 debug-util.cc:398] Leaking SignalData structure 0x7b0800394460 after lost signal to thread 20485
I20260709 13:07:58.484016 16539 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:58.485476 17124 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:07:58.486483 16537 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:58.488127 17121 raft_consensus.cc:1217] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:07:58.488643 17121 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:07:58.480257 17126 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:58.496001 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.496651 16544 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:07:58.264840 20684 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.434507 20694 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.427197 20708 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.494282 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:58.439571 20313 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.449235 20670 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.370661 20702 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.506152 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.509052 16366 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 6, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 6 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:58.514297 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 468358us
I20260709 13:07:58.480635 20715 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.480536 20678 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.494027 20581 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.468680 20710 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.381960 20590 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.528260 20672 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.528451 20590 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.521294 17122 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:07:58.524001 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:07:58.499929 20575 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.527153 20701 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:58.527784 20681 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.504616 20694 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:58.529830 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 76528.2us
I20260709 13:07:58.453783 20685 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.503219 20260 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.538033 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 43851.3us
I20260709 13:07:58.580760 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:58.580891 16511 leader_election.cc:400] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:58.521283 20670 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.542927 16366 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 7, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.477468 20703 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:07:58.544637 20509 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.574877 20391 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:07:58.589071 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 347333us
W20260709 13:07:58.587692 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 262132us
I20260709 13:07:58.590809 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:58.577123 20689 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.582047 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.582170 17119 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:58.524624 20715 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:58.542569 20710 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.584705 16511 leader_election.cc:403] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.543843 16541 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:07:58.517660 20708 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.596565 20583 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.593235 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:58.545650 20575 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.603392 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:58.635231 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.605962 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:58.606693 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:58.588963 20603 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.586782 20509 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.584199 20260 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.612709 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.646890 16542 raft_consensus.cc:2376] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 13. Re-sending same reply.
I20260709 13:07:58.612907 20480 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:58.613358 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.613601 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.608502 20583 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.615566 20708 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.582983 20694 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.616855 20687 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:58.617532 20548 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.000s
I20260709 13:07:58.617641 20702 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.620102 20692 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.594677 20720 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:58.624940 20691 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.631423 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.655984 20583 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.641480 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.656724 16614 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:58.656888 20588 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.657841 16614 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:58.657907 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:58.641645 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:58.658746 16540 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:58.627367 20391 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:58.670560 16536 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:58.644090 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.673323 16612 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:07:58.645972 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:58.648517 16366 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.648002 16611 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:58.682127 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.684911 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.686018 16614 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:58.650638 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.652102 16615 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 5. (term mismatch)
I20260709 13:07:58.652876 20694 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.653301 20548 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.660120 16540 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:58.589404 20421 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:58.707374 20421 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.693926 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:58.633018 20689 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:07:58.633136 20674 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.696516 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.696753 16539 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.710544 16366 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.711369 16539 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:07:58.702001 19984 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:58.712388 16539 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.714181 16539 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.716976 20391 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:58.718000 20391 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.706317 20548 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.707769 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.688001 16615 pending_rounds.cc:85] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 4
I20260709 13:07:58.721060 16615 pending_rounds.cc:107] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 13:07:58.721329 16615 raft_consensus.cc:2889] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.721824 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.722354 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.722699 16613 raft_consensus.cc:2410] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:58.722992 16615 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:58.724012 16613 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:58.711217 20674 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.725449 20674 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.725855 20674 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.727780 20678 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.728920 20683 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.729071 20684 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.729444 20683 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.729981 20718 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.730154 16539 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:58.730563 20718 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.731518 20683 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.733114 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.734513 17127 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:58.738098 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 171215us
I20260709 13:07:58.702281 20260 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.646296 20509 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.750175 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:58.746254 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.757141 16539 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.712258 16366 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.777732 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.648643 20697 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:58.794584 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.798568 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:07:58.799304 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49889.8us
W20260709 13:07:58.811621 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.810582 16366 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 6, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 6 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:07:58.812752 17120 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:07:58.816473 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.817504 17125 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:07:58.816529 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.810603 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:07:58.822269 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.781674 20569 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:07:58.759712 20588 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.825897 20718 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:58.827819 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.828958 20393 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.822330 20716 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:58.829576 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.830135 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.862761 16539 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:58.837306 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:58.837250 20683 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:58.780155 20260 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.841957 20575 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.745956 20703 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.822693 16366 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 8, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.823825 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.745399 20717 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:58.846081 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.847204 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.885174 17120 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:07:58.850208 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.858417 16585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.018s
W20260709 13:07:58.886011 16585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.011s	sys 0.018s
I20260709 13:07:58.852375 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.861546 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:07:58.859817 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:58.863940 16545 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.830283 20581 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:58.851797 20736 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:07:58.782187 20686 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:58.849231 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.886309 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 556148us
I20260709 13:07:58.889200 16538 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:58.890245 16544 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:58.822466 20691 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:07:58.861296 20603 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.861066 20393 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.858839 20583 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.858348 20588 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.883157 16366 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:07:58.892438 16469 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:58.893079 16463 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:07:58.951601 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 91885.2us
I20260709 13:07:58.971330 16462 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:59.083703 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:58.993741 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:59.081153 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.983898 16545 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:07:59.084635 16366 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.085844 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.086772 16545 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
W20260709 13:07:59.084848 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.088188 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.993211 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.020196 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:59.089618 16537 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:07:59.020020 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:07:58.971592 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.091624 16539 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:58.940042 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.024369 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.084687 16540 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:59.092245 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:07:58.951179 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:59.095736 16614 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:59.093976 16461 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:07:58.873396 20590 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.105434 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:59.108943 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:07:59.109294 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 158198us
I20260709 13:07:59.109766 16611 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:07:59.110318 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.110401 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.111034 16536 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
W20260709 13:07:58.994524 20723 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:07:58.993887 20724 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:58.993049 19984 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:58.888863 20720 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.001629 20715 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:58.888643 20480 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:59.114802 16366 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 8, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.015056 20509 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.002086 20730 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:07:59.115929 20729 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.116452 20722 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.117497 16537 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:59.109309 20106 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.118108 20581 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:59.118347 20686 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:59.119066 20728 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.170235 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.119207 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.173956 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:07:59.013200 20421 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:58.888844 20716 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:07:59.009202 20678 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:59.119946 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:07:59.187552 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 67684us
I20260709 13:07:59.087706 20393 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:59.127683 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.129086 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:59.130025 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.127298 19984 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:59.130825 20575 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.131057 20718 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.131465 20313 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.133432 20590 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:58.939493 20717 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.130820 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:59.135771 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.137076 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.137758 20588 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:58.889446 20703 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:59.138120 16544 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.138396 20720 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:58.885613 20260 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:59.107784 20603 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.153228 16541 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:59.154253 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.163357 16366 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:07:59.127458 20670 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
W20260709 13:07:59.142345 20710 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 13:07:59.170583 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.175262 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.176622 17126 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:59.243709 16540 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:07:59.178063 17090 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.178812 16465 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:59.179601 16464 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.179778 16466 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.189044 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:07:59.193084 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64082.9us
I20260709 13:07:59.246016 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.168892 20722 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.200874 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.185467 20689 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.179697 20421 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.254238 20421 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.254382 20717 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.255647 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.256309 16541 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:07:59.257546 16541 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:07:59.194034 20716 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.209904 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.165369 20480 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.209192 16538 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:07:59.192428 20707 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:59.200395 20729 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.229821 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:07:59.262339 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84339.5us
I20260709 13:07:59.200296 20313 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.168610 20730 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.237010 17127 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:59.239215 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:59.291460 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:07:59.294852 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 55785.7us
I20260709 13:07:59.295015 16542 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:07:59.247430 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.195005 20673 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:59.194878 20473 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:59.246465 16366 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 6, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 6 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.291302 16462 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.297423 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.238118 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.246987 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:07:59.292361 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:59.252718 20731 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:59.234069 20685 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:07:59.253362 20260 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:07:59.294867 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.297974 16541 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:59.300431 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62379.1us
I20260709 13:07:59.298184 16467 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.245465 20701 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 13:07:59.223187 19984 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.233515 20590 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.308058 16538 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [9.6-10.7]
W20260709 13:07:59.487378 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.309047 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.248406 20722 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.261655 20710 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:59.616446 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 324187us
I20260709 13:07:59.638451 16466 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.616700 16540 raft_consensus.cc:2410] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:07:59.308386 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.644604 16464 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.306777 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:07:59.639317 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:59.315269 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.646394 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.357455 16470 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:59.524065 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 228441us
W20260709 13:07:59.601090 20742 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:07:59.307037 20503 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:59.581399 20674 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.002s
I20260709 13:07:59.670850 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.670718 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:07:59.671510 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.261348 20678 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:59.673918 20739 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:07:59.245353 20694 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.405s
W20260709 13:07:59.653335 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.677479 20743 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:07:59.248432 20670 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.676398 16470 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
W20260709 13:07:59.681778 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.685846 20740 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:07:59.690307 20603 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.691452 20716 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.695935 20421 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.296931 20313 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:59.699529 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 452529us
I20260709 13:07:59.412313 20473 consensus_queue.cc:1243] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:59.810047 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:07:59.357803 20741 log.cc:927] Time spent T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:07:59.705950 16462 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:07:59.653863 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 357447us
I20260709 13:07:59.411777 20509 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.814180 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.713295 20710 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:59.714033 20548 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.714124 20503 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.651469 20715 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.715082 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.356856 20693 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:59.722903 16466 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.666846 20260 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:59.815200 20603 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:07:59.423811 16366 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 8, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.729641 20720 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:59.730545 20703 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:07:59.289844 20689 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:59.733763 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.734617 20480 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.891021 16537 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:59.421573 20696 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.832553 20503 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.426211 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.899194 16465 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:07:59.737831 16539 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:07:59.754225 20583 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.758407 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.902248 16468 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:07:59.759035 20673 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.762404 16619 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:59.765971 16615 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:59.768522 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:59.769999 16616 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:59.770946 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:59.773092 16613 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:59.776295 20730 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.848611 20391 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.789373 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.736104 20393 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.001s
W20260709 13:07:59.801236 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.801595 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.912817 16538 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:07:59.820377 20722 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:07:59.738538 20674 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.738818 20678 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:59.291448 20725 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.812623 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.812686 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:59.713203 17118 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.921365 16612 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:07:59.921569 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 108991us
I20260709 13:07:59.922101 16544 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:59.923146 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:07:59.924211 16582 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:59.819084 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.925720 16541 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:07:59.831353 16540 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:59.375735 20729 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.439s
I20260709 13:07:59.833199 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:07:59.834976 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.835714 16545 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:07:59.926956 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 284880us
I20260709 13:07:59.927875 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:59.928957 16470 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
W20260709 13:07:59.929250 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.035s	sys 0.068s
I20260709 13:07:59.929605 16619 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:59.929919 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.931257 16463 raft_consensus.cc:2368] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:07:59.930600 16470 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:59.932224 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:59.933012 16619 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:07:59.935118 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:07:59.935726 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:07:59.849409 20581 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:59.858899 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.844408 16462 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:07:59.424018 16542 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 13 index: 5. (index mismatch)
I20260709 13:07:59.938640 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:07:59.841665 20509 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:59.777089 20684 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:59.846696 20693 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:07:59.375101 20680 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:59.892791 20696 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.915601 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.916877 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.919783 20421 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.920172 20678 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.916760 20393 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:07:59.929618 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.035s	sys 0.068s
I20260709 13:07:59.916215 20391 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.912334 20673 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.938416 20745 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:59.920578 20691 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.937064 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:07:59.937561 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 125030us
I20260709 13:07:59.973951 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.975394 16433 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:07:59.889020 16366 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.938687 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1868) took 1288 ms. Trace:
I20260709 13:07:59.976540 16543 rpcz_store.cc:276] 0709 13:07:58.650103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.737005 (+ 86902us) service_pool.cc:224] Handling call
0709 13:07:58.792697 (+ 55692us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.813039 (+ 20342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.813083 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.813744 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 13:07:59.144531 (+330787us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:59.174612 (+ 30081us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.174828 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.174901 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.938473 (+763572us) raft_consensus.cc:1685] finished
0709 13:07:59.938493 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.938616 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1119,"prepare.queue_time_us":26709,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":20963,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":34424,"thread_start_us":274555,"threads_started":1,"wal-append.queue_time_us":383585}
I20260709 13:07:59.939352 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:07:59.957315 20696 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.944141 16540 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:07:59.988078 16540 pending_rounds.cc:85] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 8
I20260709 13:07:59.988387 16540 pending_rounds.cc:107] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:59.988675 16540 raft_consensus.cc:2889] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.933635 20717 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:59.943001 20473 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.930625 20260 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:59.946548 16468 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.943290 20703 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:59.814534 16461 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.931281 20725 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:07:59.966507 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.929613 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 312174us
I20260709 13:07:59.968493 16545 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:59.970261 17120 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:59.940326 20718 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:59.945971 20686 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.009227 20670 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:07:59.986361 20729 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.016247 20686 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.016928 20729 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.017275 20686 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.958532 20746 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:07:59.981317 20421 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.018028 20729 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.020902 20707 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:00.021375 20707 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:00.021718 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.022306 17126 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.022253 20707 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.023522 20707 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.991088 20701 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:59.959750 20747 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:00.025013 20701 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:00.025329 20747 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.025127 20686 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.026062 20701 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.981456 16466 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.027261 20701 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.027829 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.028339 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.028945 20689 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:07:59.991225 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51965.3us
I20260709 13:08:00.030190 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:07:59.945416 20684 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:00.031064 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.031577 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.031464 20684 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:07:59.958824 20683 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:00.032316 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:07:59.938638 20694 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:00.035290 20260 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:00.004720 16619 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:59.999719 20569 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.006974 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:07:59.974150 20745 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.007728 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:00.043325 16618 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:59.958535 20480 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:07:59.943866 20548 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:08:00.053783 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.014611 19984 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.015156 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.016203 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.058503 17123 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 6.
I20260709 13:08:00.026211 20747 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.027339 20686 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.028563 16466 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 6: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.029066 17120 raft_consensus.cc:2393] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:00.040016 20670 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.032521 20684 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:59.942195 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.075260 16470 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:07:59.962049 20509 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:07:59.938540 20583 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:59.945192 20680 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:07:59.982054 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.053702 20480 consensus_queue.cc:1243] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:00.033807 16463 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:07:59.931133 20674 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:00.038101 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 102475us
I20260709 13:08:00.039083 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.006886 20722 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.040478 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.004540 20730 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:00.045676 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.009959 20685 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:00.053740 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.054652 17119 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.055011 16610 raft_consensus.cc:606] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.013973 20752 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:00.009171 20717 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:00.036044 20575 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:59.986605 20691 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.061829 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:00.067453 17125 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.068889 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 798) took 1344 ms. Trace:
I20260709 13:08:00.069846 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.070739 20703 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.041630 20748 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.074182 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 631) took 1378 ms. Trace:
I20260709 13:08:00.143411 16612 rpcz_store.cc:276] 0709 13:07:58.695690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.707529 (+ 11839us) service_pool.cc:224] Handling call
0709 13:08:00.074021 (+1366492us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540019fad4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:00.074131 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759972224}
I20260709 13:08:00.094578 20747 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.077045 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:00.144572 16545 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.962966 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.145818 16462 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.082577 20590 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:08:00.009473 20473 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.051321 20745 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.079210 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.151309 16468 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.089370 17122 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:00.083314 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:00.090297 17124 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.098491 20685 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:00.082926 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.100294 17127 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:00.099993 16614 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:00.094326 16615 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:00.102564 16618 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:00.055945 20569 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.080438 20670 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.118881 20575 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:00.112617 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.082571 20680 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.097842 20686 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:08:00.122788 16611 raft_consensus.cc:2410] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:00.126257 16461 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
W20260709 13:08:00.137710 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 155727us
I20260709 13:08:00.125936 17118 rpcz_store.cc:276] 0709 13:07:58.724644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.732919 (+  8275us) service_pool.cc:224] Handling call
0709 13:07:58.745249 (+ 12330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.921511 (+1176262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.068562 (+147051us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:00.068816 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2225578752}
I20260709 13:08:00.119555 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.167882 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.098059 20421 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:00.147187 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56088.3us
I20260709 13:08:00.041899 20693 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.079237 20710 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:00.149900 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.082615 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.154160 16536 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:00.155604 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.236330 16462 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.157896 17119 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:00.160647 17124 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:00.236846 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.236665 16468 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
W20260709 13:08:00.164515 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.102996 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:00.094372 20683 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:00.237975 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.238619 16468 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:00.133615 17126 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:00.169651 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.239435 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.099364 20756 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:08:00.240337 16545 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:08:00.240360 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:00.165616 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 128090us
W20260709 13:08:00.218113 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.242619 16463 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.225432 16465 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:00.225749 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:00.169392 16618 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.145488 20757 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.103426 20761 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:08:00.232301 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:00.150519 20730 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.235212 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 151992us
I20260709 13:08:00.146850 20391 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.241909 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:00.155011 20673 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.146688 20746 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.253525 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.165125 20674 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:08:00.216249 20722 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.245764 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.276908 16463 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 6.
I20260709 13:08:00.278139 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.279052 16463 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.279955 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.146834 20703 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:00.254297 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.255004 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.252941 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.228907 20575 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.147433 20260 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.260270 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.245498 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.266754 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 522) took 1179 ms. Trace:
I20260709 13:08:00.261369 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.227236 20421 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.119055 20752 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:00.282411 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 180064us
I20260709 13:08:00.283974 17127 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.283655 16463 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.284509 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:00.235877 20393 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.294589 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:00.300124 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.301460 16466 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:00.150604 20748 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.244902 20755 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.308600 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.306995 16582 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:00.306377 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.312674 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.313576 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.314224 16465 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:00.274340 20756 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:00.256945 20746 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.282330 20673 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.291501 16469 rpcz_store.cc:276] 0709 13:07:59.087022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.087137 (+   115us) service_pool.cc:224] Handling call
0709 13:07:59.097155 (+ 10018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.413125 (+315970us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:59.508490 (+ 95365us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.000187 (+491697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.000258 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:00.000322 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.266455 (+266133us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54002a71d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:00.266519 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.266680 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6879,"prepare.queue_time_us":114209,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":7016,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":726087552,"thread_start_us":484290,"threads_started":1,"wal-append.queue_time_us":496699}
I20260709 13:08:00.302858 20718 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.105258 20725 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.260641 20716 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.166326 20509 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.334621 16469 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.335551 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1862) took 1149 ms. Trace:
I20260709 13:08:00.335954 16469 rpcz_store.cc:276] 0709 13:07:59.186062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.323188 (+1137126us) service_pool.cc:224] Handling call
0709 13:08:00.326294 (+  3106us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.335218 (+  8924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.335480 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.322041 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.317093 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.338308 20758 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.262246 20730 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.323167 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.371351 16466 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:00.371996 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1864) took 1164 ms. Trace:
I20260709 13:08:00.340287 16469 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:08:00.372542 16466 rpcz_store.cc:276] 0709 13:07:59.207899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.370785 (+1162886us) service_pool.cc:224] Handling call
0709 13:08:00.371112 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.371755 (+   643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.371948 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.373139 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60823.1us
I20260709 13:08:00.373319 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1863) took 1176 ms. Trace:
I20260709 13:08:00.373401 20773 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.369091 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:00.373955 20773 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:00.340557 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 82737.4us
I20260709 13:08:00.374406 20773 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.374701 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:00.371937 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 48835.9us
I20260709 13:08:00.376096 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:00.314378 20763 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.288203 20722 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.322121 20746 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.316358 20480 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.320279 20693 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.373696 16469 rpcz_store.cc:276] 0709 13:07:59.197363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.336930 (+1139567us) service_pool.cc:224] Handling call
0709 13:08:00.340016 (+  3086us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.373027 (+ 33011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.373246 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.377812 16619 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:00.379832 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67225us
W20260709 13:08:00.504086 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.327508 20716 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.504982 20716 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.329402 20718 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:00.505955 20718 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.329010 20756 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:00.507544 20756 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.338836 20758 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.403350 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:00.511130 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 107896us
I20260709 13:08:00.254462 20757 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.274367 20685 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.408834 16466 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.324034 20603 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:08:00.416738 16470 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.318163 20755 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.387020 20391 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.517549 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.517679 20581 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.518152 20581 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.519711 20745 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.522570 20745 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.523810 16613 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:00.523876 16470 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:08:00.524200 20707 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.002s
I20260709 13:08:00.370101 20673 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:08:00.526062 16461 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: [9.8-12.9]
I20260709 13:08:00.526696 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1866) took 1297 ms. Trace:
W20260709 13:08:00.410699 20313 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.002s
I20260709 13:08:00.425619 20777 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:00.418845 20766 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:00.409493 20715 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:08:00.429344 20762 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:08:00.438470 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.439191 17127 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:00.253717 20717 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.406036 20770 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.426980 20691 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.456349 20767 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:00.502388 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:00.503943 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.384287 20772 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:00.509531 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 341704us
W20260709 13:08:00.510202 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.511669 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 608) took 1313 ms. Trace:
I20260709 13:08:00.464424 20569 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.513059 16469 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:08:00.563591 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 529) took 1345 ms. Trace:
I20260709 13:08:00.528513 20729 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:00.515069 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.516745 20776 raft_consensus.cc:2764] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:00.510835 20480 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.408066 20473 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.527030 16461 rpcz_store.cc:276] 0709 13:07:59.229059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.525505 (+1296446us) service_pool.cc:224] Handling call
0709 13:08:00.525835 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:00.526430 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.526647 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.527894 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 154043us
I20260709 13:08:00.502903 20670 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.538097 20703 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.541267 20752 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.512087 20758 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:00.621373 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.552224 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 494566us
W20260709 13:08:00.553391 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 299930us
W20260709 13:08:00.556254 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52386.7us
I20260709 13:08:00.561194 16539 rpcz_store.cc:276] 0709 13:07:59.198546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.920898 (+722352us) service_pool.cc:224] Handling call
0709 13:07:59.933820 (+ 12922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.934016 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:00.038017 (+104001us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.510285 (+472268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:00.510358 (+    73us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.510420 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.510519 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.511614 (+  1095us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":167942,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":185803,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":15318,"thread_start_us":565201,"threads_started":3,"wal-append.queue_time_us":189226}
I20260709 13:08:00.563932 16469 rpcz_store.cc:276] 0709 13:07:59.217973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.511163 (+1293190us) service_pool.cc:224] Handling call
0709 13:08:00.512754 (+  1591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.563326 (+ 50572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.563539 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.515010 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:00.566848 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.623534 17119 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.546535 20777 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:00.589643 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.533582 20313 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.596823 20774 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:00.614123 20480 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.615572 20748 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.609045 20729 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:00.617002 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 240949us
W20260709 13:08:00.619789 20503 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.709s	user 0.008s	sys 0.001s
I20260709 13:08:00.577687 20673 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.554023 20770 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.624179 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:00.624855 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:00.609933 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 94980.4us
I20260709 13:08:00.606448 20722 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.621747 20694 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.606029 20730 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.636298 16469 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:00.641364 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.654135 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1868) took 1356 ms. Trace:
I20260709 13:08:00.654551 16469 rpcz_store.cc:276] 0709 13:07:59.297494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.626022 (+1328528us) service_pool.cc:224] Handling call
0709 13:08:00.636120 (+ 10098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.653899 (+ 17779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.654085 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:00.642187 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.608690 20691 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:00.630602 20703 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.640331 20696 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.635s	user 0.008s	sys 0.003s
I20260709 13:08:00.631302 20774 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.630338 20701 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.599s	user 0.011s	sys 0.000s
I20260709 13:08:00.648983 16467 raft_consensus.cc:2368] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:00.642313 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:00.640851 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:00.655788 20745 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:00.656188 20786 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:00.658798 16511 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:08:00.659521 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.695071 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52840.7us
I20260709 13:08:00.659622 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:00.696568 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:00.657243 20673 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.646265 20769 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.668591 20575 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.669417 20707 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.644021 20583 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:00.670481 20788 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:08:00.653864 20503 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.671959 20773 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.711341 20745 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.728102 20773 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.729653 16464 raft_consensus.cc:2368] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:08:00.710888 20674 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.730154 20674 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.730492 20674 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.730649 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1875) took 1058 ms. Trace:
I20260709 13:08:00.731011 16464 rpcz_store.cc:276] 0709 13:07:59.671903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.733449 (+ 61546us) service_pool.cc:224] Handling call
0709 13:08:00.730466 (+997017us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003b9554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:00.730595 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936487808}
W20260709 13:08:00.664237 20678 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.000s
I20260709 13:08:00.711058 20691 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.733081 20691 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:00.733022 20678 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.733590 20691 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:00.733790 20747 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:08:00.735283 20678 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.697288 20730 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.672806 16616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:00.674857 20581 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.737372 16616 raft_consensus.cc:606] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.737807 16616 raft_consensus.cc:614] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:00.738694 20684 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.002s
I20260709 13:08:00.738803 20581 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.664487 20694 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:08:00.676235 20777 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:00.740960 20680 consensus_meta.cc:287] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.007s
I20260709 13:08:00.741385 20680 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.742503 17126 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:00.682415 16469 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:00.661485 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:00.624315 20603 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:08:00.704082 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45345.3us
I20260709 13:08:00.706128 20473 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:00.714813 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.685920 20774 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:00.718199 20782 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.718816 20575 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:00.715960 20583 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.722332 20313 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.723428 20755 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.724272 20757 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.724851 20673 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.724731 20729 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:00.725875 20781 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:00.725734 20421 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.726202 20503 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.737267 20730 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.738962 16468 raft_consensus.cc:2410] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:08:00.687083 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 46330.8us
I20260709 13:08:00.833005 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:00.745967 16464 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.746029 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:00.836007 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2064) took 1010 ms. Trace:
W20260709 13:08:00.836136 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 90172.5us
I20260709 13:08:00.836453 16464 rpcz_store.cc:276] 0709 13:07:59.825129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.732414 (+907285us) service_pool.cc:224] Handling call
0709 13:08:00.732715 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.835683 (+102968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.835940 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.837352 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:00.838995 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:00.649168 20770 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.746501 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1874) took 1074 ms. Trace:
I20260709 13:08:00.839622 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:00.840157 16469 rpcz_store.cc:276] 0709 13:07:59.671605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.666823 (+995218us) service_pool.cc:224] Handling call
0709 13:08:00.682201 (+ 15378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.746210 (+ 64009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.746437 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.685477 20703 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:00.758363 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.760686 20583 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.761466 20680 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:00.848960 20684 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:00.689697 20696 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.849424 20684 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.774290 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 65270us
W20260709 13:08:00.775214 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 113840us
I20260709 13:08:00.751397 20694 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:00.816956 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.749531 20473 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:00.756469 20782 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:00.845898 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1896) took 1231 ms. Trace:
I20260709 13:08:00.838244 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:00.845979 16469 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:00.853405 16511 leader_election.cc:400] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:08:00.872193 16511 leader_election.cc:403] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.864027 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:00.866330 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:00.868474 16464 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:00.873898 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2065) took 1048 ms. Trace:
I20260709 13:08:00.874477 16464 rpcz_store.cc:276] 0709 13:07:59.825426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.837556 (+1012130us) service_pool.cc:224] Handling call
0709 13:08:00.868044 (+ 30488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.873166 (+  5122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.873372 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.869014 17124 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:00.872414 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2068) took 1046 ms. Trace:
I20260709 13:08:00.875692 16469 rpcz_store.cc:276] 0709 13:07:59.826190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.841357 (+1015167us) service_pool.cc:224] Handling call
0709 13:08:00.845720 (+  4363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.872107 (+ 26387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.872329 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:00.875029 16582 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.869757 16536 rpcz_store.cc:276] 0709 13:07:59.614665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.725964 (+111299us) service_pool.cc:224] Handling call
0709 13:07:59.833043 (+107079us) spinlock_profiling.cc:243] Waited 987 us on lock 0x7b5800003398. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:00.845733 (+1012690us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003854d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:00.845841 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520071424}
I20260709 13:08:00.877951 20473 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:00.879148 20473 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.850384 20313 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:00.863766 20718 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:00.881366 20313 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:00.882158 20717 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:00.882290 20313 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.882819 20718 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.883565 20786 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:00.849854 20684 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.885814 20749 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.231s
I20260709 13:08:00.886861 20745 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:01.005550 20674 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.006202 20745 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.006645 20745 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.996462 20730 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.007807 20674 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:00.895534 20694 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:01.009828 20694 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:00.998916 20548 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:00.876179 20782 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:01.012948 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 159726us
I20260709 13:08:00.873946 20421 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.934216 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:00.957502 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.017814 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83715.3us
W20260709 13:08:00.979681 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 102546us
I20260709 13:08:01.018534 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:00.831175 20603 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.877151 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:01.025753 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 149394us
I20260709 13:08:00.884675 16462 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:00.866489 20755 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:00.986914 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:00.850521 20670 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:00.998279 20680 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:00.870723 20480 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.998322 20775 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.982396 20673 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:00.889823 20765 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.471s	user 0.005s	sys 0.000s
I20260709 13:08:00.967666 20758 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.026609 20707 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.064714 17120 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 13:08:01.028568 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:00.876459 20575 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:08:01.029696 16469 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:00.982034 20717 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.997720 20569 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:00.997340 20678 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.032868 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:00.984057 20716 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.039863 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:00.997648 20703 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:01.000790 20720 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:01.039558 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.041476 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:01.048430 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:01.052249 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.013828 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:08:01.061309 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.063606 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.029673 20674 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.030220 20761 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:01.035388 20691 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.032364 20670 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.052676 20480 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.123862 20480 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.116868 20720 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:01.125484 20720 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.079478 20717 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:01.130131 20746 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.002s
I20260709 13:08:01.130280 20717 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.130676 20746 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.033617 20603 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.133926 20767 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:01.134495 20767 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:01.135563 20767 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.075889 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:01.137236 17119 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:01.137281 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2226) took 1015 ms. Trace:
I20260709 13:08:01.137809 20720 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:01.139454 20745 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.137970 16612 rpcz_store.cc:276] 0709 13:08:00.121828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.246827 (+124999us) service_pool.cc:224] Handling call
0709 13:08:00.290852 (+ 44025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.308998 (+ 18146us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:00.573191 (+264193us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.867803 (+294612us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.871366 (+  3563us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.871582 (+   216us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:00.871623 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.871695 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.006734 (+135039us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4800150258. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:08:01.136843 (+130109us) raft_consensus.cc:1685] finished
0709 13:08:01.136984 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.137194 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3385,"prepare.queue_time_us":336040,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3770,"raft.queue_time_us":39051,"raft.run_cpu_time_us":2711,"raft.run_wall_time_us":173019,"spinlock_wait_cycles":23639936,"thread_start_us":512302,"threads_started":2,"wal-append.queue_time_us":467369}
I20260709 13:08:01.076144 17127 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:01.072588 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:01.078661 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:01.041487 20673 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.074064 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.142400 20673 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.142725 16614 raft_consensus.cc:2368] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 6. Current term is 7.
I20260709 13:08:01.042222 20755 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:01.149515 20755 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.151086 20745 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.049224 20770 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:01.070783 20753 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.852s	user 0.000s	sys 0.003s
I20260709 13:08:01.154837 20673 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.156594 20770 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.157320 20391 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:08:01.157680 20794 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:08:01.157799 20391 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:01.158727 20391 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.121201 16617 raft_consensus.cc:2368] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:08:01.121905 20670 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:01.032109 20581 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:01.128007 20758 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.065035 20680 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:01.164436 17119 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:08:01.157404 20673 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.165192 20696 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:01.076674 20569 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:01.166154 20691 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.166656 20746 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:01.119247 20761 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.136256 20774 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:01.175324 20769 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:01.172569 20767 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:01.160003 20790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.010s	sys 0.017s
W20260709 13:08:01.197655 20790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.017s
I20260709 13:08:01.194685 20761 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.184520 20782 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:01.242988 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.243449 16461 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 13. Ops: []
I20260709 13:08:01.248705 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1867) took 2010 ms. Trace:
I20260709 13:08:01.249468 16461 rpcz_store.cc:276] 0709 13:07:59.238152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.624703 (+1386551us) service_pool.cc:224] Handling call
0709 13:08:00.640685 (+ 15982us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.244581 (+603896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.248148 (+  3567us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400378f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:01.248573 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384545152}
W20260709 13:08:01.251475 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.252902 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:01.254266 16461 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.058485 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1865) took 1841 ms. Trace:
I20260709 13:08:01.261775 16463 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:01.262171 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1861) took 2085 ms. Trace:
I20260709 13:08:00.997802 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:01.262770 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1869) took 1841 ms (client timeout 1694 ms). Trace:
I20260709 13:08:01.066402 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1876) took 1394 ms. Trace:
I20260709 13:08:01.263860 16464 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:01.264228 16468 rpcz_store.cc:276] 0709 13:07:59.672201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.239223 (+567022us) service_pool.cc:224] Handling call
0709 13:08:01.053660 (+814437us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54003aeb54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:01.066327 (+ 12667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146911488}
I20260709 13:08:01.261332 16466 rpcz_store.cc:276] 0709 13:07:59.217377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.373412 (+1156035us) service_pool.cc:224] Handling call
0709 13:08:00.373678 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:00.512277 (+138599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.058118 (+545841us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54003570d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:01.058385 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80294272}
I20260709 13:08:01.265831 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:01.263069 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1886) took 1536 ms. Trace:
I20260709 13:08:01.266656 16463 rpcz_store.cc:276] 0709 13:07:59.727049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.316782 (+589733us) service_pool.cc:224] Handling call
0709 13:08:01.262851 (+946069us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54003b9f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:01.263018 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122931072}
I20260709 13:08:01.267452 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2070) took 1440 ms. Trace:
I20260709 13:08:01.050468 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:01.267946 16470 rpcz_store.cc:276] 0709 13:07:59.826696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.240142 (+413446us) service_pool.cc:224] Handling call
0709 13:08:01.267009 (+1026867us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:01.267260 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403322112}
I20260709 13:08:01.269690 16465 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.270336 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:01.266371 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:01.271951 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:01.272732 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:01.274003 16466 raft_consensus.cc:2410] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:01.262638 16462 rpcz_store.cc:276] 0709 13:07:59.176399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.320508 (+1144109us) service_pool.cc:224] Handling call
0709 13:08:01.261683 (+941175us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54000b2f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:01.261935 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173515136}
I20260709 13:08:01.275980 16466 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:08:01.263617 16467 rpcz_store.cc:269] 0709 13:07:59.420866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.669561 (+248695us) service_pool.cc:224] Handling call
0709 13:08:01.262254 (+1592693us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54003af054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:01.262552 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869968128}
I20260709 13:08:01.276710 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2071) took 1427 ms. Trace:
I20260709 13:08:01.277104 16466 rpcz_store.cc:276] 0709 13:07:59.849055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.274802 (+1425747us) service_pool.cc:224] Handling call
0709 13:08:01.275547 (+   745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.276403 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.276634 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12672}
I20260709 13:08:01.277951 16467 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:01.278653 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2077) took 1295 ms. Trace:
I20260709 13:08:01.278903 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:01.278990 16467 rpcz_store.cc:276] 0709 13:07:59.983574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.277158 (+1293584us) service_pool.cc:224] Handling call
0709 13:08:01.277593 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.278386 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.278603 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.280182 16468 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:01.280454 16470 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.275851 16462 raft_consensus.cc:1217] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-11.7]   Dedup: 9.6->[11.7-11.7]
I20260709 13:08:01.285182 16462 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:08:01.285480 16468 raft_consensus.cc:1240] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:01.286093 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2075) took 1354 ms. Trace:
I20260709 13:08:01.307250 16470 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:01.297242 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2085) took 1266 ms. Trace:
I20260709 13:08:01.268321 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:01.956709 16463 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:01.957502 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2088) took 1925 ms. Trace:
I20260709 13:08:01.957852 16463 rpcz_store.cc:276] 0709 13:08:00.031815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.955994 (+1924179us) service_pool.cc:224] Handling call
0709 13:08:01.956453 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.957218 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.957427 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.959734 16463 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:08:01.960350 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2089) took 1928 ms. Trace:
I20260709 13:08:01.316121 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.307579 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2083) took 1277 ms. Trace:
I20260709 13:08:01.301904 16465 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:02.104321 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 534) took 1081 ms. Trace:
I20260709 13:08:02.104832 16465 rpcz_store.cc:276] 0709 13:08:01.022476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.050080 (+ 27604us) service_pool.cc:224] Handling call
0709 13:08:02.104225 (+1054145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:01.551290 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.307842 16462 rpcz_store.cc:276] 0709 13:07:59.931499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.274886 (+1343387us) service_pool.cc:224] Handling call
0709 13:08:01.275503 (+   617us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.285697 (+ 10194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.285979 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17152}
I20260709 13:08:02.112581 16462 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.113310 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2090) took 2061 ms. Trace:
I20260709 13:08:02.113672 16462 rpcz_store.cc:276] 0709 13:08:00.051861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.111754 (+2059893us) service_pool.cc:224] Handling call
0709 13:08:02.112277 (+   523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.113055 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.113253 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.647197 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2086) took 1614 ms. Trace:
I20260709 13:08:02.116197 16470 rpcz_store.cc:276] 0709 13:08:00.031317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.590808 (+1559491us) service_pool.cc:224] Handling call
0709 13:08:01.591762 (+   954us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.592748 (+   986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.592808 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:01.593430 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.637265 (+ 43835us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:01.637311 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.638190 (+   879us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.645652 (+  7462us) raft_consensus.cc:1685] finished
0709 13:08:01.645685 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.645860 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":43366,"threads_started":1,"wal-append.queue_time_us":45522}
I20260709 13:08:02.118875 16470 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:08:02.119572 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2093) took 2019 ms. Trace:
I20260709 13:08:02.119920 16470 rpcz_store.cc:276] 0709 13:08:00.100520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.118035 (+2017515us) service_pool.cc:224] Handling call
0709 13:08:02.118469 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.119274 (+   805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.119517 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:01.655928 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.659142 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 530) took 1628 ms. Trace:
I20260709 13:08:01.686582 16461 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
W20260709 13:08:02.122201 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.122496 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 537) took 1081 ms. Trace:
I20260709 13:08:02.122906 16461 rpcz_store.cc:276] 0709 13:08:01.040972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.252294 (+211322us) service_pool.cc:224] Handling call
0709 13:08:02.122438 (+870144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.124475 16461 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:02.125759 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 531) took 1104 ms. Trace:
I20260709 13:08:02.126102 16461 rpcz_store.cc:276] 0709 13:08:01.021454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.123655 (+1102201us) service_pool.cc:224] Handling call
0709 13:08:02.124054 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.125484 (+  1430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.125682 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.898718 16356 maintenance_manager.cc:643] P e0b8327892f143ffba83cd5a4c97d808: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.151s	user 0.203s	sys 0.082s Metrics: {"bytes_written":30272,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":62468,"dirs.run_cpu_time_us":447,"dirs.run_wall_time_us":10524,"drs_written":1,"lbm_read_time_us":395,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5467,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":70829,"threads_started":1,"update_count":14}
I20260709 13:08:01.308385 16466 rpcz_store.cc:276] 0709 13:08:00.031015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.295836 (+1264821us) service_pool.cc:224] Handling call
0709 13:08:01.296329 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.296747 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.296815 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.296889 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:01.296936 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.297012 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.297172 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:01.313944 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.481029 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.694244 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:01.314949 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 332012us
W20260709 13:08:01.320603 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.860095 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.366803 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.322134 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 308196us
I20260709 13:08:01.699568 16541 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:01.916276 16536 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: [9.10-11.11]
I20260709 13:08:01.311017 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 614) took 1268 ms. Trace:
I20260709 13:08:02.374282 16540 rpcz_store.cc:276] 0709 13:08:00.042441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.042568 (+   127us) service_pool.cc:224] Handling call
0709 13:08:00.062648 (+ 20080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.063104 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.063144 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.063706 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.224513 (+160807us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:00.224562 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.224620 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.889207 (+664587us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:01.310159 (+420952us) raft_consensus.cc:1685] finished
0709 13:08:01.310211 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.310718 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102742,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":60779,"spinlock_wait_cycles":4075392,"thread_start_us":120606,"threads_started":1,"wal-append.queue_time_us":230289,"wal-append.run_cpu_time_us":9453,"wal-append.run_wall_time_us":1821647}
I20260709 13:08:01.696229 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.377653 16542 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:01.615972 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.304631 16469 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
W20260709 13:08:02.383608 16469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2097) took 1530 ms (client timeout 1736 ms). Trace:
W20260709 13:08:02.384032 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.383991 16469 rpcz_store.cc:269] 0709 13:08:00.853408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.986592 (+133184us) service_pool.cc:224] Handling call
0709 13:08:02.383532 (+1396940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.317606 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:01.319489 16615 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:02.377691 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:02.386453 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1876) took 1073 ms. Trace:
I20260709 13:08:01.320541 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.420298 16616 raft_consensus.cc:2410] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:02.420862 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1873) took 1109 ms. Trace:
I20260709 13:08:02.421204 16616 rpcz_store.cc:276] 0709 13:08:01.311743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.320054 (+  8311us) service_pool.cc:224] Handling call
0709 13:08:02.420750 (+1100696us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.422412 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:01.318889 16614 raft_consensus.cc:1217] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:08:01.320170 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.434645 16618 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:02.435236 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1878) took 1121 ms. Trace:
I20260709 13:08:02.435643 16618 rpcz_store.cc:276] 0709 13:08:01.314064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.319564 (+  5500us) service_pool.cc:224] Handling call
0709 13:08:02.435163 (+1115599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.162556 16610 raft_consensus.cc:2368] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:08:02.438020 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:02.440093 16610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1870) took 1400 ms (client timeout 1688 ms). Trace:
I20260709 13:08:01.318548 16617 raft_consensus.cc:1217] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 13:08:02.441758 16617 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:08:02.442342 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1880) took 1126 ms. Trace:
I20260709 13:08:02.442536 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:01.320420 16619 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:02.444676 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1877) took 1131 ms. Trace:
I20260709 13:08:02.445159 16619 rpcz_store.cc:276] 0709 13:08:01.313715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.319402 (+  5687us) service_pool.cc:224] Handling call
0709 13:08:01.319919 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.444324 (+1124405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.444603 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.446915 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:01.960690 16463 rpcz_store.cc:276] 0709 13:08:00.032109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.958928 (+1926819us) service_pool.cc:224] Handling call
0709 13:08:01.959419 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.960100 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.960293 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:01.522413 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.326171 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.330029 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:01.528131 20575 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.913573 20260 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.468120 20260 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:01.159937 20391 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:01.169972 20581 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:01.342669 20603 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.167598 17124 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:02.503661 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 703) took 1455 ms. Trace:
I20260709 13:08:02.504024 17124 rpcz_store.cc:276] 0709 13:08:01.047696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.048168 (+   472us) service_pool.cc:224] Handling call
0709 13:08:02.503474 (+1455306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:01.480576 20670 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.507584 20670 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:01.118983 20674 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:02.509182 20674 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:01.118757 20678 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.402654 20684 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.513765 20833 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:01.834455 20313 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.514485 20833 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.515064 20832 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.515359 20313 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.515669 20832 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.517127 16538 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:08:01.386593 20716 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:01.858299 20746 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:08:01.328521 20509 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.567178 20509 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.568022 20842 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.568629 20842 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.569582 20509 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.570910 20842 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.571681 20838 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.572265 20838 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.573061 20674 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.574481 20838 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.331151 20569 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.577111 16461 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:02.577968 20837 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.579526 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 532) took 1557 ms. Trace:
I20260709 13:08:02.579900 16461 rpcz_store.cc:276] 0709 13:08:01.021832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.126857 (+1105025us) service_pool.cc:224] Handling call
0709 13:08:02.127262 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.577551 (+450289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.579293 (+  1742us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002a94d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:02.579469 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034078592}
I20260709 13:08:01.345993 20680 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:01.930333 20685 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.350521 20689 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:02.589080 20689 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.589654 20689 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.540333 20761 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.595541 20761 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.197057 20769 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:02.597240 20313 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.598222 20832 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.598012 20769 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.598820 20833 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:02.599352 20769 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:01.402148 20774 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:01.522616 20775 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9.
I20260709 13:08:01.382198 20782 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:01.537091 20805 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.097s	user 0.000s	sys 0.002s
I20260709 13:08:02.021539 16612 raft_consensus.cc:2368] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
W20260709 13:08:02.622728 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1874) took 1310 ms (client timeout 1578 ms). Trace:
W20260709 13:08:02.623142 16612 rpcz_store.cc:269] 0709 13:08:01.312255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.315218 (+  2963us) service_pool.cc:224] Handling call
0709 13:08:02.622668 (+1307450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.624107 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.624858 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2237) took 1030 ms. Trace:
I20260709 13:08:02.625165 16612 rpcz_store.cc:276] 0709 13:08:01.594821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.623839 (+1029018us) service_pool.cc:224] Handling call
0709 13:08:02.624791 (+   952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.090845 20730 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.101370 16468 rpcz_store.cc:276] 0709 13:08:00.030474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.284664 (+1254190us) service_pool.cc:224] Handling call
0709 13:08:01.285234 (+   570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.307109 (+ 21875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.307462 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:01.698282 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.125106 16467 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:02.121408 16464 rpcz_store.cc:276] 0709 13:08:00.030694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.287553 (+1256859us) service_pool.cc:224] Handling call
0709 13:08:01.288126 (+   573us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.288843 (+   717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.288885 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.289742 (+   857us) log.cc:844] Serialized 52 byte log entry
0709 13:08:01.608749 (+319007us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:01.657125 (+ 48376us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.657384 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.657461 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.657496 (+    35us) raft_consensus.cc:1685] finished
0709 13:08:01.657512 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.659027 (+  1515us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":69975,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":48411,"raft.run_cpu_time_us":469,"raft.run_wall_time_us":2629,"thread_start_us":343819,"threads_started":2,"wal-append.queue_time_us":273442}
I20260709 13:08:02.115137 16462 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:02.130415 20824 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.628798 20824 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.629858 20569 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.631037 20824 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.131987 16357 maintenance_manager.cc:419] P e0b8327892f143ffba83cd5a4c97d808: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8595 bytes on disk
I20260709 13:08:02.132642 16466 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.632333 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 535) took 1609 ms. Trace:
I20260709 13:08:02.632688 16466 rpcz_store.cc:276] 0709 13:08:01.022806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.127957 (+1105151us) service_pool.cc:224] Handling call
0709 13:08:02.132339 (+  4382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.632099 (+499760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.632279 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.181720 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 536) took 1141 ms. Trace:
W20260709 13:08:02.191630 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.633754 16356 maintenance_manager.cc:643] P e0b8327892f143ffba83cd5a4c97d808: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":427,"lbm_reads_lt_1ms":4}
I20260709 13:08:01.523540 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:02.637646 20782 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.637780 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.11454e+06us
W20260709 13:08:02.354933 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.638334 20782 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.633570 16465 rpcz_store.cc:276] 0709 13:08:01.040629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.130690 (+1090061us) service_pool.cc:224] Handling call
0709 13:08:02.133132 (+  2442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.133885 (+   753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.133919 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.134467 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.176105 (+ 41638us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:02.176151 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.176230 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.181418 (+  5188us) raft_consensus.cc:1685] finished
0709 13:08:02.181444 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.181619 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":41168,"threads_started":1,"wal-append.queue_time_us":40532}
I20260709 13:08:02.385882 16613 raft_consensus.cc:2368] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:02.640810 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1872) took 1330 ms. Trace:
I20260709 13:08:02.626096 20730 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.641214 20782 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:02.642892 20730 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.644244 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:02.386827 16615 rpcz_store.cc:276] 0709 13:08:01.313285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.318332 (+  5047us) service_pool.cc:224] Handling call
0709 13:08:01.318871 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.386168 (+1067297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.386353 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.399544 16469 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:02.417086 16542 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:01.316875 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.723520 16611 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:08:02.724150 16611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1879) took 1409 ms (client timeout 1792 ms). Trace:
W20260709 13:08:02.724630 16611 rpcz_store.cc:269] 0709 13:08:01.315807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.316157 (+   350us) service_pool.cc:224] Handling call
0709 13:08:02.724059 (+1407902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.725924 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.726948 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1895) took 1339 ms. Trace:
I20260709 13:08:02.727434 16611 rpcz_store.cc:276] 0709 13:08:01.387516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.725549 (+1338033us) service_pool.cc:224] Handling call
0709 13:08:02.726854 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.425025 16614 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:02.430089 16543 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.729362 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1875) took 1416 ms. Trace:
I20260709 13:08:02.730317 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.731616 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.732306 16543 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:08:02.432132 16616 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:02.733108 16616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1881) took 1416 ms (client timeout 1639 ms). Trace:
W20260709 13:08:02.733525 16616 rpcz_store.cc:269] 0709 13:08:01.338201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.422145 (+1083944us) service_pool.cc:224] Handling call
0709 13:08:02.733046 (+310901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.734496 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.735096 16616 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:02.735598 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1889) took 1393 ms. Trace:
I20260709 13:08:02.735916 16616 rpcz_store.cc:276] 0709 13:08:01.342306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.734182 (+1391876us) service_pool.cc:224] Handling call
0709 13:08:02.735539 (+  1357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.432068 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.737174 16540 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:02.738152 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.739014 16540 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:02.739809 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.433194 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.440505 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.741900 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.742530 16544 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.443287 16537 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:02.745352 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.745913 16537 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.747757 20689 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.436712 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.458498 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 811) took 1131 ms. Trace:
I20260709 13:08:02.775048 16545 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:08:02.440483 16610 rpcz_store.cc:269] 0709 13:08:01.039164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.039324 (+   160us) service_pool.cc:224] Handling call
0709 13:08:02.439753 (+1400429us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b54003db654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:02.439927 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6146304}
I20260709 13:08:02.776171 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.484911 20831 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:02.776980 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 618) took 1113 ms. Trace:
I20260709 13:08:02.460464 20575 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.777534 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 644) took 1215 ms. Trace:
I20260709 13:08:02.777931 16610 rpcz_store.cc:276] 0709 13:08:01.562043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.775870 (+1213827us) service_pool.cc:224] Handling call
0709 13:08:02.777480 (+  1610us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.500651 20260 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.498567 20581 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.779803 20575 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:02.493297 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 115795us
I20260709 13:08:02.781788 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:02.783367 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:02.514424 20830 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.785064 20830 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.787415 20830 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:02.533376 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.788909 16618 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.788932 20569 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.789251 16585 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:02.789986 20569 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.790362 20569 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:02.790827 20569 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.544375 16470 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:08:02.792930 16470 pending_rounds.cc:85] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 10
I20260709 13:08:02.793244 16470 pending_rounds.cc:107] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:08:02.793543 16470 raft_consensus.cc:2889] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.793669 20707 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.794967 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2098) took 1941 ms. Trace:
I20260709 13:08:02.545918 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.795315 20707 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:02.796284 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.796999 20707 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.797519 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:02.797855 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.798192 16538 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:08:02.799057 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.799666 16538 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.547009 20603 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.562810 20840 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.561847 20678 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.801227 20840 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.801954 16619 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:02.802443 20260 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.803424 20840 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:02.804004 20840 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:02.804319 20840 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:02.556118 20684 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.797425 20707 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.563423 20834 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:02.805140 20707 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.804495 20603 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.808032 20603 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.575311 20674 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.601051 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 539) took 1355 ms. Trace:
I20260709 13:08:02.809049 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.578739 20837 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.810036 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1886) took 1469 ms. Trace:
I20260709 13:08:02.810650 16610 rpcz_store.cc:276] 0709 13:08:01.340895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.778685 (+1437790us) service_pool.cc:224] Handling call
0709 13:08:02.809943 (+ 31258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.809409 16463 rpcz_store.cc:276] 0709 13:08:01.246266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.448019 (+1201753us) service_pool.cc:224] Handling call
0709 13:08:02.448613 (+   594us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:02.449269 (+   656us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:02.449585 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.542769 (+ 93184us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:02.554295 (+ 11526us) log.cc:844] Serialized 52 byte log entry
0709 13:08:02.554509 (+   214us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:02.554761 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.554939 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.555017 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:02.600704 (+ 45687us) raft_consensus.cc:1685] finished
0709 13:08:02.600723 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:02.600953 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11903,"prepare.queue_time_us":260,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":16376,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":7905,"thread_start_us":80692,"threads_started":1,"wal-append.queue_time_us":81823}
I20260709 13:08:02.811452 20837 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.617187 16461 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:02.811784 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:02.795358 16470 rpcz_store.cc:276] 0709 13:08:00.853706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.120746 (+1267040us) service_pool.cc:224] Handling call
0709 13:08:02.131620 (+ 10874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.794157 (+662537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.794734 (+   577us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003b9a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:02.794908 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":899968256}
I20260709 13:08:02.812371 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 541) took 1564 ms. Trace:
W20260709 13:08:02.609841 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73548.6us
I20260709 13:08:02.812804 16461 rpcz_store.cc:276] 0709 13:08:01.247717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.602259 (+1354542us) service_pool.cc:224] Handling call
0709 13:08:02.616865 (+ 14606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.812095 (+195230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.812312 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.813004 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:02.814061 16470 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.814025 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:02.814874 16461 raft_consensus.cc:3060] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:02.627897 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2092) took 2545 ms. Trace:
I20260709 13:08:02.628201 16468 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:02.634680 20767 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.816804 16462 rpcz_store.cc:276] 0709 13:08:00.082176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.114531 (+2032355us) service_pool.cc:224] Handling call
0709 13:08:02.114920 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.627611 (+512691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.627833 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:02.634176 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.817258 20767 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.817762 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:02.818080 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.818305 16468 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.351361 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 179785us
I20260709 13:08:02.819414 20767 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.634935 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2078) took 2606 ms. Trace:
I20260709 13:08:02.819984 16467 rpcz_store.cc:276] 0709 13:08:00.029018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.281050 (+1252032us) service_pool.cc:224] Handling call
0709 13:08:02.124866 (+843816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.633863 (+508997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.634712 (+   849us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54000b4d50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:02.634852 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939533568}
I20260709 13:08:02.647245 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 538) took 1595 ms. Trace:
W20260709 13:08:02.821199 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.648066 16539 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
W20260709 13:08:02.823050 16436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.555s (SENT) [suppressed 9 similar messages]
I20260709 13:08:02.648066 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.823832 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.824313 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:02.677887 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.641232 16613 rpcz_store.cc:276] 0709 13:08:01.311077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.316951 (+  5874us) service_pool.cc:224] Handling call
0709 13:08:02.640729 (+1323778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.826089 20769 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.826695 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.826802 20769 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.827498 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2240) took 1231 ms. Trace:
I20260709 13:08:02.827852 16613 rpcz_store.cc:276] 0709 13:08:01.595756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.826450 (+1230694us) service_pool.cc:224] Handling call
0709 13:08:02.827435 (+   985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.829372 20769 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:02.829604 20834 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:02.690716 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52105.7us
I20260709 13:08:02.830477 20575 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.831172 20575 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.831993 20834 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.691033 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.833098 16615 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:02.820895 16469 rpcz_store.cc:276] 0709 13:08:01.051469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.398873 (+1347404us) service_pool.cc:224] Handling call
0709 13:08:02.399275 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.646980 (+247705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.647191 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:02.833665 16615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2230) took 1240 ms (client timeout 1625 ms). Trace:
W20260709 13:08:02.834102 16615 rpcz_store.cc:269] 0709 13:08:01.592795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.646389 (+1053594us) service_pool.cc:224] Handling call
0709 13:08:02.833575 (+187186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.834762 16542 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:02.835104 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.835615 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.836017 16615 raft_consensus.cc:2410] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:02.836254 16542 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:02.695128 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 163915us
I20260709 13:08:02.697296 20848 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:02.698334 20844 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.706332 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:02.711546 20839 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.644620 20730 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.717640 16367 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 6 to 13, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.442698 16617 rpcz_store.cc:276] 0709 13:08:01.316412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.317540 (+  1128us) service_pool.cc:224] Handling call
0709 13:08:01.318104 (+   564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.442103 (+1123999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.442289 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.729861 16614 rpcz_store.cc:276] 0709 13:08:01.312816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.317725 (+  4909us) service_pool.cc:224] Handling call
0709 13:08:01.318401 (+   676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.729009 (+1410608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.729291 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.753461 20838 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.754380 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.758152 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.704429 20509 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.762193 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:02.742518 16510 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50264 dropped due to backpressure: service queue is full with 50 items
I20260709 13:08:02.763954 16537 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:02.766688 16544 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:02.770498 16540 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:02.836563 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1897) took 1448 ms. Trace:
I20260709 13:08:02.863356 20603 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.864043 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.774871 17119 rpcz_store.cc:276] 0709 13:08:01.327722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.329177 (+  1455us) service_pool.cc:224] Handling call
0709 13:08:02.458390 (+1129213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.777243 16536 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:02.865006 16544 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.865648 20509 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:02.581517 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.867004 16465 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:02.867349 16465 pending_rounds.cc:85] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 6
I20260709 13:08:02.867610 16465 pending_rounds.cc:107] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:02.867857 16465 raft_consensus.cc:2889] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.868192 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.868006 20839 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.872218 20838 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.637326 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.879052 16612 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
W20260709 13:08:02.879596 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1892) took 1536 ms (client timeout 1854 ms). Trace:
W20260709 13:08:02.879948 16612 rpcz_store.cc:269] 0709 13:08:01.343696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.636996 (+1293300us) service_pool.cc:224] Handling call
0709 13:08:02.879540 (+242544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.880895 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.881552 16612 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:02.882041 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1899) took 1492 ms. Trace:
I20260709 13:08:02.863714 16615 rpcz_store.cc:276] 0709 13:08:01.388388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.834832 (+1446444us) service_pool.cc:224] Handling call
0709 13:08:02.836508 (+  1676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.882786 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.883503 16540 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.811630 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:02.884610 16610 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:02.883381 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.885072 16464 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:02.885200 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2236) took 1290 ms. Trace:
I20260709 13:08:02.885545 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2241) took 1289 ms. Trace:
I20260709 13:08:02.885650 16610 rpcz_store.cc:276] 0709 13:08:01.594519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.811343 (+1216824us) service_pool.cc:224] Handling call
0709 13:08:02.885064 (+ 73721us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.886011 16615 rpcz_store.cc:276] 0709 13:08:01.596089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.883039 (+1286950us) service_pool.cc:224] Handling call
0709 13:08:02.885476 (+  2437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.886799 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.887039 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.887383 16610 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:02.887652 16615 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:08:02.887923 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2232) took 1294 ms. Trace:
I20260709 13:08:02.888175 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1883) took 1548 ms. Trace:
I20260709 13:08:02.864423 16466 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:02.863986 20603 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.868908 16543 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:02.891134 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.891680 16543 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.870039 20678 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:02.804328 16619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1888) took 1462 ms (client timeout 1753 ms). Trace:
W20260709 13:08:02.893674 16619 rpcz_store.cc:269] 0709 13:08:01.341859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.446535 (+1104676us) service_pool.cc:224] Handling call
0709 13:08:02.804141 (+357606us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:02.804262 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814781696}
I20260709 13:08:02.895004 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.895886 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2231) took 1302 ms. Trace:
I20260709 13:08:02.896273 16619 rpcz_store.cc:276] 0709 13:08:01.593065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.894674 (+1301609us) service_pool.cc:224] Handling call
0709 13:08:02.895826 (+  1152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.896971 16612 rpcz_store.cc:276] 0709 13:08:01.389273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.880595 (+1491322us) service_pool.cc:224] Handling call
0709 13:08:02.881988 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.898082 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.899021 16612 raft_consensus.cc:2410] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 14 because replica has last-logged OpId of term: 13 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 4.
I20260709 13:08:02.899451 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1885) took 1559 ms. Trace:
I20260709 13:08:02.899796 16612 rpcz_store.cc:276] 0709 13:08:01.340421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.897761 (+1557340us) service_pool.cc:224] Handling call
0709 13:08:02.899395 (+  1634us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.870182 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.902393 16614 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:02.871032 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.906314 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 642) took 1371 ms. Trace:
I20260709 13:08:02.906637 16617 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:02.907123 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1893) took 1563 ms. Trace:
I20260709 13:08:02.871809 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2243) took 1275 ms. Trace:
I20260709 13:08:02.872617 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.908471 17126 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:02.909440 16616 rpcz_store.cc:276] 0709 13:08:01.596747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.736573 (+1139826us) service_pool.cc:224] Handling call
0709 13:08:02.871753 (+135180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.873003 20730 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.823019 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.828693 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.873740 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:02.914347 16613 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:02.914969 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1900) took 1525 ms. Trace:
I20260709 13:08:02.875577 17127 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:02.915385 16613 rpcz_store.cc:276] 0709 13:08:01.389606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.828482 (+1438876us) service_pool.cc:224] Handling call
0709 13:08:02.914897 (+ 86415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.918165 16539 raft_consensus.cc:2393] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:02.919363 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.920437 16539 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:02.875742 20840 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:02.921720 20840 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:02.876649 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.925251 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.777410 16545 rpcz_store.cc:276] 0709 13:08:01.663513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.680887 (+ 17374us) service_pool.cc:224] Handling call
0709 13:08:01.681430 (+   543us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.775656 (+1094226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.776713 (+  1057us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001f5ed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:02.776925 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514211072}
I20260709 13:08:02.870955 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.926232 17119 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:02.926518 17127 raft_consensus.cc:2410] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:08:02.927320 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.929338 17119 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:02.929268 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:02.928411 16545 raft_consensus.cc:2410] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:02.931236 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:02.932142 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.932996 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.933334 16545 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:08:02.840009 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55363.3us
I20260709 13:08:02.906637 16614 rpcz_store.cc:276] 0709 13:08:01.535539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.869930 (+1334391us) service_pool.cc:224] Handling call
0709 13:08:02.906238 (+ 36308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.935433 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:02.907441 16617 rpcz_store.cc:276] 0709 13:08:01.344199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.870794 (+1526595us) service_pool.cc:224] Handling call
0709 13:08:02.907067 (+ 36273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:02.905491 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 82466.5us
W20260709 13:08:02.925490 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.937631 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.938798 20824 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.939210 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.939512 20824 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.940274 16539 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:02.948271 20689 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.948539 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:02.900916 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.955531 16537 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:02.956359 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:02.956925 16537 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:02.963995 20849 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:08:02.967420 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:02.968210 16541 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:02.870554 16510 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50264 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1916)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1912)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2284)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2291)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2281)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2280)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2278)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1907)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1908)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1911)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1914)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 628)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1917)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1918)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1919)
I20260709 13:08:02.830017 20769 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.970372 20769 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:02.972586 16366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 258) took 36132 ms (client timeout 15000 ms). Trace:
I20260709 13:08:02.972944 20769 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:02.976413 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:02.976725 20575 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:02.973158 16366 rpcz_store.cc:269] 0709 13:07:26.854652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.901897 (+ 47245us) service_pool.cc:224] Handling call
0709 13:08:02.972280 (+36070383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:00.465294 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:00.466131 (+   837us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:00.466176 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:08:00.466205 (+    29us) tablet.cc:662] Decoding operations
0709 13:08:00.521028 (+ 54823us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:00.521111 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:00.521138 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:00.522766 (+  1628us) tablet.cc:701] Row locks acquired
0709 13:08:00.522784 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:00.522935 (+   151us) write_op.cc:270] Start()
0709 13:08:00.523034 (+    99us) write_op.cc:276] Timestamp: P: 1783602480522887 usec, L: 0
0709 13:08:00.523058 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:00.523715 (+   657us) log.cc:844] Serialized 7123 byte log entry
0709 13:08:01.439254 (+915539us) op_driver.cc:464] REPLICATION: finished
0709 13:08:01.588851 (+149597us) write_op.cc:301] APPLY: starting
0709 13:08:01.589692 (+   841us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:01.593339 (+  3647us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:01.593454 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:01.640262 (+ 46808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:01.640700 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=36
0709 13:08:01.640748 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:01.641527 (+   779us) log.cc:844] Serialized 236 byte log entry
0709 13:08:01.647230 (+  5703us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.677456 (+ 30226us) write_op.cc:454] Released schema lock
0709 13:08:01.677537 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:01.693273 (+ 15736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.693318 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1422791,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":148782,"apply.run_cpu_time_us":24855,"apply.run_wall_time_us":104360,"cfile_cache_hit":34,"cfile_cache_hit_bytes":35513,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":1481,"lbm_reads_lt_1ms":12,"num_ops":18,"prepare.queue_time_us":150776,"prepare.run_cpu_time_us":12629,"prepare.run_wall_time_us":73960,"raft.queue_time_us":791502,"raft.run_cpu_time_us":7470,"raft.run_wall_time_us":109508,"replication_time_us":915750,"thread_start_us":750004,"threads_started":4,"wal-append.queue_time_us":41508,"wal-append.run_cpu_time_us":32201,"wal-append.run_wall_time_us":2110960}]]}
I20260709 13:08:02.977406 20313 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:02.977918 20313 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.978374 20313 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:02.979251 17124 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:02.980489 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.981158 17119 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:02.982136 17126 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:02.985469 20603 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.893072 20678 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:02.987855 16434 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:02.988139 20678 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:02.989180 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 110934us
I20260709 13:08:02.989564 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:02.989744 20678 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:02.991225 20730 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.991307 20845 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:02.888535 16615 rpcz_store.cc:276] 0709 13:08:01.339456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.886782 (+1547326us) service_pool.cc:224] Handling call
0709 13:08:02.888129 (+  1347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:02.992532 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.994297 17125 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:02.952160 16367 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:03.012142 16367 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 10, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.014134 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.013851 20707 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.014797 16612 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:03.015933 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.016393 20707 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:03.016836 16612 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.017163 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.728603 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.992178 20824 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:02.996430 16618 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:03.000463 17127 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:02.888304 16610 rpcz_store.cc:276] 0709 13:08:01.593340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.886545 (+1293205us) service_pool.cc:224] Handling call
0709 13:08:02.887876 (+  1331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:02.771071 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:03.005693 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:02.998704 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 64423.3us
I20260709 13:08:03.006145 20839 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:03.007498 16491 debug-util.cc:398] Leaking SignalData structure 0x7b0800256a60 after lost signal to thread 15321
I20260709 13:08:03.004070 20313 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.015976 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:02.988950 20509 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:02.999974 20838 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:03.006105 20569 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.017324 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2238) took 1422 ms. Trace:
I20260709 13:08:03.049463 20260 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.069839 16612 rpcz_store.cc:276] 0709 13:08:01.595099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.015681 (+1420582us) service_pool.cc:224] Handling call
0709 13:08:03.017277 (+  1596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.070261 20260 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.070989 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.071249 20260 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:03.046072 20845 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:03.028887 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.072707 20260 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.073350 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2234) took 1479 ms. Trace:
W20260709 13:08:03.073565 16618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 641) took 1540 ms (client timeout 1553 ms). Trace:
I20260709 13:08:03.073766 16613 rpcz_store.cc:276] 0709 13:08:01.593944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.917787 (+1323843us) service_pool.cc:224] Handling call
0709 13:08:03.028682 (+110895us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:03.073293 (+ 44611us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243113216}
W20260709 13:08:03.074121 16618 rpcz_store.cc:269] 0709 13:08:01.533365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.436445 (+903080us) service_pool.cc:224] Handling call
0709 13:08:03.073369 (+636924us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54003e7454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:03.073485 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32553216}
I20260709 13:08:03.074887 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.075603 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.094609 16618 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.076316 16617 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:03.099301 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.100510 16617 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.076505 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:03.063912 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70181.4us
I20260709 13:08:03.101567 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.102341 20774 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:03.103147 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1896) took 1715 ms. Trace:
I20260709 13:08:03.058450 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:03.077328 16491 debug-util.cc:398] Leaking SignalData structure 0x7b0800256d40 after lost signal to thread 15324
I20260709 13:08:03.078019 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.109143 20509 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:03.109638 16616 raft_consensus.cc:2410] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:08:03.079638 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 91879.8us
I20260709 13:08:03.110585 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:03.111387 20848 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:03.111853 20848 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:03.113039 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.113956 16466 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:03.049878 16511 leader_election.cc:400] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:08:03.017499 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.063689 16461 raft_consensus.cc:2468] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:03.033857 20575 consensus_queue.cc:1059] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:08:03.081056 20569 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:03.027933 20674 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:08:03.071979 16611 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.072716 20845 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.117483 16612 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:03.117679 16611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1894) took 1773 ms (client timeout 1886 ms). Trace:
I20260709 13:08:03.118001 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2235) took 1523 ms. Trace:
W20260709 13:08:03.118129 16611 rpcz_store.cc:269] 0709 13:08:01.344614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.728255 (+1383641us) service_pool.cc:224] Handling call
0709 13:08:03.117622 (+389367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.118753 16612 rpcz_store.cc:276] 0709 13:08:01.594245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.070707 (+1476462us) service_pool.cc:224] Handling call
0709 13:08:03.117938 (+ 47231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.083946 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.039862 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.119606 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1898) took 1730 ms. Trace:
I20260709 13:08:03.120265 16539 raft_consensus.cc:2410] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:03.051128 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.120184 16616 rpcz_store.cc:276] 0709 13:08:01.388837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.077752 (+1688915us) service_pool.cc:224] Handling call
0709 13:08:03.119544 (+ 41792us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:03.086458 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 315503us
I20260709 13:08:03.022473 20689 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.124042 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2239) took 1528 ms. Trace:
I20260709 13:08:03.124218 20689 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.089169 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:03.126942 16610 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:02.976460 16544 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:03.090337 16537 raft_consensus.cc:2410] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:03.092067 16536 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 7.
I20260709 13:08:03.091946 20830 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:03.093299 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:03.027501 16367 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:03.018409 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.071179 16468 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.096108 16543 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:03.096940 16542 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.019045 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.133495 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.103803 20774 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.104839 20782 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:03.106806 20260 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:03.109742 16491 debug-util.cc:398] Leaking SignalData structure 0x7b0800256d20 after lost signal to thread 16402
W20260709 13:08:03.110038 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51720.6us
W20260709 13:08:03.135905 16491 debug-util.cc:398] Leaking SignalData structure 0x7b0800190ca0 after lost signal to thread 16494
W20260709 13:08:03.023025 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59755.1us
W20260709 13:08:03.136307 16491 debug-util.cc:398] Leaking SignalData structure 0x7b080018ef80 after lost signal to thread 16495
I20260709 13:08:03.135996 16542 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:03.137241 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:03.137568 16491 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae6e0 after lost signal to thread 16569
W20260709 13:08:03.137876 16491 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae480 after lost signal to thread 16570
I20260709 13:08:03.137847 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.138949 16542 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:03.139107 16491 debug-util.cc:398] Leaking SignalData structure 0x7b080035fa00 after lost signal to thread 16643
W20260709 13:08:03.139427 16491 debug-util.cc:398] Leaking SignalData structure 0x7b0800115260 after lost signal to thread 16644
W20260709 13:08:03.140445 16491 debug-util.cc:398] Leaking SignalData structure 0x7b08002a4380 after lost signal to thread 17151
W20260709 13:08:03.149165 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.109681 20509 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:03.080164 20824 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.114760 16511 leader_election.cc:403] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:03.174911 20824 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.175222 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 125626us
I20260709 13:08:03.136107 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:03.176165 20603 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:03.176702 20603 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:03.176946 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1890) took 1834 ms. Trace:
I20260709 13:08:03.177786 20603 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.178629 16511 leader_election.cc:400] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:03.178923 16511 leader_election.cc:403] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.934448 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.179718 16545 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:03.179936 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.180513 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.115518 16464 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:02.999426 16538 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:03.112926 20848 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.083101 20313 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:03.085206 20391 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:03.086381 16470 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:03.122483 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.123358 20575 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.123675 20845 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:03.088146 20833 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:03.124563 16615 rpcz_store.cc:276] 0709 13:08:01.595427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.010498 (+1415071us) service_pool.cc:224] Handling call
0709 13:08:03.050982 (+ 40484us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:03.123971 (+ 72989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91458816}
I20260709 13:08:03.108400 16618 rpcz_store.cc:276] 0709 13:08:01.387962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.075199 (+1687237us) service_pool.cc:224] Handling call
0709 13:08:03.103083 (+ 27884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.075680 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2246) took 1224 ms. Trace:
I20260709 13:08:03.103643 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 646) took 1532 ms. Trace:
I20260709 13:08:03.162748 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:03.181083 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45046.1us
I20260709 13:08:03.204533 16617 rpcz_store.cc:276] 0709 13:08:01.583298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.101319 (+1518021us) service_pool.cc:224] Handling call
0709 13:08:03.103585 (+  2266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.205834 16541 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.206426 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:03.206593 16613 rpcz_store.cc:276] 0709 13:08:01.851356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.074632 (+1223276us) service_pool.cc:224] Handling call
0709 13:08:03.075623 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.181516 16466 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:03.163518 20689 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:03.164186 20581 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:03.164418 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 71185.3us
I20260709 13:08:03.211614 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:03.165066 20509 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.165002 16367 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.166206 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1891) took 1823 ms. Trace:
I20260709 13:08:03.212846 16614 rpcz_store.cc:276] 0709 13:08:01.343186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.935426 (+1592240us) service_pool.cc:224] Handling call
0709 13:08:03.018275 (+ 82849us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:03.166138 (+147863us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188770048}
I20260709 13:08:03.121101 20838 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:03.214673 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.166448 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.166798 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.167451 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.168229 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.169003 20830 consensus_queue.cc:1243] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:03.169812 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.218258 16612 raft_consensus.cc:2410] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:03.170388 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.170960 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:03.171442 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60972.5us
I20260709 13:08:03.218758 16617 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.175326 20824 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.223451 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:03.068109 16540 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:03.180598 16536 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:03.177425 16619 rpcz_store.cc:276] 0709 13:08:01.342761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.968186 (+1625425us) service_pool.cc:224] Handling call
0709 13:08:03.018903 (+ 50717us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:03.176879 (+157976us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113425664}
W20260709 13:08:03.209893 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 47484.7us
I20260709 13:08:03.206102 16611 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
W20260709 13:08:03.226646 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48204.7us
I20260709 13:08:03.215947 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:03.216199 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.217422 16616 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:08:03.223304 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56632.3us
I20260709 13:08:03.230930 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:03.232375 16537 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.232726 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.233425 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:03.232928 16618 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:03.236016 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.236704 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1887) took 1895 ms. Trace:
I20260709 13:08:03.237262 16615 rpcz_store.cc:276] 0709 13:08:01.341385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.215831 (+1874446us) service_pool.cc:224] Handling call
0709 13:08:03.236650 (+ 20819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.232021 20730 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:03.238752 16610 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:08:03.181850 20707 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:03.242399 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 643) took 1673 ms. Trace:
I20260709 13:08:03.239087 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.239892 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.239960 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.242959 16618 rpcz_store.cc:276] 0709 13:08:01.561389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.208951 (+1647562us) service_pool.cc:224] Handling call
0709 13:08:03.232754 (+ 23803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.234421 (+  1667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.234626 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.243414 16461 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.234001 17126 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:03.243434 16540 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:03.240195 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.240592 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1884) took 1900 ms. Trace:
I20260709 13:08:03.244843 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2227) took 1652 ms. Trace:
I20260709 13:08:03.245112 16612 rpcz_store.cc:276] 0709 13:08:01.339902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.169538 (+1829636us) service_pool.cc:224] Handling call
0709 13:08:03.240531 (+ 70993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.240695 16615 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:03.182011 20840 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:03.249904 16470 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:03.250080 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.245253 16610 rpcz_store.cc:276] 0709 13:08:01.587055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.219045 (+1631990us) service_pool.cc:224] Handling call
0709 13:08:03.232298 (+ 13253us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:03.239199 (+  6901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.239412 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.250674 16538 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:03.214172 20678 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:03.248176 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 267877us
I20260709 13:08:03.205523 20575 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.248909 16614 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:08:03.248109 16367 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 6 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.255250 16614 pending_rounds.cc:85] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 9
I20260709 13:08:03.255511 16614 pending_rounds.cc:107] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:08:03.249483 16543 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:08:03.251878 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.246454 16539 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.253011 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2229) took 1654 ms. Trace:
I20260709 13:08:03.256829 16615 rpcz_store.cc:276] 0709 13:08:01.592482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.237874 (+1645392us) service_pool.cc:224] Handling call
0709 13:08:03.238124 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.246694 (+  8570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.246864 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.253439 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.254186 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.258174 16536 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.255748 16614 raft_consensus.cc:2889] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.261144 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.266203 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.271387 16470 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:03.227469 20834 raft_consensus.cc:2764] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 13:08:03.273876 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 62374.6us
I20260709 13:08:03.235051 20767 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 10.
I20260709 13:08:03.275331 16613 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:03.278581 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1882) took 1939 ms. Trace:
I20260709 13:08:03.240458 20830 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.277098 16509 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:03.278930 16613 rpcz_store.cc:276] 0709 13:08:01.338858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.214272 (+1875414us) service_pool.cc:224] Handling call
0709 13:08:03.250450 (+ 36178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.278271 (+ 27821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.278492 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.276109 16544 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:03.279362 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.280049 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.283221 16465 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:03.281214 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.238988 20831 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:03.238809 20730 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.284343 16470 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:08:03.242650 20569 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:03.240651 20838 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:03.285216 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.291990 16466 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.285467 16610 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:03.285969 16611 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:03.289100 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.252565 20678 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.289245 16367 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.290169 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.293352 16468 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:03.281785 20603 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:03.242877 20707 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.292829 16463 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:03.249962 20840 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:03.294626 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:03.304973 16542 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.295733 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.291427 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 645) took 1722 ms. Trace:
I20260709 13:08:03.305869 16614 rpcz_store.cc:276] 0709 13:08:01.569114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.213896 (+1644782us) service_pool.cc:224] Handling call
0709 13:08:03.235716 (+ 21820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.284951 (+ 49235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.291368 (+  6417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.305656 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.308192 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:03.308946 20680 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:03.309485 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.310328 16542 raft_consensus.cc:2410] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:03.311066 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.312111 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.301175 16612 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:03.316738 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2233) took 1723 ms. Trace:
I20260709 13:08:03.317538 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2245) took 1482 ms. Trace:
W20260709 13:08:03.312716 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.311931 20680 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:03.247017 20839 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:08:03.316285 16367 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.326267 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.247776 20833 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.280990 20581 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.247043 20845 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:08:03.334707 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.305025 20767 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.294123 20774 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.317214 16612 rpcz_store.cc:276] 0709 13:08:01.593619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.246063 (+1652444us) service_pool.cc:224] Handling call
0709 13:08:03.276062 (+ 29999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.316401 (+ 40339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.316670 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.312704 16545 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:03.318480 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.340883 16544 raft_consensus.cc:2393] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.320338 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.294241 20678 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.339730 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.342662 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.307587 20838 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.320179 16615 rpcz_store.cc:276] 0709 13:08:01.835602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.257647 (+1422045us) service_pool.cc:224] Handling call
0709 13:08:03.281602 (+ 23955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.317217 (+ 35615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.317248 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.317291 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:03.317328 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.317384 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.317488 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83,"raft.queue_time_us":11585,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79}
I20260709 13:08:03.324851 20575 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.293061 20860 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:08:03.300215 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2244) took 1591 ms. Trace:
I20260709 13:08:03.355762 16610 rpcz_store.cc:276] 0709 13:08:01.701540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.251262 (+1549722us) service_pool.cc:224] Handling call
0709 13:08:03.280305 (+ 29043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.293103 (+ 12798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.293271 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.303381 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2242) took 1698 ms. Trace:
I20260709 13:08:03.333387 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.315903 20260 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:03.304112 16537 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:03.324404 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.336660 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.315950 20840 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.335675 20837 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:03.338325 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.308677 20391 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.343488 16540 raft_consensus.cc:2393] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:03.343492 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.302601 20569 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.380937 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2248) took 1461 ms. Trace:
I20260709 13:08:03.381366 16614 rpcz_store.cc:276] 0709 13:08:01.919320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.306709 (+1387389us) service_pool.cc:224] Handling call
0709 13:08:03.313377 (+  6668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.333182 (+ 19805us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:03.354770 (+ 21588us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.380446 (+ 25676us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.380511 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:03.380614 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.380709 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.380873 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20611,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":138,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":17152,"thread_start_us":33581,"threads_started":2,"wal-append.queue_time_us":25261}
I20260709 13:08:03.382861 20569 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:03.285267 20844 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:03.383909 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:03.325448 20674 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:03.384882 20674 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.299247 20730 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.386368 20674 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.388145 20674 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:03.356563 16611 rpcz_store.cc:276] 0709 13:08:01.596424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.246523 (+1650099us) service_pool.cc:224] Handling call
0709 13:08:03.282088 (+ 35565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.292780 (+ 10692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.294322 (+  1542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.357175 16536 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 7: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:03.333949 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:03.390019 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 63954.5us
I20260709 13:08:03.391332 16583 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:03.392241 16583 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:03.357312 15326 debug-util.cc:398] Leaking SignalData structure 0x7b080000fde0 after lost signal to thread 17093
I20260709 13:08:03.358107 16467 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:03.394372 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.358402 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.358242 16367 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:03.395282 16464 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.395624 20730 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.396307 16367 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.397615 20730 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:03.361310 20575 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:03.364372 16468 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:03.364951 20680 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:03.365456 16618 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:03.344056 20767 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.366940 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:03.368448 16612 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.329211 20839 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:03.371665 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:03.333051 20830 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:08:03.337899 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.375185 16538 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:03.378741 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.419845 16544 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:03.369858 20260 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.404191 16585 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.376529 16463 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:03.420672 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.408576 16464 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:03.405922 20861 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:03.411410 16511 connection.cc:256] RPC call timeout handler was delayed by -2.6030510680000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 13:08:03.411762 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 204386us
I20260709 13:08:03.419050 16465 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:03.415758 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:03.372761 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 141915us
W20260709 13:08:03.409233 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53336.8us
W20260709 13:08:03.416494 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.422714 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.418030 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 140866us
I20260709 13:08:03.454471 16462 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:03.435810 16470 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:03.457873 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.458683 16544 raft_consensus.cc:2410] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:08:03.498710 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.498147 16367 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 9, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:03.513363 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 82091.7us
I20260709 13:08:03.514134 16544 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:08:03.415050 20767 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:03.460712 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45027us
I20260709 13:08:03.556660 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1907) took 1070 ms. Trace:
I20260709 13:08:03.414754 20839 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:03.585234 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 193026us
I20260709 13:08:03.426360 20391 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.719511 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:03.683933 20837 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:03.418463 20860 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.629626 20260 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.711707 20678 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.754366 20260 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.755340 20678 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:03.756000 20678 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:03.513247 20313 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:03.756727 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.757673 20313 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:03.758116 20313 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.758605 20837 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.713605 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.714224 16538 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.714608 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:03.714797 20833 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:03.761261 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1908) took 1316 ms. Trace:
I20260709 13:08:03.761751 20833 raft_consensus.cc:2804] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:03.761620 16538 rpcz_store.cc:276] 0709 13:08:02.444527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.527283 (+1082756us) service_pool.cc:224] Handling call
0709 13:08:03.714069 (+186786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.761056 (+ 46987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.761217 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.762429 20833 raft_consensus.cc:697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.762370 20860 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:03.763947 16461 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:03.763649 16538 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:03.714624 16541 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:03.404744 20862 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.209s
I20260709 13:08:03.717131 20824 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.719364 16367 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 6 to 9, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 9 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:03.405931 20707 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.428534 20730 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.165s
W20260709 13:08:03.712610 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.777046 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.777566 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63980.1us
I20260709 13:08:03.457047 20863 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.250s
I20260709 13:08:03.420521 20603 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.373905 20774 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:03.420200 20782 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:03.739570 16544 rpcz_store.cc:276] 0709 13:08:02.444257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.513556 (+1069299us) service_pool.cc:224] Handling call
0709 13:08:03.513912 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.514550 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.514757 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.769625 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:03.773898 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1914) took 1318 ms. Trace:
I20260709 13:08:03.756696 20678 consensus_queue.cc:1243] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:03.806200 16538 rpcz_store.cc:276] 0709 13:08:02.448048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.762713 (+1314665us) service_pool.cc:224] Handling call
0709 13:08:03.763358 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.766221 (+  2863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.766485 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:03.807636 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 350655us
I20260709 13:08:03.807919 16538 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:08:03.779633 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.785111 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.805794 16537 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:03.808784 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2282) took 1343 ms. Trace:
I20260709 13:08:03.814985 16538 rpcz_store.cc:276] 0709 13:08:02.465016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.807215 (+1342199us) service_pool.cc:224] Handling call
0709 13:08:03.807611 (+   396us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:03.808438 (+   827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.808702 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.815474 16467 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:03.808450 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 435821us
I20260709 13:08:03.724355 20840 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.812588 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.819330 16614 raft_consensus.cc:2410] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:03.813279 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.818249 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:03.819614 16367 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.820453 16618 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:08:03.809902 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 93611.3us
I20260709 13:08:03.844476 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2276) took 1350 ms. Trace:
I20260709 13:08:03.847442 16539 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:03.845108 16537 rpcz_store.cc:276] 0709 13:08:02.463425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.805178 (+1341753us) service_pool.cc:224] Handling call
0709 13:08:03.805472 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.814002 (+  8530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.814272 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.855654 16367 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 12, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.763470 20833 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.803872 20603 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.862594 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44417.8us
I20260709 13:08:03.863170 16613 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:03.805985 20830 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:08:03.873097 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.877679 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:03.883286 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.898579 16539 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:03.899488 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2286) took 1367 ms. Trace:
I20260709 13:08:03.876837 16367 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 5 to 6, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 6 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:03.899505 16582 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:03.901072 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 45821.4us
I20260709 13:08:03.891527 16616 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.899920 16539 rpcz_store.cc:276] 0709 13:08:02.531973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.851534 (+1319561us) service_pool.cc:224] Handling call
0709 13:08:03.898146 (+ 46612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.899162 (+  1016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.899417 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.907084 16539 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:03.910735 16542 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:03.911572 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2290) took 1301 ms. Trace:
I20260709 13:08:03.913298 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 649) took 1010 ms. Trace:
I20260709 13:08:03.911962 16542 rpcz_store.cc:276] 0709 13:08:02.610000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.855146 (+1245146us) service_pool.cc:224] Handling call
0709 13:08:03.897849 (+ 42703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.911238 (+ 13389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.911503 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.914227 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.918933 16618 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:03.915107 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:03.921350 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 65566.8us
I20260709 13:08:03.922230 16585 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.861932 20782 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.889791 20603 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.913715 16615 rpcz_store.cc:276] 0709 13:08:02.893993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.368194 (+474201us) service_pool.cc:224] Handling call
0709 13:08:03.378231 (+ 10037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.406568 (+ 28337us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:03.460435 (+ 53867us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.903745 (+443310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.903803 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:03.903845 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.903922 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.904042 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37398,"prepare.queue_time_us":327898,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":37918,"thread_start_us":93723,"threads_started":1}
I20260709 13:08:03.923638 16537 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:03.907784 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 628) took 1216 ms. Trace:
I20260709 13:08:03.929863 16539 rpcz_store.cc:276] 0709 13:08:02.691652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.906321 (+1214669us) service_pool.cc:224] Handling call
0709 13:08:03.906679 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.907498 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.907719 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:03.931751 20873 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:08:03.933183 20680 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.936648 16367 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.950763 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2289) took 1381 ms. Trace:
I20260709 13:08:03.891085 20830 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:03.951236 16537 rpcz_store.cc:276] 0709 13:08:02.552747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.852728 (+1299981us) service_pool.cc:224] Handling call
0709 13:08:03.897770 (+ 45042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.928029 (+ 30259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.928308 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.952065 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:03.952679 16615 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:03.959492 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 232216us
I20260709 13:08:03.913699 20871 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:03.967592 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.987048 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 59719.5us
I20260709 13:08:03.961409 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.917455 20509 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:03.991066 16542 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:03.890436 20685 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:08:03.984939 16539 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:04.000444 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 140504us
W20260709 13:08:03.988986 20873 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:08:04.033131 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44129us
I20260709 13:08:03.849947 20839 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:03.960911 20845 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.041749 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1918) took 1349 ms. Trace:
I20260709 13:08:03.900795 20874 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:08:04.045544 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:03.933755 20680 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:04.043440 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 82156.7us
I20260709 13:08:04.045083 16539 rpcz_store.cc:276] 0709 13:08:02.692646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.954781 (+1262135us) service_pool.cc:224] Handling call
0709 13:08:03.955137 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.041471 (+ 86334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.041688 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:03.990916 20678 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:04.057219 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.059152 16618 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:04.060201 16539 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:08:04.057354 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 142345us
I20260709 13:08:04.002857 20509 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:04.055078 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.057896 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1917) took 1365 ms. Trace:
I20260709 13:08:04.061229 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.062611 16542 rpcz_store.cc:276] 0709 13:08:02.692315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.936261 (+1243946us) service_pool.cc:224] Handling call
0709 13:08:03.990892 (+ 54631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.054043 (+ 63151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.057843 (+  3800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:04.098869 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1919) took 1405 ms. Trace:
I20260709 13:08:04.105368 16537 rpcz_store.cc:276] 0709 13:08:02.693236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.006417 (+1313181us) service_pool.cc:224] Handling call
0709 13:08:04.056805 (+ 50388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.061635 (+  4830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.061665 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.098476 (+ 36811us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:04.098545 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.098631 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.098793 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:04.100642 16539 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:04.003388 20880 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:04.095785 17093 connection.cc:256] RPC call timeout handler was delayed by -1.113365407999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
I20260709 13:08:04.044689 20871 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.122215 16367 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.054924 20872 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.029866 20863 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:08:04.058710 20674 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.122062 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2228) took 2530 ms. Trace:
I20260709 13:08:04.135694 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1911) took 1688 ms. Trace:
I20260709 13:08:04.111580 20833 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.110387 20839 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.159428 16537 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:04.153319 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 98342.3us
I20260709 13:08:04.112866 20391 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.154014 16545 rpcz_store.cc:276] 0709 13:08:02.447272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.770881 (+1323609us) service_pool.cc:224] Handling call
0709 13:08:03.803288 (+ 32407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.821570 (+ 18282us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:04.044299 (+222729us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.135348 (+ 91049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.135399 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:04.135448 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.135512 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.135633 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":159387,"threads_started":2}
I20260709 13:08:04.155362 16619 rpcz_store.cc:276] 0709 13:08:01.592156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.225077 (+1632921us) service_pool.cc:224] Handling call
0709 13:08:03.246475 (+ 21398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.281676 (+ 35201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:03.353363 (+ 71687us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.914719 (+561356us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.094239 (+179520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.094298 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:04.121803 (+ 27505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.121875 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.121995 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14357,"prepare.queue_time_us":105726,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":8154,"raft.queue_time_us":127176,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":53777,"thread_start_us":702402,"threads_started":4,"wal-append.queue_time_us":380733}
I20260709 13:08:04.173100 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:04.173579 16540 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:04.173559 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 61188.8us
W20260709 13:08:04.165284 16583 leader_election.cc:336] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.724s (SENT)
I20260709 13:08:04.175028 16462 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:04.141860 20824 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.125751 20880 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.153554 20891 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:04.153702 20863 consensus_queue.cc:1243] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:04.177662 16461 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:08:04.190582 20901 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.190411 20850 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:04.204897 16367 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.190919 20900 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:04.195966 20886 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 13:08:04.196844 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.197108 20841 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:08:04.198257 20884 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:08:04.198892 20871 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.165223 20833 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.204864 20901 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.184612 20872 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:04.211158 20879 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:08:04.211675 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 650) took 1317 ms. Trace:
W20260709 13:08:04.211978 20890 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:04.212324 20882 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:04.322930 16367 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.213696 20880 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.219102 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2247) took 2300 ms. Trace:
I20260709 13:08:04.223122 20841 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:04.173115 20575 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.225023 16612 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:04.210289 20895 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:04.244690 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 136743us
I20260709 13:08:04.246014 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:04.302368 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.200264 20674 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.324744 16613 rpcz_store.cc:276] 0709 13:08:01.918980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.282445 (+1363465us) service_pool.cc:224] Handling call
0709 13:08:03.321151 (+ 38706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.865946 (+544795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.218839 (+352893us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b540036b854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:04.219020 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228333952}
W20260709 13:08:04.334187 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.220803 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2275) took 1757 ms. Trace:
I20260709 13:08:04.246352 20901 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.246352 20833 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.334590 16544 rpcz_store.cc:276] 0709 13:08:02.463154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.805042 (+1341888us) service_pool.cc:224] Handling call
0709 13:08:03.805589 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.860972 (+ 55383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.861018 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.892198 (+ 31180us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.063230 (+171032us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:04.063282 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.063377 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.220567 (+157190us) raft_consensus.cc:1685] finished
0709 13:08:04.220586 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.220724 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31740,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11109,"spinlock_wait_cycles":222592,"thread_start_us":111675,"threads_started":1,"wal-append.queue_time_us":297184}
I20260709 13:08:04.309792 16610 rpcz_store.cc:276] 0709 13:08:02.894345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.357441 (+463096us) service_pool.cc:224] Handling call
0709 13:08:03.377817 (+ 20376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.406431 (+ 28614us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:03.584500 (+178069us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.211032 (+626532us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b180042b800. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a
0709 13:08:04.211234 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.211296 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:04.211350 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.211449 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.211617 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37814,"prepare.queue_time_us":316583,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":3136,"spinlock_wait_cycles":55771904,"thread_start_us":64137,"threads_started":1,"wal-append.queue_time_us":204037}
I20260709 13:08:04.242528 20840 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:04.309243 20850 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:04.342435 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.153923 20830 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:04.341569 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 151686us
W20260709 13:08:04.342252 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.004s	sys 0.016s
I20260709 13:08:04.245538 20845 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.348060 20845 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.361500 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1907) took 1019 ms. Trace:
I20260709 13:08:04.362115 16467 rpcz_store.cc:276] 0709 13:08:03.341837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.394122 (+ 52285us) service_pool.cc:224] Handling call
0709 13:08:04.361239 (+967117us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003b8654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:04.361420 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900068224}
I20260709 13:08:04.343863 16585 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:04.365381 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:04.366518 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.366938 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.367314 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.367579 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.370675 16468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.010s	sys 0.044s
W20260709 13:08:04.371027 16468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.010s	sys 0.044s
I20260709 13:08:04.346223 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:04.365579 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2285) took 1834 ms. Trace:
I20260709 13:08:04.393253 16544 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.394718 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.390949 20391 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:04.333786 20895 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:04.397169 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:04.381749 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.004s	sys 0.016s
I20260709 13:08:04.398201 16538 rpcz_store.cc:276] 0709 13:08:02.531580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.815948 (+1284368us) service_pool.cc:224] Handling call
0709 13:08:03.851687 (+ 35739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.851884 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.851918 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.851972 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:03.852014 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.852094 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.365419 (+513325us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b54001e2b50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:04.365522 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12305792}
W20260709 13:08:04.404325 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58136.9us
I20260709 13:08:04.398972 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 637) took 1031 ms. Trace:
I20260709 13:08:04.408417 16544 rpcz_store.cc:276] 0709 13:08:03.367227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.338454 (+971227us) service_pool.cc:224] Handling call
0709 13:08:04.338793 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.398726 (+ 59933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.398919 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:04.342780 20850 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:04.223778 20509 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.229317 20891 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.178300 20782 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.399389 20769 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:04.441366 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 380175us
W20260709 13:08:04.446535 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 108551us
I20260709 13:08:04.403534 20848 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:04.456386 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 999020us
W20260709 13:08:04.453150 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.469816 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 104492us
I20260709 13:08:04.418773 20895 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:04.529448 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 60135.7us
I20260709 13:08:04.534014 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2252) took 1712 ms. Trace:
I20260709 13:08:04.496372 16367 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 4 to 11, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:04.559257 16615 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.003s
W20260709 13:08:04.560611 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 119351us
I20260709 13:08:04.471510 20769 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.566039 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.471344 20874 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.572820 16615 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:04.577224 16538 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:04.578218 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:04.599793 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:04.600129 16610 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.587311 16367 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 11, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.587260 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:04.601358 17124 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.601801 16367 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 8, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.534638 16617 rpcz_store.cc:276] 0709 13:08:02.821909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.307817 (+485908us) service_pool.cc:224] Handling call
0709 13:08:03.308133 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:03.323995 (+ 15862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.324025 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:03.374387 (+ 50362us) log.cc:844] Serialized 52 byte log entry
0709 13:08:03.807309 (+432922us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:03.807366 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.807455 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.533724 (+726269us) raft_consensus.cc:1685] finished
0709 13:08:04.533753 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.533938 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15457,"raft.queue_time_us":15599,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":12804,"thread_start_us":351614,"threads_started":1,"wal-append.queue_time_us":504039}
I20260709 13:08:04.471975 20848 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:04.473855 20680 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:04.610033 16613 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:08:04.606218 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 135389us
I20260709 13:08:04.608557 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:04.611284 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:04.543913 20907 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.616185 20907 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.616710 20904 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:04.617257 20904 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.617609 20904 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.474186 20841 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:04.614311 16511 connection.cc:256] RPC call timeout handler was delayed by -2.4005510679999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2296s for a response
W20260709 13:08:04.619436 16511 connection.cc:256] RPC call timeout handler was delayed by -2.3537510679999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2348s for a response
W20260709 13:08:04.619959 16511 connection.cc:256] RPC call timeout handler was delayed by -2.3330510679999179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 13:08:04.620258 16511 connection.cc:256] RPC call timeout handler was delayed by -2.3276510679999092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2377s for a response
I20260709 13:08:04.620873 16538 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:08:04.610363 16367 catalog_manager.cc:5697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.628401 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 636) took 1261 ms. Trace:
I20260709 13:08:04.631183 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:04.628904 16540 rpcz_store.cc:276] 0709 13:08:03.366982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.174617 (+807635us) service_pool.cc:224] Handling call
0709 13:08:04.202562 (+ 27945us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.226507 (+ 23945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.226537 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.321505 (+ 94968us) log.cc:844] Serialized 52 byte log entry
0709 13:08:04.476949 (+155444us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:04.476986 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.477063 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.628177 (+151114us) raft_consensus.cc:1685] finished
0709 13:08:04.628197 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.628341 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6436,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":67048,"thread_start_us":129133,"threads_started":1,"wal-append.queue_time_us":283851}
I20260709 13:08:04.480890 20861 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:08:04.637244 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:04.637390 16511 connection.cc:256] RPC call timeout handler was delayed by -1.8965510680000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2856s for a response
I20260709 13:08:04.630234 16367 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.605849 20874 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.638922 16511 connection.cc:256] RPC call timeout handler was delayed by -1.7066510679999283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30670000000000003s for a response
I20260709 13:08:04.610040 20848 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:04.640101 16511 connection.cc:256] RPC call timeout handler was delayed by -1.5113510679999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3284s for a response
I20260709 13:08:04.638933 16465 raft_consensus.cc:2376] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9. Re-sending same reply.
I20260709 13:08:04.641561 17124 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
W20260709 13:08:04.643563 16511 connection.cc:256] RPC call timeout handler was delayed by -1.4420510679999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33610000000000007s for a response
I20260709 13:08:04.653717 16434 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:04.607018 20900 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.633021 20882 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:04.657322 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45222.7us
I20260709 13:08:04.659425 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.657352 16367 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 3 to 8, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 8 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.628901 20888 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.639474 20831 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.468531 20872 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.629125 20674 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.641357 20874 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.667893 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:04.666209 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 196117us
I20260709 13:08:04.669305 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:04.671285 20911 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:04.683662 20914 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:08:04.676801 20831 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.685973 20907 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:04.610860 20850 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.686964 20831 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:04.688102 20891 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.690603 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.691509 16610 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:04.707840 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.710068 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:04.711958 20767 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.958s	user 0.004s	sys 0.005s
W20260709 13:08:04.714262 20603 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.712s	user 0.000s	sys 0.009s
W20260709 13:08:04.714797 20839 consensus_meta.cc:287] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.002s
I20260709 13:08:04.714753 20603 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.716253 16466 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:04.717041 20313 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.959s	user 0.006s	sys 0.006s
I20260709 13:08:04.717464 20313 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.719710 20313 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:04.722158 20881 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:08:04.671758 20888 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.727207 20888 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:04.708000 20911 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:04.654512 20769 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.712443 20767 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.732115 16540 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:04.752358 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.734398 16543 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:04.770329 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:04.771585 17127 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:04.771992 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 104170us
I20260709 13:08:04.773113 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.672235 20900 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:04.730747 20883 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:04.770390 20838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.004s	sys 0.011s
W20260709 13:08:04.785043 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 77420.3us
I20260709 13:08:04.731350 20918 raft_consensus.cc:2764] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:08:04.786351 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 635) took 1419 ms. Trace:
W20260709 13:08:04.788817 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 111469us
I20260709 13:08:04.792194 20767 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.791743 20900 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.789880 16545 rpcz_store.cc:276] 0709 13:08:03.366769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.170456 (+803687us) service_pool.cc:224] Handling call
0709 13:08:04.187223 (+ 16767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.187468 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:04.577909 (+390441us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.785989 (+208080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.786047 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.786097 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.786165 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.786287 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":244832,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1141,"thread_start_us":560461,"threads_started":2}
I20260709 13:08:04.701668 20837 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:08:04.769003 20839 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:04.796306 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 127086us
W20260709 13:08:04.786422 20838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.004s	sys 0.012s
I20260709 13:08:04.778586 20882 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.736943 20906 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.784734 20844 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.805511 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.807283 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 634) took 1440 ms. Trace:
I20260709 13:08:04.809013 16537 rpcz_store.cc:276] 0709 13:08:03.366543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.164540 (+797997us) service_pool.cc:224] Handling call
0709 13:08:04.164821 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.164994 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:04.343611 (+178617us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.806853 (+463242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.806921 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:04.806982 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.807054 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.807200 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225787,"prepare.run_cpu_time_us":484,"prepare.run_wall_time_us":3077,"raft.queue_time_us":2917,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":619058,"threads_started":2}
I20260709 13:08:04.728739 20833 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.733081 20887 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:08:04.811740 20920 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:04.814996 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2249) took 2461 ms. Trace:
I20260709 13:08:04.821085 16616 rpcz_store.cc:276] 0709 13:08:02.353612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.306898 (+953286us) service_pool.cc:224] Handling call
0709 13:08:03.307189 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.913812 (+606623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.814748 (+900936us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400234bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:04.814941 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343252352}
I20260709 13:08:04.814946 20917 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.827416 20917 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:04.827848 20917 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.828826 20910 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:04.829501 20912 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:08:04.829634 20839 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.830178 20839 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.816147 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.831167 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2264) took 2382 ms. Trace:
W20260709 13:08:04.817564 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 186257us
I20260709 13:08:04.818701 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.826709 20707 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.831528 16541 rpcz_store.cc:276] 0709 13:08:02.449232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.766834 (+1317602us) service_pool.cc:224] Handling call
0709 13:08:03.767248 (+   414us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:03.780129 (+ 12881us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:03.780170 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:03.814556 (+ 34386us) log.cc:844] Serialized 52 byte log entry
0709 13:08:04.301304 (+486748us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:04.301346 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.301415 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.830961 (+529546us) raft_consensus.cc:1685] finished
0709 13:08:04.830981 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.831115 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7708,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":20182,"thread_start_us":399010,"threads_started":1,"wal-append.queue_time_us":885396}
I20260709 13:08:04.730453 20911 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.808266 20844 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:04.809368 20906 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.804678 20882 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:04.871505 20838 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:04.835999 20918 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:04.872470 20913 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:04.894698 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84439.4us
W20260709 13:08:04.896087 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 90666.4us
W20260709 13:08:04.900111 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 89508.7us
I20260709 13:08:04.830514 20901 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.900998 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.904497 16612 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:08:04.877075 20831 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:04.907127 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.909822 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.875691 20920 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:04.914881 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:04.918082 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.919737 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.920075 20845 raft_consensus.cc:2764] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:04.920466 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.886502 20906 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.899542 20913 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.919984 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:04.895412 20882 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.933476 20915 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.918232 20313 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:04.946772 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.947105 16611 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.947831 20730 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.920562 20919 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.948295 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.948825 20919 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.949651 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.950902 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.951470 20919 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:04.931870 20916 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:04.951925 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.952126 20916 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:04.953020 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.953397 20916 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:04.954187 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.954850 20916 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.955366 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:04.906967 20918 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:04.956911 20930 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:08:04.957729 20918 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.959007 20833 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:04.959235 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.959647 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:04.960435 16617 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:04.961374 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:04.962136 16615 raft_consensus.cc:2410] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:04.962996 20895 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.963685 20603 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:04.965165 20927 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:08:04.966743 20929 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:04.967360 16467 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.969921 20880 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:04.970358 20880 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:04.970718 20880 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.958912 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:04.975179 20937 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.945783 20839 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:04.939540 20913 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:04.975720 16610 raft_consensus.cc:2376] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 10. Re-sending same reply.
I20260709 13:08:04.979750 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:04.981165 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 60840.7us
I20260709 13:08:04.982278 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:04.983541 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:04.984203 20831 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:04.985841 20904 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:04.986943 20919 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:04.988201 20904 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:04.988379 20774 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.874130 20837 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:04.975260 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:04.999508 16465 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:04.996891 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:04.997323 20891 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:04.997640 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:05.001147 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49283.5us
I20260709 13:08:05.001504 16610 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:04.997869 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:05.002279 16462 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.003301 17127 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:05.000650 20603 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.004823 20909 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.004931 20313 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.005664 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:05.005591 20920 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.019629 20707 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:05.020130 16615 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:05.021432 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:04.984241 20901 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:04.998318 20767 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.028352 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:05.011662 20831 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.034863 20707 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.035445 20707 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:05.036115 20877 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.927s	user 0.000s	sys 0.013s
I20260709 13:08:05.037464 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2124) took 1669 ms. Trace:
I20260709 13:08:05.037786 20707 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:05.037799 16468 rpcz_store.cc:276] 0709 13:08:03.368356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.412352 (+ 43996us) service_pool.cc:224] Handling call
0709 13:08:03.412724 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.413066 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.413094 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.413523 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.371404 (+957881us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:04.371453 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.371531 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.035513 (+663982us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:05.037177 (+  1664us) raft_consensus.cc:1685] finished
0709 13:08:05.037199 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.037404 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3339,"raft.queue_time_us":3244,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9004,"spinlock_wait_cycles":28915072,"thread_start_us":957494,"threads_started":1,"wal-append.queue_time_us":548072}
I20260709 13:08:05.002386 20848 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.043202 17124 raft_consensus.cc:2393] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:05.043015 20910 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:05.043824 20910 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.044687 16610 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:05.046545 20838 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.048066 20838 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.050820 20925 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:05.051330 20925 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:05.030527 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:05.024641 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:05.037933 17121 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:05.054159 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:05.056663 16463 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:05.057695 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:05.059827 20774 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:05.060240 20774 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.067795 16465 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:05.069242 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:05.068873 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:05.088804 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:05.091269 16462 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:05.094234 16539 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:05.095767 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:05.060668 20774 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:05.107461 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:05.100880 16539 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.102492 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:05.102702 20575 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.019999 20888 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:08:05.113487 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.125085 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.133384 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:05.133567 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:05.145184 16615 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:05.083359 20707 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:05.145591 16540 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:05.139777 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:05.141340 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:05.149200 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:05.150022 16537 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.008109 20874 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.092567 20876 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.151957 16610 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:08:05.163014 16610 pending_rounds.cc:85] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 4
I20260709 13:08:05.163405 16610 pending_rounds.cc:107] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:08:05.163756 16610 raft_consensus.cc:2889] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:05.152932 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:05.105949 20871 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:05.154430 20831 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.052603 20925 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.158425 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:05.160236 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:05.165613 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.074102 20839 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:08:05.172883 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.109018 20895 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:05.182543 17123 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:05.174177 16542 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:05.021325 20844 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.135447 20685 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:08:05.342964 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.166501 20876 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:05.349325 20831 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.350096 20831 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.337350 20925 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:05.173913 20707 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:05.339097 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:05.365461 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 189906us
W20260709 13:08:05.352986 20932 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:08:05.408442 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.376931 20895 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.409183 20685 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:05.409530 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:05.358500 20876 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.410400 17120 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:05.408555 16511 leader_election.cc:400] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:05.409201 17126 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:05.411339 20874 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:05.181051 20871 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:05.409686 20685 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:05.412815 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.151014 20575 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:05.417176 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78192.1us
I20260709 13:08:05.418386 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:05.422917 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:05.427057 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 380870us
I20260709 13:08:05.428637 16544 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:05.428401 16539 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:08:05.415207 20900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.027s	sys 0.040s
I20260709 13:08:05.413807 20844 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.472110 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.413089 20685 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.478837 16537 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:05.352743 20831 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:05.427466 20937 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.480684 20892 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:08:05.436542 20904 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:05.386518 20707 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.470310 20888 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:08:05.530385 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 445763us
I20260709 13:08:05.491683 20876 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.494119 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:05.496717 20878 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 1.387s	user 0.006s	sys 0.013s
W20260709 13:08:05.498106 20899 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.875s	user 0.004s	sys 0.006s
I20260709 13:08:05.499346 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 652) took 1022 ms. Trace:
W20260709 13:08:05.469064 20900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.031s	sys 0.041s
I20260709 13:08:05.435732 20906 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.509552 20575 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:05.509088 20910 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.438637 20895 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:05.509912 20769 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.500869 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 629) took 2388 ms. Trace:
W20260709 13:08:05.533684 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.491823 20916 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.001s
I20260709 13:08:05.614943 16543 rpcz_store.cc:276] 0709 13:08:03.112023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.323316 (+211293us) service_pool.cc:224] Handling call
0709 13:08:05.500594 (+2177278us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000ab9d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:05.500757 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3217150208}
I20260709 13:08:05.583848 16611 rpcz_store.cc:276] 0709 13:08:04.477062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.533004 (+ 55942us) service_pool.cc:224] Handling call
0709 13:08:04.577903 (+ 44899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.947582 (+369679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.499041 (+551459us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000d70d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:05.499273 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":848620416}
W20260709 13:08:05.580436 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 96591.9us
W20260709 13:08:05.525709 20782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.022s	sys 0.086s
W20260709 13:08:05.577819 20845 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.021s	sys 0.047s
W20260709 13:08:05.526654 20917 consensus_meta.cc:287] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
I20260709 13:08:05.597180 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:05.636353 16614 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.600857 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2263) took 3151 ms. Trace:
W20260709 13:08:05.601603 20880 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:08:05.412817 20871 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.610868 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:05.647626 16615 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:05.579843 20913 consensus_meta.cc:287] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 13:08:05.577865 20685 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:05.629737 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.621430 20895 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.637107 16536 rpcz_store.cc:276] 0709 13:08:02.448936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.766747 (+1317811us) service_pool.cc:224] Handling call
0709 13:08:03.779235 (+ 12488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.801992 (+ 22757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.802025 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.806753 (+  4728us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.058134 (+251381us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:04.058172 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.058232 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.497433 (+1439201us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:05.600516 (+103083us) raft_consensus.cc:1685] finished
0709 13:08:05.600536 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.600792 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9919,"raft.queue_time_us":24731,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":13507,"spinlock_wait_cycles":10522496,"thread_start_us":167373,"threads_started":1,"wal-append.queue_time_us":624093}
W20260709 13:08:05.630738 20782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.023s	sys 0.087s
I20260709 13:08:05.635070 16617 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:08:05.635766 20845 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.021s	sys 0.048s
I20260709 13:08:05.656435 16434 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:05.632076 20911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.033s	sys 0.116s
I20260709 13:08:05.634335 20892 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.687224 16615 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
W20260709 13:08:05.688335 16464 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.011s
W20260709 13:08:05.688751 16464 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.000s	sys 0.011s
I20260709 13:08:05.690179 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:05.672575 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:05.691609 16611 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:05.693436 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.664031 20911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.033s	sys 0.116s
W20260709 13:08:05.741678 16583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.005s
W20260709 13:08:05.744979 16583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.005s
W20260709 13:08:05.747761 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 574936us
I20260709 13:08:05.747880 16610 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:05.765470 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.733682 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:05.650288 20917 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.661630 20895 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:05.689424 20860 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.004s
I20260709 13:08:05.653000 20880 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.743702 20782 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.783551 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.744001 20902 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.810405 20902 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.745656 20910 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:05.780114 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 310792us
W20260709 13:08:05.801208 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 388472us
I20260709 13:08:05.801997 20839 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.802395 20848 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:05.812752 20957 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:05.813468 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:05.814612 20839 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.658470 20913 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:05.815156 20839 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.805480 16612 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:05.817551 20839 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:05.807217 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58162 (request call id 0) took 1175 ms. Trace:
I20260709 13:08:05.753822 20925 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:05.818475 16618 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:08:05.819592 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:05.858160 16613 rpcz_store.cc:276] 0709 13:08:04.653368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.658286 (+  4918us) service_pool.cc:224] Handling call
0709 13:08:05.804606 (+1146320us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540025d854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37503735 00007ffa374fb9fa 00007ffa3c4c34c9 00007ffa35a3fc54 00007ffa35a3fbe2 00007ffa35a3fb11 00007ffa35a3fa8c 00007ffa35a3ed42 00007ffa3583848c 00007ffa358378c6
0709 13:08:05.807114 (+  2508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385428864}
I20260709 13:08:05.814832 20957 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.820343 20674 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.870368 20674 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:05.872901 20893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.008s	sys 0.004s
I20260709 13:08:05.874951 20925 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.820472 20920 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:05.798614 20882 consensus_meta.cc:287] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.852s	user 0.007s	sys 0.004s
W20260709 13:08:05.802439 20774 consensus_meta.cc:287] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
W20260709 13:08:05.830884 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 47425.3us
W20260709 13:08:05.807111 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.806396 20919 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:05.780874 20860 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.004s
I20260709 13:08:05.750344 20892 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:05.865260 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.917687 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 261306us
W20260709 13:08:05.917833 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.804927 20782 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:05.905403 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:05.904053 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 879412us
W20260709 13:08:05.913213 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.915560 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 722) took 1548 ms. Trace:
I20260709 13:08:05.850476 20891 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:05.961784 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 56562.3us
I20260709 13:08:05.926465 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:05.964071 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:05.967170 16583 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.872701 20674 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:05.968282 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:05.880491 20957 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:05.964462 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.975600 16614 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:05.969487 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:05.921886 16463 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:08:05.985407 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 62217.4us
I20260709 13:08:05.989651 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:05.844064 20949 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.343s
W20260709 13:08:05.976308 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49955.8us
I20260709 13:08:06.033982 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:06.037959 16543 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.906188 20839 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:06.039877 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:06.041524 16462 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:05.957494 20915 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:05.960453 17125 rpcz_store.cc:276] 0709 13:08:04.335791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.335911 (+   120us) service_pool.cc:224] Handling call
0709 13:08:04.392919 (+ 57008us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.396565 (+  3646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.396598 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.432159 (+ 35561us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.414702 (+982543us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b1800001840. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:05.656887 (+242185us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:05.742923 (+ 86036us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.863739 (+120816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.863850 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.863912 (+    62us) raft_consensus.cc:1685] finished
0709 13:08:05.883829 (+ 19917us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.884189 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4553,"prepare.queue_time_us":75786,"prepare.run_wall_time_us":8232,"raft.queue_time_us":8022,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":60626,"spinlock_wait_cycles":20993536,"thread_start_us":358758,"threads_started":2,"wal-append.queue_time_us":1353424}
W20260709 13:08:05.979290 20932 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:08:05.958004 20848 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:05.966280 20906 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:05.976802 20313 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:06.034727 20950 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:06.051530 20946 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:08:05.989634 20901 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.916216 20774 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.043149 20920 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:06.042927 20919 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.047417 20839 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.912271 20882 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.047469 20674 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.077936 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2138) took 1016 ms. Trace:
I20260709 13:08:06.047600 20915 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:06.085263 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 271847us
I20260709 13:08:06.072921 20967 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.083472 16543 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:06.089509 16464 rpcz_store.cc:276] 0709 13:08:05.061724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.061917 (+   193us) service_pool.cc:224] Handling call
0709 13:08:05.100057 (+ 38140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.100301 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:05.689172 (+588871us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.077601 (+388429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.077652 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:06.077711 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.077773 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.077884 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282605,"prepare.queue_time_us":246664,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":279163,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":56960,"thread_start_us":669864,"threads_started":2}
W20260709 13:08:06.093384 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 472667us
I20260709 13:08:06.075011 20925 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.096448 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:06.077138 20313 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:06.084115 20909 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:06.088902 20839 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:06.086730 20952 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.066473 20848 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.108141 16461 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.110478 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.119674 16463 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:06.120927 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.092495 20915 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:06.121687 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:06.083563 20901 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:06.117338 20941 log.cc:927] Time spent T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:08:06.136884 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:06.137260 16436 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.555s (SENT)
I20260709 13:08:06.127235 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:06.126334 16463 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:06.135618 16464 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:06.112605 20880 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:06.124469 20925 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.122740 20969 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.158699 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:08:06.157728 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 160660us
I20260709 13:08:06.159492 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:06.159689 16464 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:06.143954 16463 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:06.167493 17124 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:06.160991 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:06.178920 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 209488us
I20260709 13:08:06.113400 20891 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.100998 20967 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.121361 20952 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.191824 16611 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:06.214932 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.160487 20970 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.179939 20925 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:06.090557 20957 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:06.222892 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.223925 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.224505 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:06.219664 20876 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.640s	user 0.011s	sys 0.000s
W20260709 13:08:06.238772 16466 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50946 (request call id 545) took 2513 ms (client timeout 2222 ms). Trace:
W20260709 13:08:06.248206 16466 rpcz_store.cc:269] 0709 13:08:03.714253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.714372 (+   119us) service_pool.cc:224] Handling call
0709 13:08:06.227667 (+2513295us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54002a94d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:06.227815 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2195742464}
I20260709 13:08:06.208444 20874 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.242856 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:06.244179 20962 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:08:06.245160 20944 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:08:06.160276 20313 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.253520 16539 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:06.226930 20782 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:06.270177 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 109243us
W20260709 13:08:06.294653 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 326380us
I20260709 13:08:06.303150 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.308384 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:06.309140 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.315508 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:06.317880 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:06.319559 20949 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:06.320007 20901 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.320484 20949 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:06.321524 20949 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:06.325328 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 82600.3us
W20260709 13:08:06.320616 20956 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:08:06.328563 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:06.330063 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:06.332630 17126 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:06.334959 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 120730us
I20260709 13:08:06.294678 20774 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:06.334352 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:06.338831 17123 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:06.353621 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.340443 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:06.318081 20947 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:08:06.312472 20970 raft_consensus.cc:2764] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:08:06.355752 17121 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:06.363711 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.364780 16611 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:06.314261 20838 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.360373 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:06.325572 20882 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.373811 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:06.355851 20907 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:06.311612 20910 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:06.313748 20782 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:08:06.355702 20848 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.356650 20901 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.438683 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.317757 20874 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:06.502468 20996 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:06.441551 20954 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:08:06.442646 20971 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:08:06.372277 20838 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.598771 20838 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.503407 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2269) took 1398 ms. Trace:
W20260709 13:08:06.465821 20958 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:08:06.502592 20973 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.602638 16619 rpcz_store.cc:276] 0709 13:08:05.104585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.104885 (+   300us) service_pool.cc:224] Handling call
0709 13:08:05.142449 (+ 37564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.142880 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.142922 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.181555 (+ 38633us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.795375 (+613820us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:05.795416 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.795484 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.503121 (+707637us) raft_consensus.cc:1685] finished
0709 13:08:06.503150 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.503339 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7775,"raft.queue_time_us":8685,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":429392,"threads_started":1,"wal-append.queue_time_us":515518}
I20260709 13:08:06.503818 20968 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.504145 20990 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.538137 20882 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.538635 20997 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:06.482951 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.504988 20986 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:08:06.505787 20987 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:08:06.496403 20963 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:08:06.562875 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.570758 20974 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
I20260709 13:08:06.398658 20977 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.386s
I20260709 13:08:06.467255 20969 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.574219 20824 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:06.538210 20976 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 13:08:06.484751 20907 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:06.533319 20901 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.529194 20848 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:06.577317 20998 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.179s
W20260709 13:08:06.581307 20972 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.400s	user 0.001s	sys 0.001s
W20260709 13:08:06.588347 20895 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.784s	user 0.007s	sys 0.002s
W20260709 13:08:06.589702 21000 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:06.590374 20982 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:06.774250 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 649) took 1114 ms. Trace:
I20260709 13:08:06.774729 16537 rpcz_store.cc:276] 0709 13:08:05.659434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.659749 (+   315us) service_pool.cc:224] Handling call
0709 13:08:05.693903 (+ 34154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.851802 (+157899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.851838 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.867340 (+ 15502us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.217197 (+349857us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:06.217306 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.217401 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.774026 (+556625us) raft_consensus.cc:1685] finished
0709 13:08:06.774051 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.774197 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120096,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":406306,"threads_started":2,"wal-append.queue_time_us":768072}
I20260709 13:08:06.597304 20996 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:06.359052 20925 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.662334 20969 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.501494 21002 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.308s
I20260709 13:08:06.665566 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 648) took 1008 ms. Trace:
W20260709 13:08:06.666167 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 312614us
I20260709 13:08:06.606057 20882 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:06.642733 20685 consensus_meta.cc:287] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.004s
W20260709 13:08:06.732846 16434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.016s
W20260709 13:08:06.784783 16434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.001s	sys 0.016s
I20260709 13:08:06.728412 20990 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.596386 20915 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.769327 20907 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.772166 20901 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:06.772903 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1944) took 1643 ms. Trace:
I20260709 13:08:06.669440 20824 consensus_queue.cc:1243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:08:06.779354 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.779438 16541 rpcz_store.cc:276] 0709 13:08:05.657619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.657897 (+   278us) service_pool.cc:224] Handling call
0709 13:08:05.692151 (+ 34254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.969183 (+277032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.969215 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.989454 (+ 20239us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.181442 (+191988us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:06.181506 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.181627 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.665396 (+483769us) raft_consensus.cc:1685] finished
0709 13:08:06.665412 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.665513 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74179,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":328904,"threads_started":2,"wal-append.queue_time_us":195689}
W20260709 13:08:06.756415 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 453292us
W20260709 13:08:06.785356 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 411615us
W20260709 13:08:06.785095 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 595397us
I20260709 13:08:06.605255 20968 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.731082 20892 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:06.790797 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.794482 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.797195 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.799635 16538 rpcz_store.cc:276] 0709 13:08:05.129972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.140416 (+ 10444us) service_pool.cc:224] Handling call
0709 13:08:05.140806 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.172094 (+ 31288us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:05.611984 (+439890us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b18000beae0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa3aef53c7 00007ffa375079a7 00007ffa375170bf 00007ffa37517038
0709 13:08:05.808915 (+196931us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.109582 (+300667us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.121641 (+ 12059us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.121894 (+   253us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:06.122226 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.122665 (+   439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.122763 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.772670 (+649907us) raft_consensus.cc:1685] finished
0709 13:08:06.772692 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.772844 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155704,"prepare.queue_time_us":893193,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":70,"raft.queue_time_us":28154,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":28547,"spinlock_wait_cycles":17311744,"thread_start_us":453256,"threads_started":2,"wal-append.queue_time_us":363248}
I20260709 13:08:06.778326 20861 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.811532 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2271) took 1638 ms. Trace:
I20260709 13:08:06.811764 20968 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.811949 16615 rpcz_store.cc:276] 0709 13:08:05.173050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.802386 (+629336us) service_pool.cc:224] Handling call
0709 13:08:05.802696 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.802890 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.802915 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:05.803388 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.087510 (+284122us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:06.087553 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.087616 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.811331 (+723715us) raft_consensus.cc:1685] finished
0709 13:08:06.811350 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.811478 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":283779,"threads_started":1,"wal-append.queue_time_us":327233}
I20260709 13:08:06.785549 20982 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:06.816267 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:06.820839 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.781472 20895 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.803589 20882 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:06.806633 20952 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:06.837702 20915 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:06.843731 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2270) took 1695 ms. Trace:
I20260709 13:08:06.844198 16618 rpcz_store.cc:276] 0709 13:08:05.148406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.341634 (+193228us) service_pool.cc:224] Handling call
0709 13:08:05.414270 (+ 72636us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:05.861579 (+447309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.843485 (+981906us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54000d4dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:06.843673 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926945152}
I20260709 13:08:06.846990 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2267) took 1770 ms. Trace:
I20260709 13:08:06.847546 16613 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:06.847376 16612 rpcz_store.cc:276] 0709 13:08:05.076817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.092941 (+ 16124us) service_pool.cc:224] Handling call
0709 13:08:05.093229 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.817077 (+723848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.846781 (+1029704us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540025ce54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:06.846934 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637441280}
W20260709 13:08:06.857633 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 487509us
I20260709 13:08:06.792411 20990 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:06.861918 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.863811 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:06.859695 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 43511.1us
I20260709 13:08:06.864755 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:06.865198 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:06.867497 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.870359 16615 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:06.873664 16611 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:06.878810 16583 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:06.890679 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 93610.7us
I20260709 13:08:06.829471 20999 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:06.825944 21005 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:08:06.901684 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 85321.4us
I20260709 13:08:06.906277 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.906870 16612 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:06.909545 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.891315 20911 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:06.911782 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47108.6us
I20260709 13:08:06.891165 20952 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:06.902398 20839 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.772s	user 0.004s	sys 0.009s
I20260709 13:08:06.897158 20782 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.893935 21004 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.845220 20996 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.901147 20977 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:06.817834 20861 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:06.920482 16536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.015s	sys 0.042s
I20260709 13:08:06.918514 21009 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:06.918730 20850 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:06.904601 20949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.000s	sys 0.006s
I20260709 13:08:06.917523 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:06.921123 16536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.016s	sys 0.042s
I20260709 13:08:06.927340 17124 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:06.931876 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.897397 20900 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:06.921450 20977 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.933641 20911 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:06.915993 20782 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.911975 21016 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.939517 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.934353 20893 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:06.956039 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46587us
W20260709 13:08:06.926331 20949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.007s
I20260709 13:08:06.925916 20990 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:06.959492 16611 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.960635 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:06.962299 21019 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.964411 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.945585 20977 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.939512 20892 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:06.953058 21003 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:08:06.919672 20839 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.965734 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.968654 20891 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.941649 20313 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:06.987221 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:06.955248 20685 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:07.003578 20969 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:06.964195 20997 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:07.004454 20997 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:07.004845 20997 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.005692 20997 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.006996 20997 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.007467 20838 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:06.919195 20882 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.987679 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:07.012343 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46091.2us
I20260709 13:08:07.013477 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.014995 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:06.988734 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.986366 20897 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:08:06.990300 21018 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.054s	user 0.002s	sys 0.001s
I20260709 13:08:06.957870 20782 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.920046 20982 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:06.967594 20861 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:06.997498 16615 raft_consensus.cc:2410] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:06.999565 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:06.959414 20893 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.020885 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.032325 16466 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:08:06.990765 20901 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:07.037223 16615 pending_rounds.cc:85] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 10
I20260709 13:08:07.025348 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.037587 16615 pending_rounds.cc:107] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:08:07.031018 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.037945 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.038338 16615 raft_consensus.cc:2889] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.038543 21019 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.991057 20824 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:06.959204 21004 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:08:07.021212 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 77281.4us
I20260709 13:08:07.039819 20901 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.042310 16465 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:07.042910 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.043072 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.023573 20990 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.043558 16466 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:07.023780 20895 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:07.047765 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 48310.3us
I20260709 13:08:07.050005 20893 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.052137 20893 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.052400 20901 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.053648 20838 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.054289 16611 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:07.056581 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.036947 20685 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.045456 20887 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.044675 20915 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.062963 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.049001 21004 consensus_queue.cc:1243] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:07.050647 21014 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.065714 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.073171 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.064616 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.045233 20897 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:07.067232 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.067700 16537 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:07.074401 16541 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:07.074764 16540 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:07.068239 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.071803 20913 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.075305 16545 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:07.073727 16539 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 8.
I20260709 13:08:07.078100 16539 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:07.085325 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.061694 20887 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:07.090523 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.102350 16540 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.090981 16545 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:07.062981 20685 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.091035 20913 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.091539 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.073395 20901 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:07.093169 16543 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:07.098686 20977 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.104161 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.059116 20900 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:07.076033 20973 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.092842 20888 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.047061 20911 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.118767 20913 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.067451 21026 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:07.116822 21025 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.064718 20838 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:07.079319 21019 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 13:08:07.175616 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.191982 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.163116 21016 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.208931 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 162938us
W20260709 13:08:07.209524 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.218532 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 155653us
I20260709 13:08:07.206537 16540 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:07.227459 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.229461 20917 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:07.231215 21028 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:08:07.207540 21025 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.229627 21017 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.122s	user 0.000s	sys 0.005s
I20260709 13:08:07.232524 20892 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.226087 20685 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:07.241734 16511 connection.cc:256] RPC call timeout handler was delayed by -2.3271620600000915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:08:07.242355 16511 connection.cc:256] RPC call timeout handler was delayed by -2.2542620600000873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1814s for a response
W20260709 13:08:07.242784 16511 connection.cc:256] RPC call timeout handler was delayed by -2.2038620600001195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:08:07.243232 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1867620600000919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
W20260709 13:08:07.243645 16511 connection.cc:256] RPC call timeout handler was delayed by -2.1687620600000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:08:07.244059 16511 connection.cc:256] RPC call timeout handler was delayed by -2.0859620600001563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 13:08:07.244479 16511 connection.cc:256] RPC call timeout handler was delayed by -2.0238620600000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:08:07.247614 20509 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.235985 21025 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.206275 20888 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.241074 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.250887 17125 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:07.246687 16511 connection.cc:256] RPC call timeout handler was delayed by -1.565762060000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260709 13:08:07.251739 16511 connection.cc:256] RPC call timeout handler was delayed by -1.5216620600001534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26280000000000003s for a response
W20260709 13:08:07.252277 16511 connection.cc:256] RPC call timeout handler was delayed by -1.0248620600001459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31800000000000006s for a response
I20260709 13:08:07.252753 20603 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.253165 20685 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.253439 16511 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.253937 20685 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:07.254187 20603 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:07.254444 21021 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.255254 20901 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:07.257547 21037 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:07.257982 21037 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:07.257550 20997 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:08:07.259080 21037 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.260473 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.260514 21037 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.262113 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.262791 16540 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:07.264055 16540 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:07.264274 21021 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:07.265075 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.265167 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.265718 16539 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.265865 16545 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.267386 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.270205 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.236680 20996 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.237286 20839 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.273949 16544 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:07.274534 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.220829 16543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:07.278090 16465 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:08:07.278649 16543 raft_consensus.cc:606] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:07.279032 16543 raft_consensus.cc:614] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.241114 20913 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.285439 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.290282 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 653) took 2331 ms. Trace:
I20260709 13:08:07.292387 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.233042 21016 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.290688 16616 rpcz_store.cc:276] 0709 13:08:04.957205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.958291 (+  1086us) service_pool.cc:224] Handling call
0709 13:08:04.958546 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.087144 (+1128598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.087174 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.087218 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:06.087255 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.288594 (+1201339us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540025e254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:07.288624 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.288706 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79299,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":14539,"spinlock_wait_cycles":2116437248,"thread_start_us":206755,"threads_started":1}
I20260709 13:08:07.282548 20990 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.299448 20977 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.302059 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.304688 16543 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:07.305485 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:07.308519 16537 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:07.309126 16465 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.309474 16465 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.343408 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.344569 16539 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:07.345963 16540 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:07.349251 16544 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:08:07.305018 20973 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.363370 16544 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: [9.10-12.12]
I20260709 13:08:07.321573 16465 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.364998 16465 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:07.375065 21033 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:07.398000 20909 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:07.398536 20909 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.402329 16545 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:07.415642 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.394932 21025 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.425284 16465 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:08:07.433988 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 166673us
W20260709 13:08:07.438495 20994 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.070s	user 0.013s	sys 0.011s
I20260709 13:08:07.440335 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 552) took 1342 ms. Trace:
W20260709 13:08:07.441293 21041 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:08:07.440941 16462 rpcz_store.cc:276] 0709 13:08:06.098363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.098488 (+   125us) service_pool.cc:224] Handling call
0709 13:08:06.113940 (+ 15452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:06.118494 (+  4554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.118524 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:06.140102 (+ 21578us) log.cc:844] Serialized 52 byte log entry
0709 13:08:06.212874 (+ 72772us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:06.213521 (+   647us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.294014 (+ 80493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.294471 (+   457us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.437904 (+1143433us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:07.439934 (+  2030us) raft_consensus.cc:1685] finished
0709 13:08:07.440063 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.440257 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11237,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":160067,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":24967,"spinlock_wait_cycles":5088128,"thread_start_us":97099,"threads_started":2,"wal-append.queue_time_us":111410}
I20260709 13:08:07.435276 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.449328 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:07.396016 20782 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.450459 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.452827 16541 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:07.454035 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.459333 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:07.452581 20990 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.456344 20973 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.473083 20960 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.474076 20960 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.474843 20960 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.475248 20960 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.475678 20960 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.477339 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 660) took 2458 ms. Trace:
I20260709 13:08:07.477963 16617 rpcz_store.cc:276] 0709 13:08:05.018898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.019034 (+   136us) service_pool.cc:224] Handling call
0709 13:08:05.019350 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:05.660285 (+640935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.476981 (+1816696us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540025dd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:07.477261 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407871360}
I20260709 13:08:07.479805 20767 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.480376 20767 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:07.481455 20767 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:07.477464 21034 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:08:07.464075 20990 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.492347 16545 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.495388 21025 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.498818 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.500576 16469 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:08:07.500921 16469 pending_rounds.cc:85] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 5
I20260709 13:08:07.501129 16469 pending_rounds.cc:107] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:07.501317 16469 raft_consensus.cc:2889] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.499521 21016 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.494455 20990 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.490676 20973 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.505533 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 1903) took 2395 ms. Trace:
I20260709 13:08:07.503273 21025 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.507495 16545 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:07.511880 16610 rpcz_store.cc:276] 0709 13:08:05.110209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.177455 (+ 67246us) service_pool.cc:224] Handling call
0709 13:08:05.331512 (+154057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.761392 (+429880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.505255 (+1743863us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003db654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:07.505458 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957092736}
I20260709 13:08:07.517511 20902 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.518669 20680 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:07.519141 20680 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:08:07.521274 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:07.522624 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.523245 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.523943 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.501775 20981 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.525490 16465 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:07.520053 20680 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.524427 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.524559 16462 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:07.537178 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.525658 20981 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.539924 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.536163 20680 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.541635 20782 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.542160 20841 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.546350 20973 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.549511 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.550145 16464 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.538125 21046 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.555408 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.556135 16465 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:07.558511 16467 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:07.564119 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 1947) took 2136 ms. Trace:
I20260709 13:08:07.564862 20839 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:07.565325 20839 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:07.565644 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 651) took 1600 ms. Trace:
I20260709 13:08:07.566370 20839 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.567363 20969 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.567690 20839 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:07.567914 21025 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.568588 21025 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.566037 16536 rpcz_store.cc:276] 0709 13:08:05.965055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.965163 (+   108us) service_pool.cc:224] Handling call
0709 13:08:06.033417 (+ 68254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.033640 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:06.376308 (+342668us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.565148 (+1188840us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.565314 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.565358 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:07.565419 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.565496 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.565597 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629917,"prepare.queue_time_us":692121,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":87,"raft.queue_time_us":48547,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":6487,"thread_start_us":875313,"threads_started":3,"wal-append.queue_time_us":625453}
I20260709 13:08:07.551620 21046 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:07.571581 21046 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.564509 16542 rpcz_store.cc:276] 0709 13:08:05.427241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.427365 (+   124us) service_pool.cc:224] Handling call
0709 13:08:05.469808 (+ 42443us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:05.526077 (+ 56269us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:05.912503 (+386426us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.309878 (+397375us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:06.316303 (+  6425us) log.cc:844] Serialized 52 byte log entry
0709 13:08:06.317382 (+  1079us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:07.563314 (+1245932us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.563660 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.563818 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.563890 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.563923 (+    33us) raft_consensus.cc:1685] finished
0709 13:08:07.563934 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.564043 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1277230,"prepare.queue_time_us":1754715,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":96,"raft.queue_time_us":339360,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":13949,"thread_start_us":569384,"threads_started":2,"wal-append.queue_time_us":400716}
I20260709 13:08:07.576551 20824 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.577039 20824 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.577498 21025 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.578296 20916 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.577903 20824 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.578811 20916 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.584964 20830 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.579293 20824 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.594516 16464 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:07.596184 16464 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:08:07.608251 16465 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:07.607481 21002 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.611039 21002 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.623445 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2130) took 2645 ms. Trace:
I20260709 13:08:07.624171 21002 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.625505 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.626307 16542 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:07.623936 16461 rpcz_store.cc:276] 0709 13:08:04.974264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.977452 (+  3188us) service_pool.cc:224] Handling call
0709 13:08:04.977823 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.114964 (+1137141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.619645 (+1504681us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002a80d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:07.619821 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599020416}
I20260709 13:08:07.629007 16614 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:07.629386 16614 pending_rounds.cc:85] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 8
I20260709 13:08:07.629601 16614 pending_rounds.cc:107] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:07.629812 16614 raft_consensus.cc:2889] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.633740 20575 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.637245 20981 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.642256 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:07.643499 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:07.656005 16539 raft_consensus.cc:1240] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:07.656342 20509 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.656924 20509 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.659153 20509 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.659291 20968 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.662573 20957 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.664981 21037 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:07.665482 21037 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.665791 16463 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:07.665865 21037 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.667593 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.668452 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.668948 20995 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:07.669481 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.669210 16470 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:07.670473 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.671020 16467 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:07.671617 20910 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.671774 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.673966 20916 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.678342 20888 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.679574 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2272) took 2491 ms. Trace:
I20260709 13:08:07.680076 16613 rpcz_store.cc:276] 0709 13:08:05.187944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.961278 (+773334us) service_pool.cc:224] Handling call
0709 13:08:06.035379 (+ 74101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.848079 (+812700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.679246 (+831167us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b540025c454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:07.679510 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1867052288}
I20260709 13:08:07.636718 20575 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.659706 20509 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.683339 20509 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.683745 16466 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:07.685683 20509 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.659726 20968 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.686717 20968 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.688898 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.672158 20910 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.692305 20910 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.660665 20990 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.698508 20990 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.686206 20960 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.701187 20895 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.701736 20895 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.703248 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:07.704141 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.704921 20917 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.705063 21035 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.705403 20917 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:07.705638 20603 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:07.705597 21035 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.706579 20603 consensus_queue.cc:1059] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:07.707360 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:07.707602 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.708148 16467 raft_consensus.cc:2410] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:08:07.710873 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.709560 20995 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:07.711745 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:07.712234 20995 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.711968 21036 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:07.711453 16467 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:07.717156 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.717720 16467 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 8.
I20260709 13:08:07.722047 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:07.734511 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:07.712999 20871 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:07.736023 21035 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.736406 20960 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:07.736883 20900 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.738668 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:07.739306 20895 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.739943 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:07.740795 16616 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:08:07.740939 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 205603us
I20260709 13:08:07.742110 16616 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:07.743479 20833 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:07.744051 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.664471 20909 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.745460 20837 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:07.744951 20906 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.749799 16612 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:07.712630 20995 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.753979 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:07.751274 20909 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.751853 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.752251 20917 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:07.754278 16612 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:07.754287 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:07.746250 21046 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.756523 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.713126 21002 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:07.733083 21009 raft_consensus.cc:3055] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:07.798949 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44732.4us
W20260709 13:08:07.769095 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.804258 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.777372 16617 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:07.805447 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:07.765358 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.802117 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.800971 16467 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:08:07.801741 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:07.809219 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.810086 16539 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
W20260709 13:08:07.810518 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 54059us
W20260709 13:08:07.811170 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.811334 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:07.744074 20833 consensus_queue.cc:1243] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:07.750511 20837 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:07.733764 20990 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.755570 20966 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.755446 20906 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.812986 20915 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.821425 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.822137 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.824517 16536 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:07.825404 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:07.797619 20957 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.799029 16612 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.829682 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:07.829941 16612 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.830278 16540 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 7.
I20260709 13:08:07.826795 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.827004 16542 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:07.757848 20949 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:07.804737 21009 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.825635 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:07.814165 20874 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:07.820480 21050 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:07.833971 16541 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 9.
I20260709 13:08:07.808406 21002 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:07.813403 20960 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.838882 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:07.833295 16585 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.832342 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.844372 20917 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.845003 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:07.860428 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.844715 21009 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.828926 20957 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.819319 20837 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:07.819151 20916 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:07.824191 20844 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:07.847889 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:07.873145 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:07.818786 20961 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:07.854571 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 150496us
I20260709 13:08:07.832427 20906 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.852834 20888 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.848734 21046 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:07.837641 20874 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.872467 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.836706 20949 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.880695 16612 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:07.906770 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:07.863596 20917 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.868213 20957 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.867816 20391 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.831918 20966 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.852510 20981 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:08:07.918222 17118 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:07.836596 20990 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.873739 21036 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:07.921500 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:07.926780 16467 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.838675 20915 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.923035 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:07.864544 20911 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:08:07.931154 17122 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:07.873927 20830 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:07.878206 20904 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:07.932904 21002 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:07.913673 20949 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:07.934247 20837 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.935461 20837 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:07.919301 20872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:07.914494 20874 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:07.940481 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:07.916540 20917 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.945132 20830 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.946403 21036 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:07.945799 20904 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.917812 21009 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.879798 20916 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.948486 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:07.976612 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:07.957115 20962 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:07.913439 20839 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:07.925420 20977 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.934248 21002 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:07.942970 20902 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.995520 16467 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:08:08.018534 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.944494 20391 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:08.006875 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:07.924371 20952 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:08:07.925158 20895 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:08:08.001462 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.007385 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 167792us
I20260709 13:08:08.059592 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.060480 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
W20260709 13:08:08.055646 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73311.5us
I20260709 13:08:08.056749 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:08.062839 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:08.069196 16610 raft_consensus.cc:606] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:08.088364 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 105325us
I20260709 13:08:08.069815 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:07.974308 20918 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:08.091614 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 84812.8us
I20260709 13:08:08.072788 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:08.058387 20902 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.088546 16610 raft_consensus.cc:614] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.074040 16465 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 12. Ops: []
I20260709 13:08:08.108942 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:08.109472 16542 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:08.076108 16461 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.110596 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.111197 16542 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:08.111801 20391 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.112469 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.112847 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.113335 16544 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:08.114811 16544 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:08.114864 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:08.097096 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.118616 17122 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.118851 16539 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.112217 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.099879 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.114084 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.121210 16543 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:08.101013 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:08.073936 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.122598 16536 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:07.981340 20913 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:08:08.118021 16540 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:08:08.126264 16540 pending_rounds.cc:85] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 5
I20260709 13:08:08.126543 16540 pending_rounds.cc:107] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:08:08.126818 16540 raft_consensus.cc:2889] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.981647 20904 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.116422 16544 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.129498 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.121305 16541 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.071539 16464 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:08.096814 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.066437 21056 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:08.088102 21037 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:07.993299 20830 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:08:08.130867 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:08.093750 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 228152us
I20260709 13:08:07.989143 20968 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.148350 20966 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.149102 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:08.102324 20845 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.149801 20916 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.007354 20839 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.150624 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.151425 16610 raft_consensus.cc:2368] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:08.151887 20839 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.153079 20968 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.141541 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.146833 20957 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:08.156175 20957 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.147054 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.107614 20902 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.157321 20915 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.150079 20845 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.161202 20845 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.095284 21035 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:08.163858 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.055665 20977 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.145449 20967 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.167441 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.172043 16542 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:08.173947 16615 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:08.085951 20990 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.180176 17121 raft_consensus.cc:2393] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:08.095758 20918 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.182269 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.183672 17090 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.192972 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.164956 20900 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.210040 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.222967 16541 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:08.226487 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.229153 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.205237 20841 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:08.229933 16541 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:08.200876 20918 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.231637 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.139976 21036 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.234790 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.235814 16541 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.252270 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.253413 16610 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:08.254405 17126 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:08.260747 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.264350 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.233237 20841 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.268719 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.269393 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 733) took 2099 ms. Trace:
I20260709 13:08:08.273910 17125 rpcz_store.cc:276] 0709 13:08:06.164694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.164908 (+   214us) service_pool.cc:224] Handling call
0709 13:08:06.189885 (+ 24977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.265312 (+1075427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.263527 (+998215us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540060f754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:08.263744 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439414144}
I20260709 13:08:08.267449 20841 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:08.219360 20900 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.276305 16610 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 12.
I20260709 13:08:08.276157 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.276104 16541 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:08.286149 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.287225 16539 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:08.291818 16539 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:08.273583 20990 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.308344 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.309763 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.322163 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.323024 16610 raft_consensus.cc:2368] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15.
I20260709 13:08:08.326331 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:08.327589 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.329401 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.329651 17122 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:08.330469 16610 raft_consensus.cc:2393] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:08.330892 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:08.331485 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.334663 21037 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.334821 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:08.335481 16461 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:08.337278 20874 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.338001 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:08.338828 17119 raft_consensus.cc:2368] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10.
I20260709 13:08:08.340081 20874 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.328322 20990 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.344319 16461 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:08.345870 16467 raft_consensus.cc:2410] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:08.346367 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.346928 16539 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.347819 16461 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:08.350023 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:08.350220 16511 leader_election.cc:400] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:08.350594 17125 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.351668 16461 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:08.350587 16511 leader_election.cc:403] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:08.353372 16461 raft_consensus.cc:1217] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-13.8]   Dedup: 9.6->[11.7-13.8]
I20260709 13:08:08.354090 16461 pending_rounds.cc:85] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 6
I20260709 13:08:08.354526 16461 pending_rounds.cc:107] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:08.354902 16461 raft_consensus.cc:2889] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.350771 20957 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:08.370980 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.359539 20839 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:08.358208 20904 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.373025 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:08.386919 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:08.373502 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:08.374564 21001 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:08.376914 21035 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:08.377933 20391 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:08.378531 20260 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.388522 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:08.404124 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.371743 20830 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:08.372546 20977 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.410737 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:08.408373 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52443.5us
W20260709 13:08:08.411695 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.409263 20833 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:08.413209 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.414362 20769 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:08:08.399161 20895 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:08:08.415352 21063 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:08:08.406873 20904 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:08.415994 20904 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:08.401782 20981 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:08.416857 20904 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.417310 20981 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.418190 20904 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.404943 20603 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:08.419337 20981 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.419741 20603 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:08.420630 20603 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:08.422201 21070 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:08.430476 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:08.407166 20830 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.434787 20830 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.401762 20913 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.444001 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.444986 16618 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:08.447700 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.448707 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.449337 16618 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:08.450403 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:08.403731 21037 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:08.457862 17125 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:08:08.451574 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45438us
I20260709 13:08:08.413060 20833 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:08.451897 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.458925 16618 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:08.459285 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:08.460731 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:08.438283 20913 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.472486 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.473546 16618 raft_consensus.cc:2393] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:08.446856 21068 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:08.474498 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:08.463181 20995 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.001s
I20260709 13:08:08.482713 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:08.477990 20949 consensus_meta.cc:287] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.001s
W20260709 13:08:08.481451 21073 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:08:08.471969 21001 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.487473 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.463630 20833 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.477427 20913 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.476804 21049 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.470688 21037 consensus_queue.cc:1243] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:08.492942 16618 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.499217 16618 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.480798 20900 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.461632 20967 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:08.477645 20895 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:08:08.515987 21066 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:08:08.489948 20917 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
W20260709 13:08:08.505847 21078 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:08:08.492168 21001 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.490298 21082 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.490803 20839 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.488586 21068 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:08.500468 21049 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.523836 21001 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.524392 21082 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:08.520364 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:08:08.500761 20906 consensus_meta.cc:287] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:08:08.502524 20990 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.488044 20995 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.525259 20767 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.493767 20949 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.546649 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:08.499382 20977 consensus_queue.cc:1059] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:08:08.550514 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.557325 16544 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:08.542114 21049 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.558830 16466 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:08.561650 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2157) took 1037 ms. Trace:
I20260709 13:08:08.555395 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.563076 16466 rpcz_store.cc:276] 0709 13:08:07.524652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.685277 (+160625us) service_pool.cc:224] Handling call
0709 13:08:08.558343 (+873066us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:08:08.558517 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.561431 (+  2914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.561599 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60235648}
I20260709 13:08:08.565181 16618 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:08.566576 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.521750 20917 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.572898 21037 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:08.573176 21062 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:08.573246 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:08.574249 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.526482 20902 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:08.576400 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56122.5us
I20260709 13:08:08.580806 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.578187 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.581807 16543 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.574445 20949 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.596086 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 662) took 3014 ms. Trace:
I20260709 13:08:08.604302 20990 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:08.603857 16511 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 12.
I20260709 13:08:08.563499 20839 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:08.726328 20995 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.737221 16511 leader_election.cc:403] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:08.738144 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 134413us
I20260709 13:08:08.739787 16511 leader_election.cc:400] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15.
I20260709 13:08:08.577605 20895 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:08:08.548105 20906 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.579494 20915 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:08:08.645584 16619 raft_consensus.cc:2368] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:08.661280 16614 rpcz_store.cc:276] 0709 13:08:05.581598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.035453 (+453855us) service_pool.cc:224] Handling call
0709 13:08:06.035702 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.633577 (+1597875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.595828 (+962251us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540019f5d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:08.596017 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3653132672}
I20260709 13:08:08.669039 16615 raft_consensus.cc:2368] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 13.
W20260709 13:08:08.638150 21002 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260709 13:08:08.646827 20902 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.643607 20977 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:08.671801 20837 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.005s
I20260709 13:08:08.698738 21049 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.699271 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2279) took 1740 ms. Trace:
I20260709 13:08:08.699676 20918 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.702310 20917 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.704138 20833 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.628564 20845 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:08.714092 20841 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.719599 17125 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:08.720170 17121 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.617362 20913 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.670423 20830 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:08.616631 21068 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.637197 21082 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.746739 17119 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.740697 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.855752 17123 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:08.856240 20990 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:08.829496 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 574) took 1440 ms. Trace:
W20260709 13:08:08.857393 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 116767us
I20260709 13:08:08.814132 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:08.858433 16544 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:08.858763 21049 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.858530 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:08:08.797839 21065 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.470s	user 0.005s	sys 0.000s
I20260709 13:08:08.859478 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.860140 16617 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.860431 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:08.860826 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2284) took 1160 ms. Trace:
I20260709 13:08:08.861248 16613 rpcz_store.cc:276] 0709 13:08:07.700729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.749413 (+ 48684us) service_pool.cc:224] Handling call
0709 13:08:07.751774 (+  2361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.824564 (+ 72790us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.824596 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:07.825055 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.170262 (+345207us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:08.170310 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.170454 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.797138 (+626684us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:08.860513 (+ 63375us) raft_consensus.cc:1685] finished
0709 13:08:08.860539 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.860748 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72413,"raft.queue_time_us":77277,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5067,"spinlock_wait_cycles":11168128,"thread_start_us":311217,"threads_started":1,"wal-append.queue_time_us":442481}
I20260709 13:08:08.825341 20575 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.863106 20833 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.863404 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.857304 16470 rpcz_store.cc:276] 0709 13:08:07.389486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.389680 (+   194us) service_pool.cc:224] Handling call
0709 13:08:07.668871 (+279191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.670032 (+  1161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.816748 (+1146716us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54002a94d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:08.829432 (+ 12684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641093504}
I20260709 13:08:08.864317 16612 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 9. Current term is 11.
I20260709 13:08:08.864707 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.856829 17119 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.866945 20906 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.867492 16617 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:08.867601 17119 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:08.869453 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 740) took 1023 ms. Trace:
I20260709 13:08:08.870044 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:08.870795 16543 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:08.744894 20767 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:08.873384 20837 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:08.879060 16611 rpcz_store.cc:276] 0709 13:08:06.959207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.993907 (+ 34700us) service_pool.cc:224] Handling call
0709 13:08:06.994356 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.054767 (+ 60411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.698997 (+1644230us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b540001e5d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:08.699211 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137351936}
I20260709 13:08:08.878916 20685 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:08.787333 21067 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.406s	user 0.003s	sys 0.000s
I20260709 13:08:08.871958 16543 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:08.778617 20887 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.783934 16541 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:08.881596 20913 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.881824 17126 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:08.882820 20918 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.885741 16610 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:08.869493 20839 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.886915 16469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2143) took 2966 ms. Trace:
I20260709 13:08:08.905560 16469 rpcz_store.cc:276] 0709 13:08:05.920573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.964941 (+ 44368us) service_pool.cc:224] Handling call
0709 13:08:05.965202 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.501642 (+1536440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.886627 (+1384985us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400379954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:08.886841 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3530331904}
I20260709 13:08:08.748023 21001 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:08.908862 16582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 1.853s (SENT) [suppressed 22 similar messages]
I20260709 13:08:08.869887 17118 rpcz_store.cc:276] 0709 13:08:07.846086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.858790 (+ 12704us) service_pool.cc:224] Handling call
0709 13:08:07.863584 (+  4794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.926172 (+ 62588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.869242 (+943070us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b5400523854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:08.869400 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125042944}
I20260709 13:08:08.889048 20845 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.893047 16617 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:08:08.897862 16544 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
W20260709 13:08:08.917027 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.899739 20830 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.907932 20990 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.901855 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:08.910780 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.907863 20685 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:08.914629 20957 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:08.913509 20887 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:08.929209 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:08.934134 16544 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:08.941267 21001 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.895512 20977 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.935381 20839 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:08.957718 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:08.936156 20876 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:08.967401 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58610.5us
I20260709 13:08:08.971823 20767 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 12.
I20260709 13:08:08.973022 16613 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:08.981168 20685 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.985275 17123 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:08:08.985740 17123 pending_rounds.cc:85] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 8
I20260709 13:08:08.986002 20977 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:08.986003 17123 pending_rounds.cc:107] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:08:08.986716 17123 raft_consensus.cc:2889] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.986732 20876 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:08.991513 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 672) took 1264 ms. Trace:
I20260709 13:08:08.991933 16616 rpcz_store.cc:276] 0709 13:08:07.727352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.742766 (+ 15414us) service_pool.cc:224] Handling call
0709 13:08:07.743054 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:07.747538 (+  4484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.747580 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:07.748264 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.227703 (+479439us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.236879 (+  9176us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.237175 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.237251 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.571504 (+334253us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b180016b5e0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:08.786640 (+215136us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:08.991287 (+204647us) raft_consensus.cc:1685] finished
0709 13:08:08.991311 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.991454 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1202,"prepare.queue_time_us":8872,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":3989,"raft.queue_time_us":7376,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":14993,"spinlock_wait_cycles":14775936,"thread_start_us":412010,"threads_started":1,"wal-append.queue_time_us":545495}
I20260709 13:08:08.995409 16616 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:08.961660 21049 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:08.969624 20990 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.996543 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:08.965724 20841 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:08.999320 16616 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:09.001302 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:08.991045 20876 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:08.999512 20767 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:08:09.007138 20767 consensus_queue.cc:1243] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:08.998473 21049 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:09.005888 16616 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:09.008374 21049 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.018002 16583 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:09.008802 20957 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:09.021284 20957 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:09.022325 20957 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.023087 21049 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.023753 20957 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.026106 21049 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.027462 21001 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:09.029469 21001 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:09.030486 21001 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:09.036276 21043 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.601s	user 0.006s	sys 0.000s
I20260709 13:08:09.044458 20685 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.045302 20685 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.047853 20685 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.049227 21061 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.049901 21061 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.052260 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 735) took 1236 ms. Trace:
I20260709 13:08:09.047713 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:09.053524 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.054491 16469 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:09.054636 16511 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:09.053020 17124 rpcz_store.cc:276] 0709 13:08:07.816284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.816418 (+   134us) service_pool.cc:224] Handling call
0709 13:08:07.816677 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.060441 (+243764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.060485 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:08.060544 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.060614 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.051950 (+991336us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400120054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:09.052014 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.052183 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559981824}
I20260709 13:08:09.056928 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.059002 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.059122 16469 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:09.063800 21049 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:09.056885 20990 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.065073 20767 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.065117 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:09.066154 21049 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:09.066881 20767 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:09.052271 21061 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.065065 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.068475 20911 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.070905 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.071189 20911 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.068535 20767 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:09.072045 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.072476 20767 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.076656 20911 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.077144 21049 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.073796 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:09.074023 16465 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.074435 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.075176 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:09.083184 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.084100 20990 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.086599 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.087427 20990 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.089921 20990 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.094641 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2161) took 1559 ms. Trace:
I20260709 13:08:09.094893 16465 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:09.095069 16463 rpcz_store.cc:276] 0709 13:08:07.534942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.690006 (+155064us) service_pool.cc:224] Handling call
0709 13:08:09.093835 (+1403829us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:08:09.094030 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.094305 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.094330 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.094366 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.094399 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.094465 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.094572 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102659840}
I20260709 13:08:09.099424 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:09.100432 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.103381 16434 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:09.102828 20957 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:09.105993 20957 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:09.109236 20888 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:09.109678 20888 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:09.110549 20888 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.107000 20957 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:09.123376 16434 leader_election.cc:400] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10.
I20260709 13:08:09.123759 16434 leader_election.cc:403] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:09.126097 21002 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:09.128050 21061 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.129426 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1917) took 1392 ms. Trace:
I20260709 13:08:09.130002 16467 rpcz_store.cc:276] 0709 13:08:07.736867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.062596 (+325729us) service_pool.cc:224] Handling call
0709 13:08:09.129149 (+1066553us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400355cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.129346 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627593600}
W20260709 13:08:09.131693 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.133031 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.136615 17124 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:09.111658 20888 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.138520 21002 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:09.141426 20990 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.111590 20918 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:08:09.134160 20911 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:08:09.150869 20911 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:09.151274 20911 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:09.152191 20911 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.145704 20925 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:09.153275 20925 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.153817 20911 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.155500 20925 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.156379 21061 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10.
I20260709 13:08:09.147953 20918 consensus_queue.cc:1243] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:09.114097 20767 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:09.166023 16511 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.694s (SENT)
I20260709 13:08:09.167140 20767 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.167960 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.173511 16467 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.170466 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:09.170651 16511 leader_election.cc:336] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.753s (SENT)
I20260709 13:08:09.176549 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.176625 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.180356 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:09.180915 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.854s (SENT)
I20260709 13:08:09.181053 16463 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.182919 20767 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.180466 21055 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:09.185047 21055 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:09.184921 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.185962 21055 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.187126 21055 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.189283 16467 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:09.192139 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.193037 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.193463 16467 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.195845 16463 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.198315 16511 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:09.191263 20767 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.206791 16467 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.210868 20957 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:09.211565 20957 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:09.212620 20957 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.228250 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.210379 20260 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.239002 20260 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.240999 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:09.257987 20260 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.234570 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2173) took 1070 ms. Trace:
I20260709 13:08:09.237382 20509 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.271087 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:09.239573 21056 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:09.236153 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.230538 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.276132 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.271243 16462 rpcz_store.cc:276] 0709 13:08:08.164524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.709424 (+544900us) service_pool.cc:224] Handling call
0709 13:08:08.709914 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.710210 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:09.187330 (+477120us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.226892 (+ 39562us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.234120 (+  7228us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.234185 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.234342 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.234497 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476831,"prepare.queue_time_us":478351,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":181,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1017,"spinlock_wait_cycles":9441152,"thread_start_us":39035,"threads_started":1,"wal-append.queue_time_us":41632}
I20260709 13:08:09.228785 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2172) took 1123 ms. Trace:
I20260709 13:08:09.279002 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.282253 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:09.284296 16433 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.278690 16466 rpcz_store.cc:276] 0709 13:08:08.105596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.564758 (+459162us) service_pool.cc:224] Handling call
0709 13:08:08.565027 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.565198 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:09.185717 (+620519us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.228361 (+ 42644us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.228419 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:09.228472 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.228550 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.228689 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":621042,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":2393,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":42145,"threads_started":1,"wal-append.queue_time_us":83094}
I20260709 13:08:09.288152 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.290349 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.280526 20952 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:09.291684 16466 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:09.280664 20925 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.295861 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.285655 21002 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.281674 20911 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.297006 16462 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.298086 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:09.295681 20915 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:09.299582 20925 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.291427 20893 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.293079 21061 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:09.282385 20909 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:09.314334 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.282496 20845 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:09.314568 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:09.283373 21056 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.326838 20925 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.328650 21056 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.302006 20952 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:09.325736 20845 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:09.326229 16466 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:09.312903 20911 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:08:09.356066 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.356946 20957 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:09.357568 20957 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.359226 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.359794 20957 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.360321 21049 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:09.363700 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:09.363969 21049 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:09.364439 21049 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.364528 16617 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:09.363731 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:09.367956 21002 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.362288 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:09.363476 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1923) took 1034 ms. Trace:
I20260709 13:08:09.370167 16610 rpcz_store.cc:276] 0709 13:08:08.328951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.331200 (+  2249us) service_pool.cc:224] Handling call
0709 13:08:09.363305 (+1032105us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400233cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.363424 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272319872}
I20260709 13:08:09.376639 21049 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.376590 20845 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.378485 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.379140 16465 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.379640 21049 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.380115 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.349340 20952 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:09.383422 21071 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.960s	user 0.003s	sys 0.003s
I20260709 13:08:09.385066 20957 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.385771 16466 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.385607 20957 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.387419 16466 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:09.387823 20957 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.388293 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1911) took 1212 ms. Trace:
I20260709 13:08:09.388370 20957 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:09.389617 20767 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.389767 20957 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.390147 20767 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.388737 16615 rpcz_store.cc:276] 0709 13:08:08.176287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.181926 (+  5639us) service_pool.cc:224] Handling call
0709 13:08:09.388104 (+1206178us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54002477d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.388224 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087163776}
I20260709 13:08:09.392270 20767 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.393838 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.393298 20957 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.332108 16462 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.400588 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:09.401888 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:09.405067 16617 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:09.405839 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:09.405978 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45220.9us
I20260709 13:08:09.401952 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.403087 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:09.403193 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:09.372463 20509 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:09.408219 16467 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:09.406787 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.407655 16509 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:09.410934 16615 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:09.414888 16536 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:09.415609 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:09.421263 21082 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:09.421715 17123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 744) took 1052 ms. Trace:
I20260709 13:08:09.422088 17123 rpcz_store.cc:276] 0709 13:08:08.369440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.858229 (+488789us) service_pool.cc:224] Handling call
0709 13:08:08.858495 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.987250 (+128755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.421505 (+434255us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54004b1754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:09.421660 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290633984}
I20260709 13:08:09.413110 20990 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.410923 20674 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.425088 17124 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:09.424841 20674 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.425463 16540 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:09.426445 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.426529 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.426954 20674 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.427237 16538 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.429033 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.428978 16465 pending_rounds.cc:85] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 4
I20260709 13:08:09.433324 16465 pending_rounds.cc:107] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:08:09.433868 16465 raft_consensus.cc:2889] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.413865 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:09.408918 21055 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:09.408171 21049 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.451936 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:09.452714 17124 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:09.454520 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.456893 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:09.457130 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.457558 17123 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:09.445694 20871 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:09.457818 16536 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:09.458182 20871 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:09.458596 20871 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.459678 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:09.460284 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.460357 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.461230 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.410113 20957 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:09.461634 16542 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:09.468394 16541 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:09.468432 16540 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:09.471478 16538 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:09.468983 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:09.474279 16536 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:09.474804 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:09.475852 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.480036 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.485786 16536 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:09.475612 20990 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:09.499977 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.500845 16536 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:09.480108 20767 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.466470 21049 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.467742 20957 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.470726 20913 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:08:09.518204 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.519049 16536 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:09.518167 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 174039us
I20260709 13:08:09.528959 16509 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:09.512311 20990 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:09.533279 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:09.537305 16536 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:09.550046 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 569) took 2280 ms. Trace:
I20260709 13:08:09.550586 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.551379 16538 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.514351 20767 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.554558 20839 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:09.550581 16468 rpcz_store.cc:276] 0709 13:08:07.269422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.269592 (+   170us) service_pool.cc:224] Handling call
0709 13:08:07.276731 (+  7139us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:07.283734 (+  7003us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:07.293676 (+  9942us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.406122 (+112446us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:07.406866 (+   744us) log.cc:844] Serialized 52 byte log entry
0709 13:08:07.407284 (+   418us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:07.407332 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.407429 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.035617 (+1628188us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:09.527428 (+491811us) raft_consensus.cc:1685] finished
0709 13:08:09.549750 (+ 22322us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.549982 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5456,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":9480,"raft.run_cpu_time_us":681,"raft.run_wall_time_us":5206,"spinlock_wait_cycles":18765440,"thread_start_us":52785,"threads_started":1,"wal-append.queue_time_us":130275}
I20260709 13:08:09.562903 16543 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:09.562290 20839 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.564193 20839 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.559540 20767 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.569391 16543 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:09.573170 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.574883 16538 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.568159 21025 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.580212 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.582268 16538 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.583935 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.584198 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.584540 16541 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:09.584725 16542 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:09.580912 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 166305us
I20260709 13:08:09.589167 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:09.589344 16537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1961) took 2530 ms (client timeout 1853 ms). Trace:
W20260709 13:08:09.589792 16537 rpcz_store.cc:269] 0709 13:08:07.058560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.080035 (+ 21475us) service_pool.cc:224] Handling call
0709 13:08:09.589139 (+2509104us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002062d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.589268 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461742336}
W20260709 13:08:09.590373 16612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1912) took 1398 ms (client timeout 1753 ms). Trace:
W20260709 13:08:09.590726 16612 rpcz_store.cc:269] 0709 13:08:08.192290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.192530 (+   240us) service_pool.cc:224] Handling call
0709 13:08:09.590198 (+1397668us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.590321 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536117504}
W20260709 13:08:09.579679 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 133644us
I20260709 13:08:09.592355 16542 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:09.594064 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:09.605895 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.606608 16543 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.610023 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:09.607434 16541 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:09.615068 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:09.617298 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.619254 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:09.624522 16541 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:09.615206 16538 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:09.604408 20906 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:09.635147 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:09.639459 16543 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:08:09.641603 21121 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:09.642732 16542 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:09.649144 16544 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:09.649904 16537 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:08:09.650466 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:09.652216 16539 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:09.594182 21025 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:09.572343 20990 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.655064 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:09.661156 16544 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:09.666914 16537 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:09.667701 16539 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:09.670274 16540 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.669718 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2171) took 1590 ms. Trace:
I20260709 13:08:09.999264 16461 rpcz_store.cc:276] 0709 13:08:08.079324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.559352 (+480028us) service_pool.cc:224] Handling call
0709 13:08:08.559635 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.567976 (+  8341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.568006 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.570405 (+  2399us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.529496 (+959091us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:09.529533 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.529594 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.669469 (+139875us) raft_consensus.cc:1685] finished
0709 13:08:09.669496 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.669651 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7905,"raft.queue_time_us":12514,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":152481,"threads_started":1,"wal-append.queue_time_us":237237}
W20260709 13:08:09.641700 21074 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.266s	user 0.002s	sys 0.006s
W20260709 13:08:09.726979 21127 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:09.741182 21086 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.179s	user 0.006s	sys 0.000s
I20260709 13:08:09.756595 20767 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:09.763754 21025 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:09.775393 17126 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 832) took 1801 ms (client timeout 2194 ms). Trace:
I20260709 13:08:09.668161 21049 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:09.827797 21002 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.906457 17127 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:09.954433 21122 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.338s	user 0.002s	sys 0.000s
I20260709 13:08:09.979642 20848 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:09.980844 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.334239 20767 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:09.985145 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:09.986497 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:10.335853 17118 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:10.021075 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.990643 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:10.337065 17122 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:10.337172 17090 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:10.337270 21002 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.338289 17122 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:10.339740 17122 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:10.339859 21002 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:10.340225 17122 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:10.026705 21155 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.027259 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:10.033243 21116 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:10.050779 17119 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:10.056489 20957 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:10.068734 17125 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 731) took 2149 ms. Trace:
I20260709 13:08:10.354269 17125 rpcz_store.cc:276] 0709 13:08:07.919195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.483337 (+564142us) service_pool.cc:224] Handling call
0709 13:08:08.719409 (+236072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.868003 (+148594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.068483 (+1200480us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54006be250. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:10.068663 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541654784}
I20260709 13:08:10.078255 20909 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:10.355613 20909 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:10.356873 20925 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:10.357839 21156 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:10.096163 20906 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:10.098824 21134 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.107920 21056 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.108592 21055 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.109083 20919 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.110752 20845 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:10.358093 20909 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:10.346462 21155 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.361783 21055 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.363618 21155 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:10.364156 21055 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:10.364586 17118 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:10.364871 20919 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:10.358878 21116 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:10.133422 20871 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.001s
I20260709 13:08:10.034327 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:10.034262 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:10.541337 16463 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
W20260709 13:08:09.858176 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 207767us
W20260709 13:08:10.034114 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 112125us
W20260709 13:08:10.035622 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.825302 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2174) took 1594 ms. Trace:
I20260709 13:08:10.773080 16470 rpcz_store.cc:276] 0709 13:08:08.230809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.864306 (+633497us) service_pool.cc:224] Handling call
0709 13:08:08.864610 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:08.873410 (+  8800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.873445 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:08.874000 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.925387 (+ 51387us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:09.441051 (+515664us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.824940 (+383889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.825017 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.825064 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:09.825076 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.825231 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646675,"prepare.queue_time_us":273531,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":1918,"raft.queue_time_us":586955,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":192,"thread_start_us":303968,"threads_started":2,"wal-append.queue_time_us":96307,"wal-append.run_cpu_time_us":2737,"wal-append.run_wall_time_us":1468668}
W20260709 13:08:09.856794 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45259.4us
I20260709 13:08:09.711150 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:10.020083 16539 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:10.013499 16540 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:09.735796 16541 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:08:10.948367 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:10.951009 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2341) took 1289 ms. Trace:
I20260709 13:08:10.951444 16541 rpcz_store.cc:276] 0709 13:08:09.661745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.712406 (+ 50661us) service_pool.cc:224] Handling call
0709 13:08:09.735496 (+ 23090us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.950770 (+1215274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.950957 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:10.107102 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 452080us
I20260709 13:08:10.121778 16611 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:10.106215 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:09.988453 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 682) took 1148 ms. Trace:
I20260709 13:08:10.996807 16613 rpcz_store.cc:276] 0709 13:08:08.840519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.864458 (+ 23939us) service_pool.cc:224] Handling call
0709 13:08:09.988251 (+1123793us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540036b854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.988392 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245866240}
I20260709 13:08:10.997459 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:10.119813 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:10.122686 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:09.951661 16618 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:11.009090 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2294) took 2447 ms. Trace:
I20260709 13:08:11.009582 16618 rpcz_store.cc:276] 0709 13:08:08.562089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.582985 (+ 20896us) service_pool.cc:224] Handling call
0709 13:08:09.951393 (+1368408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.006734 (+1055341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.008809 (+  2075us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540036bd50. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:11.009004 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3146207616}
W20260709 13:08:09.943658 16619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41796 (request call id 1914) took 1725 ms (client timeout 1854 ms). Trace:
I20260709 13:08:10.422442 21156 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:10.364216 21155 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:08:10.421236 21134 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.444502 21116 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:10.563640 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:10.459846 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 121375us
I20260709 13:08:11.020152 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:10.352689 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.022660 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:10.479526 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.042788 17120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 736) took 1059 ms. Trace:
I20260709 13:08:11.043303 17120 rpcz_store.cc:276] 0709 13:08:09.983340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.022267 (+ 38927us) service_pool.cc:224] Handling call
0709 13:08:11.042727 (+1020460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.351927 17127 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 733) took 2424 ms. Trace:
I20260709 13:08:10.027873 20509 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.077016 21134 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:10.453284 20839 consensus_meta.cc:287] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.889s	user 0.007s	sys 0.006s
I20260709 13:08:10.424108 20871 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.457315 20906 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:10.348839 20848 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.161911 20848 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.335054 20837 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:11.174153 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 48191.6us
I20260709 13:08:10.347277 17122 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.195618 17122 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.336017 17121 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:11.223824 17121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 740) took 1237 ms (client timeout 1589 ms). Trace:
I20260709 13:08:11.188248 21190 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:08:11.224176 17121 rpcz_store.cc:269] 0709 13:08:09.986135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.986248 (+   113us) service_pool.cc:224] Handling call
0709 13:08:11.223756 (+1237508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:10.436049 20919 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:10.421345 20845 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.423861 21056 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.459399 20925 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.296645 20925 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:10.660708 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:10.726729 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:10.726842 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc160 after lost signal to thread 15324
W20260709 13:08:11.298252 16566 debug-util.cc:398] Leaking SignalData structure 0x7b0800302900 after lost signal to thread 16402
I20260709 13:08:11.298462 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:11.299470 16566 debug-util.cc:398] Leaking SignalData structure 0x7b0800306960 after lost signal to thread 16494
W20260709 13:08:11.299778 16566 debug-util.cc:398] Leaking SignalData structure 0x7b080036b800 after lost signal to thread 16495
W20260709 13:08:11.300817 16566 debug-util.cc:398] Leaking SignalData structure 0x7b080037b9c0 after lost signal to thread 16569
I20260709 13:08:10.728554 21049 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:10.733265 20909 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:11.302781 20925 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:10.733807 21055 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:10.744251 20957 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:10.737658 20767 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:10.749325 20674 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.756412 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:10.774515 21163 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.821009 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:11.305241 16610 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:11.305704 16544 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:10.836750 21025 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.871575 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44540.1us
I20260709 13:08:10.821606 21164 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:10.886703 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.883966 21173 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:10.898422 21174 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.884294 21168 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:08:10.905234 21166 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:10.921352 16570 heartbeater.cc:646] Failed to heartbeat to 127.14.246.126:40851 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.246.126:40851 timed out after 15.000s (SENT)
I20260709 13:08:10.921495 21002 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:10.925595 21162 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.324733 21217 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:08:11.326721 21002 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.326962 21162 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.313527 21164 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.329768 21164 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:10.926368 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.329906 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:10.929095 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:10.933655 21175 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.331516 17118 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:10.959803 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 1998) took 1363 ms. Trace:
I20260709 13:08:10.979491 16536 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:10.947122 21167 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.948177 21181 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.077318 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2297) took 1514 ms. Trace:
I20260709 13:08:11.344642 21221 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.998324 16545 raft_consensus.cc:2410] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:11.345319 16614 rpcz_store.cc:276] 0709 13:08:08.562857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.872706 (+309849us) service_pool.cc:224] Handling call
0709 13:08:10.000972 (+1128266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.001168 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.001195 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.001238 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:10.001279 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.001332 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.077133 (+ 75801us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540036b850. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:10.077256 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2593878272}
I20260709 13:08:11.345611 21221 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.001451 16615 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
W20260709 13:08:11.001614 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 53325us
W20260709 13:08:11.000927 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 1.28971e+06us
I20260709 13:08:11.004052 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.347906 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:11.002856 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.348656 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 694) took 1224 ms. Trace:
I20260709 13:08:11.348956 16612 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:11.349087 16614 rpcz_store.cc:276] 0709 13:08:10.122912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.346847 (+1223935us) service_pool.cc:224] Handling call
0709 13:08:11.347151 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.347402 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.347427 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.347470 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.347513 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.347567 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.347667 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.006039 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.353897 16611 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.354592 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2302) took 1230 ms. Trace:
I20260709 13:08:11.354983 16611 rpcz_store.cc:276] 0709 13:08:10.123664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.353274 (+1229610us) service_pool.cc:224] Handling call
0709 13:08:11.353655 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.354334 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.354530 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.013437 16619 rpcz_store.cc:269] 0709 13:08:08.218664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.243570 (+ 24906us) service_pool.cc:224] Handling call
0709 13:08:09.943374 (+1699804us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540036bd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.943578 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874691328}
I20260709 13:08:11.005456 21165 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.356416 21165 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.357352 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2306) took 1232 ms. Trace:
I20260709 13:08:11.012002 21001 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.358476 21165 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:11.021507 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 457918us
I20260709 13:08:11.358904 21001 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:11.359355 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:11.359452 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.360069 16463 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:11.011991 21183 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.361164 21172 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.361217 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:11.361711 21172 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.044641 17127 rpcz_store.cc:276] 0709 13:08:07.927466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.484720 (+557254us) service_pool.cc:224] Handling call
0709 13:08:09.906275 (+1421555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.332513 (+426238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.351594 (+ 19081us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54007b57d0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:10.351839 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3240735616}
I20260709 13:08:11.017081 21188 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.033407 21178 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.362951 21178 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.028692 21116 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.039232 21159 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:11.357875 16619 rpcz_store.cc:276] 0709 13:08:10.124691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.356377 (+1231686us) service_pool.cc:224] Handling call
0709 13:08:11.356728 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.356960 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.356996 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.357060 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:11.357105 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.357173 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.357292 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.368614 20830 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.368865 21159 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:11.369447 16619 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:11.369956 20830 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.077273 20838 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.077661 21134 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:11.077939 21180 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.078354 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:11.070544 21156 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.070449 21187 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.093807 16461 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:11.380851 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:11.095685 16367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 259) took 12624 ms (client timeout 15000 ms). Trace:
I20260709 13:08:11.088058 21176 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.359997 21001 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.088356 21155 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:11.387105 21227 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.387804 21155 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.387661 21227 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.111830 21203 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.388666 21203 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.388756 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2300) took 1265 ms. Trace:
I20260709 13:08:11.122504 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.121363 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.090106 20839 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.130386 20871 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.023658 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:11.159107 21201 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.176935 21207 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.180756 21211 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:11.187031 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.381122 21134 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.189905 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.377234 20509 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:08:11.219964 17122 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:08:11.224870 21200 log.cc:927] Time spent T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:08:11.405838 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 848) took 1407 ms. Trace:
I20260709 13:08:11.225699 21190 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:11.404394 21211 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.406112 21231 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.406212 17122 rpcz_store.cc:276] 0709 13:08:09.998481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.339257 (+340776us) service_pool.cc:224] Handling call
0709 13:08:10.339588 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.405502 (+1065914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.405758 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.406443 21190 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.407209 21203 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.407719 21203 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.408013 21194 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:11.408236 21203 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.408751 21190 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.408586 21194 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.410261 21203 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.410643 21194 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.404397 21207 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.413331 21207 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.413924 20871 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:11.383000 21187 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.222260 21218 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.415730 21218 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.416332 21187 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.416935 16616 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:11.417058 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.417899 21218 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.418237 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:11.252787 21196 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:11.380105 21180 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.261221 20848 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.267074 16466 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.419720 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:11.274996 21223 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.420795 21180 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:11.420907 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:11.293833 20845 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.286499 21220 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.407791 21211 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.296005 21056 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:11.301057 16566 debug-util.cc:398] Leaking SignalData structure 0x7b080032c840 after lost signal to thread 16570
I20260709 13:08:11.402439 21201 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.422379 21134 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.422894 21227 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:11.423283 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1d60 after lost signal to thread 16643
W20260709 13:08:11.423607 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08002cde80 after lost signal to thread 16644
I20260709 13:08:11.424273 21201 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.304406 21222 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:10.816330 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:11.303313 20909 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.305768 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2305) took 1181 ms. Trace:
I20260709 13:08:10.865469 21170 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:10.873921 21171 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.304315 20957 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.309309 20674 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.311532 21163 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.309363 21055 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.308939 20767 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.361129 21183 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.330924 17125 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.942062 16362 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 5 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 10 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.331938 16540 rpcz_store.cc:276] 0709 13:08:09.583254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.588894 (+  5640us) service_pool.cc:224] Handling call
0709 13:08:10.946428 (+1357534us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54002062d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:10.946528 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185039232}
I20260709 13:08:11.316982 20925 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.340571 21175 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.343683 21181 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.325003 21174 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.330442 21199 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:11.341971 21167 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.347642 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 688) took 1246 ms. Trace:
I20260709 13:08:11.360477 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:11.043447 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53658 (request call id 734) took 1063 ms. Trace:
W20260709 13:08:10.331327 17126 rpcz_store.cc:269] 0709 13:08:07.973892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.275928 (+302036us) service_pool.cc:224] Handling call
0709 13:08:09.775209 (+1499281us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54007b57d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:09.775338 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375207680}
I20260709 13:08:11.362104 21172 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.366019 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.053624 21185 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:11.370093 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2307) took 1245 ms. Trace:
I20260709 13:08:11.366386 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2303) took 1242 ms. Trace:
I20260709 13:08:11.345386 16509 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:11.329977 21162 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:11.373327 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:11.311331 21025 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.373122 20830 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.101284 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.475481 17124 rpcz_store.cc:276] 0709 13:08:09.980043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.479189 (+499146us) service_pool.cc:224] Handling call
0709 13:08:11.043381 (+564192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.377032 21178 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.478955 21227 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:11.372545 21188 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:11.479463 21002 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:11.381560 16367 rpcz_store.cc:269] 0709 13:07:58.465677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.465869 (+   192us) service_pool.cc:224] Handling call
0709 13:07:58.814499 (+348630us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5400240590. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d9640 00007ffa3d2b0b76 00007ffa3d3bac3e 00007ffa3b87b2a4 00007ffa3b87b232 00007ffa3b87b161 00007ffa3b87b0dc 00007ffa3b87a392 00007ffa3583848c 00007ffa358378c6
0709 13:08:11.090104 (+12275605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:05.614010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:05.830561 (+216551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:05.837243 (+  6682us) write_op.cc:435] Acquired schema lock
0709 13:08:05.845005 (+  7762us) tablet.cc:662] Decoding operations
0709 13:08:06.449933 (+604928us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:06.534503 (+ 84570us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:06.536306 (+  1803us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:08:06.836735 (+300429us) tablet.cc:701] Row locks acquired
0709 13:08:06.837199 (+   464us) write_op.cc:260] PREPARE: finished
0709 13:08:06.837375 (+   176us) write_op.cc:270] Start()
0709 13:08:06.837513 (+   138us) write_op.cc:276] Timestamp: P: 1783602486837311 usec, L: 0
0709 13:08:06.837543 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:06.840462 (+  2919us) log.cc:844] Serialized 9937 byte log entry
0709 13:08:07.240901 (+400439us) op_driver.cc:464] REPLICATION: finished
0709 13:08:07.387838 (+146937us) write_op.cc:301] APPLY: starting
0709 13:08:07.387923 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:07.471433 (+ 83510us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:07.471565 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:07.585681 (+114116us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:07.586065 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:08:07.586117 (+    52us) write_op.cc:312] APPLY: finished
0709 13:08:07.586838 (+   721us) log.cc:844] Serialized 220 byte log entry
0709 13:08:07.587018 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.587668 (+   650us) write_op.cc:454] Released schema lock
0709 13:08:07.587725 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:07.594026 (+  6301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.594057 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261002,"reported_tablets":49,"spinlock_wait_cycles":2455040,"child_traces":[["op",{"apply.queue_time_us":138103,"apply.run_cpu_time_us":37184,"apply.run_wall_time_us":206155,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108577,"num_ops":25,"prepare.queue_time_us":588645,"prepare.run_cpu_time_us":31186,"prepare.run_wall_time_us":1301964,"raft.queue_time_us":186134,"raft.run_cpu_time_us":39895,"raft.run_wall_time_us":133043,"replication_time_us":390166,"thread_start_us":655261,"threads_started":4,"wal-append.queue_time_us":95391,"wal-append.run_cpu_time_us":28762,"wal-append.run_wall_time_us":1653563}]]}
I20260709 13:08:11.389496 21176 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.482147 21176 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:11.390515 16464 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:11.483251 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.484391 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:11.484934 16464 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.485127 21199 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.485253 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.485584 21199 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:11.486451 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.486338 21199 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.486996 16618 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:11.487494 21199 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.487767 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.488466 16618 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:11.095306 21195 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.488893 21195 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.489789 21025 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.489991 21201 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.490461 21177 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:11.490540 21201 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.491073 21195 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.316844 21166 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.315948 21173 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.491573 21167 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.493310 21173 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.493534 21174 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.492611 21201 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.494928 16469 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.495383 21175 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:11.393953 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:11.395073 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 371469us
I20260709 13:08:11.431756 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:11.498649 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:11.499576 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:11.376278 21165 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:08:11.394783 16612 rpcz_store.cc:276] 0709 13:08:10.123173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.349994 (+1226821us) service_pool.cc:224] Handling call
0709 13:08:11.350403 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.350876 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.350916 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:11.351668 (+   752us) log.cc:844] Serialized 52 byte log entry
0709 13:08:11.377730 (+ 26062us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:11.377769 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.377832 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.388555 (+ 10723us) raft_consensus.cc:1685] finished
0709 13:08:11.388572 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.388706 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1085,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":184064,"thread_start_us":25587,"threads_started":1,"wal-append.queue_time_us":34968}
I20260709 13:08:11.187264 21205 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.369796 21159 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.403404 17120 raft_consensus.cc:2410] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:08:11.192432 21215 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:11.390584 21204 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:11.368883 21116 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.557307 16461 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.223829 21157 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.377159 20838 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.421490 21169 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.424348 21134 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.289354 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:11.303246 21049 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.472057 16610 rpcz_store.cc:276] 0709 13:08:10.124428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.756033 (+631605us) service_pool.cc:224] Handling call
0709 13:08:11.305712 (+549679us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:11.472725 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 127421us
I20260709 13:08:11.472121 16613 rpcz_store.cc:276] 0709 13:08:10.123920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.997842 (+873922us) service_pool.cc:224] Handling call
0709 13:08:11.366309 (+368467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.473819 16537 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:11.425732 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:11.471786 16619 rpcz_store.cc:276] 0709 13:08:10.124953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.368967 (+1244014us) service_pool.cc:224] Handling call
0709 13:08:11.369286 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.369819 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.370044 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15744}
I20260709 13:08:11.613871 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.614454 17126 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:11.474535 16615 rpcz_store.cc:276] 0709 13:08:10.118570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.119572 (+  1002us) service_pool.cc:224] Handling call
0709 13:08:11.347589 (+1228017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.476749 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.615494 16463 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:11.616525 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.616803 21230 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.617259 21230 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.617692 21230 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.538167 21174 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:11.477275 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 116885us
W20260709 13:08:11.476460 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48606.8us
I20260709 13:08:11.482283 21226 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:11.491349 21187 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:11.496688 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 123434us
I20260709 13:08:11.500651 16464 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:11.643889 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:11.646119 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:11.421468 21180 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:11.432638 21228 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:11.525110 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:11.663408 16543 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:11.529036 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:11.520802 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.664109 16538 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:11.543111 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:11.544153 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 465836us
I20260709 13:08:11.665115 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:11.402215 21168 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.546453 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 152554us
I20260709 13:08:11.418308 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 690) took 1299 ms. Trace:
I20260709 13:08:11.430261 20906 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:11.421463 20839 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.570408 16541 raft_consensus.cc:1240] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:11.571166 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:11.406750 21231 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.494083 20674 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:11.429203 21221 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:11.424824 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08002734e0 after lost signal to thread 17151
I20260709 13:08:11.614408 17125 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
W20260709 13:08:11.691327 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08002c0f60 after lost signal to thread 17152
I20260709 13:08:11.636802 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:11.619469 17124 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:11.558395 21162 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.546922 20871 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.557622 20848 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.638718 16469 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:11.560334 21188 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.660492 16583 connection.cc:256] RPC call timeout handler was delayed by -1.0639747999999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:08:11.519999 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 88315.8us
I20260709 13:08:11.699926 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.700044 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:11.700608 16610 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:11.666419 16616 rpcz_store.cc:276] 0709 13:08:10.119186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.660396 (+541210us) service_pool.cc:224] Handling call
0709 13:08:11.418160 (+757764us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000d61d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:11.418255 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275102976}
I20260709 13:08:11.701617 16582 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:11.672434 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff880 after lost signal to thread 15321
I20260709 13:08:11.702347 16616 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:11.702548 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2b20 after lost signal to thread 15324
I20260709 13:08:11.697839 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:11.703905 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08000ffb40 after lost signal to thread 16402
W20260709 13:08:11.704380 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4900 after lost signal to thread 16422
I20260709 13:08:11.560945 21173 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.637624 16619 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.658994 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:11.675736 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.676745 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:11.678980 16545 raft_consensus.cc:2410] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:08:11.572331 16540 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:11.685719 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:11.685724 16509 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:11.422010 21220 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.636318 21226 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:11.678611 21180 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:11.663558 21217 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:11.674481 21190 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.421044 21223 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.496322 21171 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.496456 21222 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.496047 21185 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:11.708750 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8d20 after lost signal to thread 16494
I20260709 13:08:11.709830 16615 raft_consensus.cc:1240] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:11.807638 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08000a2c40 after lost signal to thread 16495
I20260709 13:08:11.683091 20837 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.694347 21155 raft_consensus.cc:2764] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:08:11.662772 21201 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:08:11.519259 21170 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.675783 21176 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:08:11.676184 21177 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:08:11.574299 21157 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.817552 21222 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.819681 21157 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.819808 21171 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.820288 21157 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.811581 21175 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:11.718146 21245 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.618788 21169 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.821360 21175 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:11.822671 21175 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.823767 21169 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.694556 21162 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.824559 21162 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.815357 21185 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.826198 21230 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.827747 21170 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:11.755985 21240 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:08:11.828544 21157 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:11.757414 21233 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:08:11.709318 21188 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.697378 20848 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:11.716328 21055 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.558106 21205 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.711796 20839 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:11.713670 21156 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.766012 21049 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.766517 20957 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.766669 21190 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:11.835407 21226 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.847072 21226 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:11.846828 21190 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.847839 21205 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.841799 21156 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.849009 21156 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.767297 21220 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.767593 21163 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.686911 21168 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.767781 21227 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:11.712560 21173 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.853684 21168 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.854595 21173 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.769313 21180 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.771492 21231 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.781806 21166 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.687144 21208 consensus_queue.cc:1059] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:08:11.856184 21208 consensus_queue.cc:1243] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 98881185daee4f13b69385e36026216c log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:11.699314 21235 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:08:11.785744 21164 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:11.857250 21164 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:11.787673 21056 raft_consensus.cc:3055] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.858294 21056 raft_consensus.cc:740] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:11.801326 21172 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.802107 21181 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.694419 21234 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.865561 21234 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.858301 21164 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:11.868566 21164 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:11.803428 21183 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.821182 21245 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.858825 21188 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.842643 21230 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.879980 21245 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.882048 21223 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.884542 21234 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.484514 16362 catalog_manager.cc:5697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 7 to 11, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 11 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.920950 16362 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 7 to 8, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.928438 16362 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.647473 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:11.617305 16463 raft_consensus.cc:2393] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:11.935482 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 287880us
I20260709 13:08:11.937007 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.938824 16463 raft_consensus.cc:2410] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:11.940382 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.941468 16463 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:11.667502 16461 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:11.669201 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:11.718875 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:11.947311 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 228370us
I20260709 13:08:11.715485 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:11.958683 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 243170us
W20260709 13:08:11.694263 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08003929c0 after lost signal to thread 20685
W20260709 13:08:11.793505 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.720621 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 61755.2us
I20260709 13:08:11.806788 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 692) took 1684 ms. Trace:
W20260709 13:08:11.809185 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08003849c0 after lost signal to thread 16569
W20260709 13:08:12.010596 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 217198us
W20260709 13:08:12.010839 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001de4e0 after lost signal to thread 16570
I20260709 13:08:12.011049 20919 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:11.806696 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 141644us
W20260709 13:08:12.014395 16566 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3540 after lost signal to thread 21007
W20260709 13:08:12.015753 16566 debug-util.cc:398] Leaking SignalData structure 0x7b0800313580 after lost signal to thread 21079
I20260709 13:08:11.795135 20767 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.769765 20830 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.017583 21168 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.018157 21168 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.018582 21168 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.018772 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.019381 20830 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.768823 20838 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.812390 20837 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.024019 20837 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:12.025146 16611 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:11.836038 20848 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.785413 20871 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:11.709367 20906 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:11.781806 20909 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.797209 20925 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.802644 21116 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.814847 21155 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:11.830946 21157 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:11.864805 21172 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.026165 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.031309 20871 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.031826 20871 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:12.032827 20925 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:11.970413 21203 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.034585 21203 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.035552 20925 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:12.027734 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.037321 17124 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:12.038468 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.030015 21155 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.002605 21181 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.005400 21230 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.005767 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.006881 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2301) took 1843 ms. Trace:
I20260709 13:08:12.006623 21183 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:12.008333 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.008138 21163 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:12.009234 21208 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:12.009946 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.009994 20957 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:12.016029 21190 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:12.016983 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:11.837278 20839 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.966957 16436 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.084597 20839 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:12.084798 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 140365us
I20260709 13:08:12.087224 16462 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:12.020545 20830 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.026944 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:12.075505 16640 debug-util.cc:398] Leaking SignalData structure 0x7b0800352c60 after lost signal to thread 16643
W20260709 13:08:12.088333 16640 debug-util.cc:398] Leaking SignalData structure 0x7b0800115200 after lost signal to thread 16644
I20260709 13:08:12.025583 16617 rpcz_store.cc:276] 0709 13:08:10.122394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.012891 (+890497us) service_pool.cc:224] Handling call
0709 13:08:11.020486 (+  7595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.495303 (+474817us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:11.495541 (+   238us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.804957 (+309416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.805008 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.805047 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.805596 (+   549us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540025d354. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:11.805636 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.806730 (+  1094us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107265,"prepare.queue_time_us":545,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":108569,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4311,"spinlock_wait_cycles":1091477376,"thread_start_us":201419,"threads_started":1,"wal-append.queue_time_us":294234}
W20260709 13:08:12.078116 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63128.3us
I20260709 13:08:12.078310 21183 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.078444 16463 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:12.070735 21249 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:12.082231 16461 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:12.029899 20906 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:12.080163 21173 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.121750 21162 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.087512 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.124907 21203 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:11.932741 16362 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 11 to 12, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 12 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:12.126964 21155 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.127940 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:12.128865 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 89064.6us
I20260709 13:08:12.053372 16614 rpcz_store.cc:276] 0709 13:08:10.123426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.350159 (+1226733us) service_pool.cc:224] Handling call
0709 13:08:11.369244 (+ 19085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:11.369552 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.369580 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.370007 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.376000 (+  5993us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:11.376037 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.376095 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.966206 (+590111us) raft_consensus.cc:1685] finished
0709 13:08:11.966254 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.966590 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1620,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":3792,"spinlock_wait_cycles":1408,"thread_start_us":5699,"threads_started":1,"wal-append.queue_time_us":147962}
I20260709 13:08:12.129528 21226 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.093276 21183 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:12.093120 20830 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.130290 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.088238 20957 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:12.145982 21162 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.146925 16467 raft_consensus.cc:1240] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.146622 20957 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:12.116971 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 61789.8us
I20260709 13:08:12.145046 17122 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:12.149919 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62593.6us
I20260709 13:08:12.151392 16461 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:08:12.152962 21190 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:12.161199 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001e82c0 after lost signal to thread 17151
W20260709 13:08:12.161545 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae760 after lost signal to thread 17152
I20260709 13:08:12.149857 21116 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.148391 20830 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.144049 21226 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.165089 16463 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:12.162642 17118 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
W20260709 13:08:12.168531 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001c13e0 after lost signal to thread 20260
I20260709 13:08:12.166254 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.170948 21055 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:12.171947 21055 consensus_queue.cc:1243] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:12.173493 16469 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:08:12.178970 16469 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:12.153996 21190 consensus_queue.cc:1059] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:08:12.182379 16536 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.189474 21170 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.190057 21170 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:12.182798 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.191377 16540 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:12.183148 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.193003 16539 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:12.194422 20909 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:12.194901 20909 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:12.194757 20906 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.196069 20909 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.199293 21173 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:12.199779 21173 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.201210 16464 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:12.201938 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2223) took 1078 ms. Trace:
I20260709 13:08:12.184238 21250 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.205246 21250 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.205626 21188 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.206214 21188 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:12.084160 21056 consensus_queue.cc:260] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.208210 21056 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.209414 21183 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.211249 21183 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.211856 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2304) took 2087 ms. Trace:
I20260709 13:08:12.185168 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.186159 16362 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 7 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 10 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.190605 21170 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.205802 21250 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.184145 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:12.178720 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51180.7us
W20260709 13:08:12.228973 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.212311 16611 rpcz_store.cc:276] 0709 13:08:10.124194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.355866 (+1231672us) service_pool.cc:224] Handling call
0709 13:08:11.373578 (+ 17712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.025687 (+652109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.211531 (+185844us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003e7454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.211782 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497167104}
W20260709 13:08:12.218295 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 95379.5us
I20260709 13:08:12.213688 16464 rpcz_store.cc:276] 0709 13:08:11.123914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.936099 (+812185us) service_pool.cc:224] Handling call
0709 13:08:12.184274 (+248175us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800000f98. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4d6fc0 00007ffa3c4c1929 00007ffa3c4c13d2 00007ffa35a38bd4
0709 13:08:12.184546 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.201644 (+ 17098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.201858 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30009728}
I20260709 13:08:12.197680 20909 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.166761 21226 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.188119 21169 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:12.245221 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:12.245646 16545 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:12.243027 16511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.003s	sys 0.014s
W20260709 13:08:12.247238 16511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.003s	sys 0.014s
I20260709 13:08:12.240375 16468 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:12.245280 16536 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:12.201713 21156 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.154393 21230 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.246886 16613 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.253896 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:12.255529 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.250705 21163 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.260015 21163 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.260288 20871 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.260915 16542 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:12.262338 20871 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.247251 21207 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.263134 21207 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.263584 21207 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.264851 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2222) took 1098 ms. Trace:
I20260709 13:08:12.257143 21203 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.265815 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.265348 16466 rpcz_store.cc:276] 0709 13:08:11.123668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.654493 (+530825us) service_pool.cc:224] Handling call
0709 13:08:11.686898 (+ 32405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.937905 (+251007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:11.938020 (+   115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.938130 (+   110us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:11.938194 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.212988 (+274794us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54000b3954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.213041 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.222408 (+  9367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575477504}
I20260709 13:08:12.267731 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.256637 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:12.265746 21203 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.262390 21163 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:12.263247 16640 debug-util.cc:398] Leaking SignalData structure 0x7b08001a4da0 after lost signal to thread 20913
I20260709 13:08:12.268723 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:12.290964 17122 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.267760 16466 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:12.294090 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.307252 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:12.315958 16640 debug-util.cc:398] Leaking SignalData structure 0x7b080016bb00 after lost signal to thread 20917
I20260709 13:08:12.291563 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.290761 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2308) took 2165 ms. Trace:
W20260709 13:08:12.311786 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 52979.6us
W20260709 13:08:12.316339 16640 debug-util.cc:398] Leaking SignalData structure 0x7b080016bb20 after lost signal to thread 20918
I20260709 13:08:12.281253 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.273890 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.274627 21231 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.275132 21177 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.276918 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2224) took 1010 ms. Trace:
I20260709 13:08:12.304916 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.319448 21177 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.274338 21205 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.321090 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.320984 21205 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:12.305419 21256 log.cc:927] Time spent T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:12.274101 20767 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.322012 21177 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:12.322829 21177 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.322569 20767 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.303671 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.306229 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.323393 21205 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.316808 16613 rpcz_store.cc:276] 0709 13:08:10.125183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.612693 (+1487510us) service_pool.cc:224] Handling call
0709 13:08:11.675087 (+ 62394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.264860 (+589773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.290449 (+ 25589us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.290681 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307726592}
I20260709 13:08:12.323884 16615 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.319676 16462 rpcz_store.cc:276] 0709 13:08:11.266794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.289101 (+ 22307us) service_pool.cc:224] Handling call
0709 13:08:12.276693 (+987592us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002a71d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:12.276864 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746832640}
I20260709 13:08:12.318663 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:12.319211 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.310083 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:12.318289 16640 debug-util.cc:398] Leaking SignalData structure 0x7b080016bba0 after lost signal to thread 20952
I20260709 13:08:12.300230 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2214) took 1180 ms. Trace:
W20260709 13:08:12.318809 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45063.7us
I20260709 13:08:12.323927 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.277199 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:12.351126 16616 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:12.357004 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88399.5us
I20260709 13:08:12.350528 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.306031 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.307943 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.348198 16545 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:12.292323 21203 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.372256 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.277990 21156 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.293653 21230 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.381989 17124 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.311151 21188 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.383013 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.383591 21188 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.384290 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:12.384900 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.387573 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:12.308056 21207 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.389055 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2208) took 1278 ms. Trace:
I20260709 13:08:12.389246 20848 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.390682 21207 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.389504 16470 rpcz_store.cc:276] 0709 13:08:11.089596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.091040 (+  1444us) service_pool.cc:224] Handling call
0709 13:08:11.091373 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:11.558452 (+467079us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:11.618176 (+ 59724us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.191406 (+573230us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.301995 (+110589us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:12.302841 (+   846us) log.cc:844] Serialized 52 byte log entry
0709 13:08:12.302999 (+   158us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:12.303048 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.303766 (+   718us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b5400357fd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.303813 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.349571 (+ 45758us) raft_consensus.cc:1685] finished
0709 13:08:12.349594 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.367618 (+ 18024us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235195,"prepare.queue_time_us":56564,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":133350,"raft.run_cpu_time_us":685,"raft.run_wall_time_us":63316,"spinlock_wait_cycles":1072721280,"thread_start_us":499318,"threads_started":1,"wal-append.queue_time_us":629205}
I20260709 13:08:12.391393 20848 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.313149 21226 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.392627 20767 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.392879 21163 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.393317 21163 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:12.393733 21163 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.346828 21177 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.393942 21226 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.394225 21177 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.298197 20839 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.347759 16465 rpcz_store.cc:276] 0709 13:08:11.119609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.119773 (+   164us) service_pool.cc:224] Handling call
0709 13:08:11.125149 (+  5376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.635254 (+510105us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:11.675348 (+ 40094us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.297942 (+622594us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b180020cfe0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:08:12.298435 (+   493us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.298641 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.298713 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:12.298784 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.299848 (+  1064us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b540037a854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.299888 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.300046 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7942,"prepare.queue_time_us":46753,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":143753,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":1177582208,"thread_start_us":460881,"threads_started":1,"wal-append.queue_time_us":487255}
I20260709 13:08:12.396467 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.397042 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:12.398365 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.399541 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.400028 20839 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.400238 17122 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:12.403218 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 45897.7us
I20260709 13:08:12.405254 17118 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:12.406314 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.407086 17118 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.407864 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.408300 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.414822 21203 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:12.415359 20839 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.417186 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.418164 16541 raft_consensus.cc:2410] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:12.419178 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.419448 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.420455 16538 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.420698 17121 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.420588 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.419524 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.422559 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.423128 17121 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:12.423206 16541 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:12.421571 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.423911 16543 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:12.423681 21177 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.424736 21203 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.273249 16362 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 7 to 11, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:12.425309 21203 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.427479 21203 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.426698 16362 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 8 to 9, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 9 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:12.428300 21177 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:12.279981 21175 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:08:12.430327 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.431322 16539 raft_consensus.cc:2393] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.433250 17119 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.434607 20839 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.435007 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.435802 17119 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:12.430316 16362 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 6 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:12.448634 21163 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.451433 21163 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.454131 16362 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 5 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.460976 16618 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:12.465193 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.466472 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.467599 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.294605 21176 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.200s
I20260709 13:08:12.436614 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.468739 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.424556 17121 raft_consensus.cc:1240] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:08:12.473021 16640 debug-util.cc:398] Leaking SignalData structure 0x7b080016bda0 after lost signal to thread 21072
I20260709 13:08:12.382052 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.483081 17123 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:12.482662 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 596) took 1102 ms. Trace:
I20260709 13:08:12.480486 17124 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:12.271158 21168 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.498335 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.499197 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.501991 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.473948 21208 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.505209 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.460372 21173 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.473839 16362 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.510476 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:12.511081 16539 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.513064 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.513177 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.513878 16470 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:12.514869 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.515552 16465 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:12.507941 21188 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.517329 21188 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.511638 16362 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 5 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 10 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.520226 21188 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:12.524200 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.510517 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.484254 16461 rpcz_store.cc:276] 0709 13:08:11.380635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.152454 (+771819us) service_pool.cc:224] Handling call
0709 13:08:12.152922 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.153275 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:08:12.153659 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.348923 (+195264us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.370181 (+ 21258us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.370387 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.370429 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:12.411493 (+ 41064us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b18002c3ce0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:12.412212 (+   719us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18002c3ce0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:12.482419 (+ 70207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.482496 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.482604 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66150,"prepare.queue_time_us":12738,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":110,"raft.queue_time_us":20122,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":19940352,"thread_start_us":193123,"threads_started":1}
I20260709 13:08:12.527642 17123 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:12.538865 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.539712 17124 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 8: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:12.541167 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.542557 21175 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:12.543851 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:12.545975 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 268911us
I20260709 13:08:12.540488 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:12.550612 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.552104 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.555094 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:12.555222 17125 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:12.529664 21181 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.562269 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.567675 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:12.569588 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70488.3us
I20260709 13:08:12.573666 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.575472 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.576642 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.576707 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.577860 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.578104 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.578239 21116 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:12.578763 16469 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:12.578869 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.579474 21116 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:12.579682 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.579886 21116 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:12.580017 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.580818 16612 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:12.580900 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.579996 16464 raft_consensus.cc:2410] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:08:12.582180 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.576915 21234 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:12.583248 21234 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.583622 21234 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.586462 20830 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.578857 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.594343 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:12.602962 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.604455 16618 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:08:12.606047 16465 raft_consensus.cc:2410] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:08:12.606276 16611 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:12.604048 16619 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:12.560783 21181 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:12.631564 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.637425 16461 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:12.641088 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73844.4us
W20260709 13:08:12.641726 21164 consensus_meta.cc:287] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.007s
I20260709 13:08:12.644474 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:12.647171 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.654511 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.634074 21181 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.662369 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:12.653797 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83388.7us
I20260709 13:08:12.638360 20830 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:12.666528 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.657861 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:12.674302 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.680112 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.681265 16461 raft_consensus.cc:2410] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:08:12.676270 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.685832 16536 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:08:12.665858 21163 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.685874 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.596781 21116 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.642910 21170 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.687891 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.697016 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.694571 16543 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:12.668915 21205 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:12.700889 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:12.695159 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56860.8us
I20260709 13:08:12.691304 21231 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.714653 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.721715 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.724169 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.725428 16461 raft_consensus.cc:2410] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:08:12.727339 16467 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:12.734768 17123 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:12.734155 16436 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.708372 20830 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:12.740576 16540 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:12.697569 20909 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:08:12.718911 21164 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.729032 21173 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:12.755386 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67592.9us
I20260709 13:08:12.756176 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.764297 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.766563 17123 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
W20260709 13:08:12.765080 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47801.2us
I20260709 13:08:12.774212 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.752095 21207 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.778714 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.733006 21205 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.783563 16536 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:12.776669 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.751818 21164 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.755688 21116 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:12.787586 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:12.738138 21163 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:12.801606 21276 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:12.803098 21163 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.804096 21205 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.777222 21226 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.805027 21226 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:12.805603 21226 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.789659 21164 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.809474 16540 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:12.775070 21230 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:12.780148 21183 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.566s	user 0.000s	sys 0.014s
I20260709 13:08:12.820837 16463 raft_consensus.cc:2410] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:12.789372 20830 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:12.834303 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:12.835547 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 79450.4us
I20260709 13:08:12.838331 16461 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:08:12.839538 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47976.1us
I20260709 13:08:12.818454 21230 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.842022 16433 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.847011 16536 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:12.849958 21267 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:08:12.851970 21170 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.855450 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2229) took 1428 ms. Trace:
I20260709 13:08:12.855837 16467 rpcz_store.cc:276] 0709 13:08:11.427493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.275856 (+848363us) service_pool.cc:224] Handling call
0709 13:08:12.276189 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.731720 (+455531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.855170 (+123450us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003b9554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:12.855378 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037016320}
I20260709 13:08:12.884080 16544 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:12.869259 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.885574 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.848551 21230 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:12.912750 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66520.2us
I20260709 13:08:12.913177 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:12.913461 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:12.885524 20830 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.913803 16543 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
W20260709 13:08:12.930163 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 88241.2us
I20260709 13:08:12.931267 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.933049 21171 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:12.936270 21250 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.007s
I20260709 13:08:12.940099 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:12.940940 16467 raft_consensus.cc:2376] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 14. Re-sending same reply.
I20260709 13:08:12.941112 21236 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:12.941604 21236 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.941948 21236 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.942109 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.943636 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.945231 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.870338 21170 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.951908 21164 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.886427 21234 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:12.954655 21234 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:12.915746 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 89054.7us
I20260709 13:08:12.963480 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:12.965157 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:12.963322 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 238581us
I20260709 13:08:12.981190 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.956558 21183 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:12.989403 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:12.994073 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 154008us
I20260709 13:08:12.996718 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.970129 21168 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:12.969280 21171 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.999895 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:13.015014 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:13.015650 17122 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.018363 16610 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:13.021113 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.022501 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.023428 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.023595 21055 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:13.024729 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.024962 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.025537 16616 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.025871 21164 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.027046 21181 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:12.993116 21183 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.994813 21205 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.029515 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:12.957734 21250 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.025537 16613 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:13.020602 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:12.987756 21170 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:13.032639 16618 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.042725 17127 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:13.044970 16539 consensus_meta.cc:287] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.007s
I20260709 13:08:13.047144 16539 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:13.046656 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:13.091121 16610 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:13.092569 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 86765.5us
I20260709 13:08:13.014647 20909 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.047984 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.050094 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:13.094758 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 249525us
I20260709 13:08:13.034147 21183 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.045622 20839 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.130889 17118 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:13.131760 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 114802us
I20260709 13:08:13.115128 20909 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.145071 16615 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
W20260709 13:08:13.152170 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.124686 21181 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.150465 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:13.154970 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.163856 16616 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:13.147128 20909 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.166093 21250 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.166278 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:13.167706 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.169245 21234 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.170078 21234 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.171782 21234 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:13.173678 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.174794 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.175599 16613 raft_consensus.cc:2410] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:13.176352 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.177366 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.178506 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.179272 20848 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:13.179491 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.182546 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.183830 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.187136 21234 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:13.193105 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 161781us
I20260709 13:08:13.197054 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:13.198989 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63959.9us
I20260709 13:08:13.210809 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:13.211372 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.208827 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 90422.1us
I20260709 13:08:13.180511 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.209023 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.216754 17122 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:13.195413 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.218393 16615 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:13.147732 21170 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:13.220331 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.222195 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.221968 16610 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:13.193610 21204 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:13.228629 16612 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
W20260709 13:08:13.188666 21257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.013s
I20260709 13:08:13.229404 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.129770 21205 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.230908 21204 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:13.231314 21173 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.231485 20767 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.237464 21250 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:13.238879 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:13.239574 16468 raft_consensus.cc:2368] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:13.239490 21250 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:13.240175 21250 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:13.247568 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:13.249608 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:13.250986 21181 consensus_queue.cc:1059] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:13.251418 16463 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:13.252080 21181 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:13.252452 21181 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:13.253203 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:13.248639 17120 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:13.233301 16511 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.235118 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.134992 20839 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.257799 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.234365 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.265281 20767 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.265749 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.266009 16434 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:13.266608 20767 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.267208 16434 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.268055 21188 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.268471 21188 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:13.268890 21188 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.270057 21173 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:13.272938 21289 log.cc:927] Time spent T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:08:13.273258 21226 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.255273 21257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.011s	sys 0.013s
I20260709 13:08:13.274336 21250 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.274757 20767 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.275516 21226 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.275672 21250 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.276587 21181 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.277885 21181 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:13.279060 21164 consensus_queue.cc:1175] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98881185daee4f13b69385e36026216c" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:13.279378 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:13.281524 16468 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:13.281611 20767 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:13.284729 20767 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.286960 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.293291 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:13.294588 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.295363 21234 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.295823 21234 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.296209 21234 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.296906 21236 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.287083 20767 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.236323 20909 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.299355 21236 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:13.299444 20909 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:13.299576 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.300146 16464 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:13.300293 16540 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:13.300552 16462 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:13.301296 16542 raft_consensus.cc:1240] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:13.301568 16539 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:13.303038 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.283607 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:13.281960 21164 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.295504 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.300320 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.310163 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.310472 16618 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:13.314106 16544 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:08:13.313989 20909 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.320252 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.320799 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:13.321470 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.321785 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:13.324980 16545 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:13.325476 16540 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:13.325987 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.320448 20848 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.326457 16613 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:13.327109 20848 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:13.327579 20848 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.327714 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.332998 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.325356 16583 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:13.296916 21257 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.335464 21164 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.342684 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:13.342445 21203 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:13.342425 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 47920.1us
I20260709 13:08:13.347532 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.348623 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.344027 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.344707 16613 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:13.344506 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.343317 16618 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:13.355042 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.356492 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.359267 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.369761 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:13.370965 16610 raft_consensus.cc:2393] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:13.373749 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:13.374838 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 164120us
I20260709 13:08:13.375048 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.375873 16613 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:13.381037 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.381212 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.382716 16616 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:13.381958 16543 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:13.389086 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.400386 16433 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:13.402247 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 54785.1us
I20260709 13:08:13.397920 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.398244 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.400636 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.364940 21175 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.405489 16434 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:13.403810 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 78577.4us
I20260709 13:08:13.408026 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.378605 21236 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.382300 21207 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.389314 21171 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.409363 21175 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:13.407567 21163 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.412499 21175 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.414978 21250 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.415428 21250 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:13.415808 21250 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.234398 21204 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.417002 21226 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:13.417333 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.417586 21226 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:13.418695 21226 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.419062 16583 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.420377 21208 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.422708 21171 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:13.390538 21203 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:13.461742 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60141.5us
W20260709 13:08:13.464802 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59392.7us
I20260709 13:08:13.465638 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:13.466739 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:13.417429 21204 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.484130 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:13.484658 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 79269.6us
I20260709 13:08:13.483376 21163 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.488250 21163 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.488679 21163 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.468045 20871 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.501221 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.498307 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.508368 16544 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:13.478588 20839 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:13.526793 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 60116.7us
I20260709 13:08:13.529860 21205 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.508977 21055 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:13.531240 21055 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:13.531709 21055 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.505038 20957 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.533515 21203 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.534052 20909 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.534756 20909 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.506330 21116 consensus_meta.cc:287] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.002s
I20260709 13:08:13.537950 21116 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:13.538502 21116 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.545357 21293 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:08:13.546651 21183 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.548290 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:13.549914 21230 consensus_meta.cc:287] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.615s	user 0.004s	sys 0.006s
I20260709 13:08:13.549613 21056 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:13.550441 21230 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.547586 20909 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.554141 16462 raft_consensus.cc:2410] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:13.474560 21208 consensus_queue.cc:1059] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:13.540558 21116 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.474328 21176 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:13.509055 21294 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.576845 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.578660 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:13.579627 16617 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.579880 16614 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.578755 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.580644 16615 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:13.582345 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.553598 21231 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.554791 21183 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:13.601081 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 290601us
I20260709 13:08:13.532594 21163 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.623579 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75350.2us
I20260709 13:08:13.624580 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:13.575672 21234 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.627187 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.579478 21175 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.556273 21171 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.621549 21300 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:13.555378 21230 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.645411 16540 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:13.591992 21294 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.638681 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 143015us
I20260709 13:08:13.675371 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.675704 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.675856 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.679430 16613 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:13.680331 16536 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:13.680609 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57307us
I20260709 13:08:13.681510 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.641417 21300 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:13.689530 16434 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:08:13.693011 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 68527.8us
I20260709 13:08:13.642088 21164 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.673533 21236 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.701610 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.677201 20767 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.708534 21180 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:13.709043 21180 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:13.709426 21180 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.709985 20767 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:13.713478 21163 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:13.714290 21295 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:08:13.714406 21175 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:13.729249 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:13.730793 16536 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:13.737273 16436 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:13.742542 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:13.729436 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.717609 21230 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.753135 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2024) took 1056 ms. Trace:
I20260709 13:08:13.775918 21156 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.776167 16614 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:13.776717 21156 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:13.778371 21175 raft_consensus.cc:2764] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:13.781185 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.685851 20848 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.782618 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.783243 16540 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.783988 20848 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.786022 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.786635 16545 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.789136 20845 raft_consensus.cc:3055] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:13.789579 20845 raft_consensus.cc:740] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:13.790441 20845 consensus_queue.cc:260] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.791728 20845 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:13.794901 21300 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.796231 21300 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.797130 21314 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:13.797747 21314 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.799010 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.801744 21314 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.804337 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.804800 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.805135 16538 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:13.806314 21164 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:13.807022 21164 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.806064 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.808028 21170 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:13.808674 21170 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.809028 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.812177 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:13.739526 21302 log.cc:927] Time spent T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
I20260709 13:08:13.729671 21307 consensus_queue.cc:1059] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.126s
I20260709 13:08:13.835549 16540 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:13.819296 16436 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:13.841084 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 159659us
I20260709 13:08:13.911293 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.753690 16541 rpcz_store.cc:276] 0709 13:08:12.667937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.668065 (+   128us) service_pool.cc:224] Handling call
0709 13:08:12.683064 (+ 14999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.718506 (+ 35442us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:12.999682 (+281176us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.402141 (+402459us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.479715 (+ 77574us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.479884 (+   169us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:13.480131 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 13:08:13.486734 (+  6603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.486959 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.724430 (+237471us) raft_consensus.cc:1685] finished
0709 13:08:13.724461 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.724665 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31098,"prepare.queue_time_us":513864,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":43343,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":22631,"thread_start_us":518286,"threads_started":2,"wal-append.queue_time_us":557432}
W20260709 13:08:13.883841 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 382693us
I20260709 13:08:13.747049 21234 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:13.913605 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 101507us
I20260709 13:08:13.735922 21188 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:13.742818 20871 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.807597 21294 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.928004 21314 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:13.730033 21304 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.703995 21236 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.892305 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:13.904686 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 93095us
I20260709 13:08:13.904282 21313 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.902165 16617 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:13.852386 21173 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.914351 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:13.942452 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:13.811584 21230 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.943450 21230 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.943928 21230 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.807538 21164 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:13.885059 21175 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.948349 21175 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:13.948876 21175 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.922104 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:13.952688 21234 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.953562 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.956151 16511 leader_election.cc:400] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:13.956465 16511 leader_election.cc:403] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.956969 20767 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:13.926955 21168 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:13.958432 21168 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:13.927400 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 108208us
I20260709 13:08:13.962843 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:13.963500 21164 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.927470 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:13.964473 16539 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:13.965574 21168 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:13.929306 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.930765 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:13.966912 16538 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.854229 21181 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:08:13.891351 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:13.965596 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:13.902801 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 195019us
I20260709 13:08:13.972950 21301 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:13.973522 21301 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:13.973959 21301 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:13.977134 21172 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:13.978255 21172 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:13.978677 21172 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:13.979063 21172 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:13.996233 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:14.006587 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.012319 16436 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:13.743140 21250 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:14.013653 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 160348us
I20260709 13:08:13.928970 21319 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.020112 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.029214 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.029790 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.029808 16541 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.032351 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:14.038676 16465 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:14.041049 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.041198 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:14.042374 16462 raft_consensus.cc:2410] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:13.921749 21055 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.020983 16538 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:13.995213 21314 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:14.022351 21176 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:14.060559 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 131322us
I20260709 13:08:14.014715 21294 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:14.028443 21183 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.051282 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.064209 16470 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.052596 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.065512 16465 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.049788 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:14.064265 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44211us
I20260709 13:08:14.041698 16537 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:14.061676 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.062130 21257 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:14.051702 16434 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.010831 20906 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:14.070087 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.070679 16540 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:14.071534 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.072127 16617 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:14.028718 21324 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.073167 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.069434 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.073740 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:14.076861 16544 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.048288 21164 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.045385 20957 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.050617 21170 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.060993 21176 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.016731 21322 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:08:14.080545 16538 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.088294 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.081198 21177 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.005867 21313 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.072489 21116 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.096735 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.075198 20906 consensus_queue.cc:1243] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:14.100980 21250 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:14.075536 21163 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:14.106320 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:14.092672 21176 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.118863 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.090401 21319 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.113932 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.094532 21170 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:14.115382 16464 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
W20260709 13:08:14.112658 21204 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.001s
I20260709 13:08:14.097070 21226 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:14.101981 21171 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.129073 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.122897 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.097328 20957 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.134196 16538 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:14.086473 21294 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.113404 20767 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12.
I20260709 13:08:14.136404 20848 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.146711 21156 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:14.146924 20848 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:14.147887 20848 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.148624 21208 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:14.149092 20848 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.150530 21236 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.152477 21294 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.157073 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:14.157737 16462 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 7.
I20260709 13:08:14.159125 21055 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:14.159368 21306 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.376s	user 0.003s	sys 0.000s
I20260709 13:08:14.160976 21188 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.161418 21226 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.163479 21226 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.140237 21314 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.136670 21180 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.171320 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:14.168529 16542 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:14.174420 16470 raft_consensus.cc:2468] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
W20260709 13:08:14.178617 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 126975us
I20260709 13:08:14.179723 16541 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:14.156173 21230 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:14.188640 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 115009us
I20260709 13:08:14.192404 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.129073 21181 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.121136 21163 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.218883 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.092993 21257 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.183300 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:14.220016 16470 raft_consensus.cc:2393] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:14.132480 21330 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.227530 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.220651 16463 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.137192 20957 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.180703 21156 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:14.149094 21208 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:14.222777 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 208374us
I20260709 13:08:14.230347 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:14.236954 16461 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:14.231410 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.226449 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.234540 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:14.240370 16544 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:14.243469 16469 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:14.237547 17127 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 8.
I20260709 13:08:14.244032 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.188436 21183 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:14.245078 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 272497us
I20260709 13:08:14.245518 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.220878 21181 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.243813 16469 pending_rounds.cc:85] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 6
I20260709 13:08:14.249830 16470 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.251112 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.228331 21171 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:14.253634 16466 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:08:14.254837 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.228029 21330 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:14.248986 16469 pending_rounds.cc:107] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:14.292119 16469 raft_consensus.cc:2889] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.265362 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.243127 21226 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.253090 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.268307 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:14.297974 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:14.316032 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.316320 16468 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:14.316745 17122 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.288348 16466 pending_rounds.cc:85] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 7
W20260709 13:08:14.318269 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 146988us
I20260709 13:08:14.313419 16541 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:14.319381 16465 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:14.264977 16509 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.318661 16466 pending_rounds.cc:107] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:14.320555 16466 raft_consensus.cc:2889] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.314445 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.300633 16461 raft_consensus.cc:2368] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
I20260709 13:08:14.245385 20957 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.324168 16538 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:14.325520 16542 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.251956 21181 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.330032 16542 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.331598 17120 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.332569 16539 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:14.333942 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 69085.2us
W20260709 13:08:14.336597 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 80320.2us
I20260709 13:08:14.343402 16468 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:08:14.343868 16468 pending_rounds.cc:85] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 6
I20260709 13:08:14.251609 21301 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:14.320896 16511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 1.590s (SENT) [suppressed 12 similar messages]
I20260709 13:08:14.325947 20957 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.344156 16468 pending_rounds.cc:107] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:08:14.299103 21330 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:14.345543 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 92538.1us
I20260709 13:08:14.361816 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.347961 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.348256 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.348879 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.362800 16538 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:08:14.348971 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:14.349175 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:14.364223 16613 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:14.327180 21337 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.350407 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:14.350724 20845 consensus_meta.cc:287] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 13:08:14.358790 16468 raft_consensus.cc:2889] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.364845 16461 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.364781 16541 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.335427 21332 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:14.369123 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 117761us
I20260709 13:08:14.342835 21207 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:14.372414 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 8 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.375564 16469 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:14.380869 17122 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:14.381218 17127 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:08:14.318358 21171 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.360913 20957 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.383810 16619 raft_consensus.cc:2410] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:08:14.383872 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.384666 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.393257 17119 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.394677 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.397889 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:14.405222 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84360.4us
I20260709 13:08:14.380499 21207 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.407399 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.410003 16544 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:14.410256 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.411397 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.412236 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.413502 20845 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.413932 20845 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:14.414888 20845 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.415962 20845 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.392024 21250 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:08:14.417171 21176 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.417668 16614 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.419818 16538 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:14.421030 21338 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:14.421916 21311 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.614s	user 0.000s	sys 0.004s
I20260709 13:08:14.421868 21301 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.372360 21172 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.423353 21230 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.372655 21156 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.363319 21175 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.416844 21319 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.383502 21313 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.335956 21208 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.423369 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2042) took 1032 ms. Trace:
I20260709 13:08:14.385419 21226 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:14.434059 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.424292 21304 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:14.385507 21183 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.437079 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:14.399398 21294 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:14.461459 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.468465 16615 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:14.412177 21207 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:14.462028 16544 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:14.462388 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.434361 21314 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.468420 16538 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:14.470583 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 45227.5us
I20260709 13:08:14.461604 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.488227 16462 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:14.488987 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.489861 16611 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:14.489760 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50702.7us
I20260709 13:08:14.463721 16543 rpcz_store.cc:276] 0709 13:08:13.391227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.391393 (+   166us) service_pool.cc:224] Handling call
0709 13:08:13.391684 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.422676 (+ 30992us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:13.422710 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.423146 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.678900 (+255754us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:13.678941 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.679003 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.233018 (+554015us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:14.423091 (+190073us) raft_consensus.cc:1685] finished
0709 13:08:14.423115 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.423312 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":75945216,"thread_start_us":255410,"threads_started":1,"wal-append.queue_time_us":354625}
W20260709 13:08:14.495760 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.462371 21250 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.467967 21168 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:14.462567 21230 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:14.514206 21336 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.514709 21341 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:08:14.515462 21331 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:14.521529 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60038us
I20260709 13:08:14.522581 16538 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:14.438074 21188 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:08:14.531450 16543 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.533456 21203 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.470155 21304 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:14.485211 21314 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.489773 21208 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.541553 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:14.543391 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 110013us
I20260709 13:08:14.493624 21294 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:14.516753 21168 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:14.566855 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.570225 16470 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.569630 16543 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:14.573704 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.544696 21176 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:14.469671 21337 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:08:14.547238 21314 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.544479 21163 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.547986 21304 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.583177 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.585711 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.548081 21250 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:14.587101 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.597637 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.543746 21230 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.603061 21356 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:14.603700 21356 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.605157 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:14.605672 21342 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:08:14.606473 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:14.607180 21360 consensus_queue.cc:1059] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:14.608348 16469 raft_consensus.cc:2410] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:08:14.614740 21358 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.596460 21168 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.619019 21168 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.620376 21362 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.620982 21362 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.628350 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:14.631397 16464 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:14.633694 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.641268 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.592572 21172 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.645430 17125 raft_consensus.cc:1240] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:14.647225 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60050.1us
I20260709 13:08:14.650424 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.650554 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.650924 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.651202 17121 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.651651 17125 raft_consensus.cc:2368] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:14.651738 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:14.652189 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 180021us
I20260709 13:08:14.653046 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.653877 21359 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:14.655366 16511 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:14.656049 21359 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.656451 21359 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.656800 21359 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.659574 17121 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:14.665421 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.581766 21226 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.666707 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.667143 17093 leader_election.cc:400] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11.
W20260709 13:08:14.680397 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.688237 16543 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.694924 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.696491 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.666332 21234 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.645936 21171 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:14.700655 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 125449us
I20260709 13:08:14.703567 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.681751 21175 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:14.705201 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.692616 21203 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.625609 21294 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.700045 21163 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:14.710847 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 62710.2us
I20260709 13:08:14.682476 21362 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.716854 21234 raft_consensus.cc:2764] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:14.718348 21349 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:14.721104 21345 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.722450 21356 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.723657 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.722623 21163 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.724259 16543 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.724526 21163 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.727543 21207 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.730901 21207 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.737478 17119 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:14.739667 17126 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:14.742753 21230 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.744304 20845 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.744710 20845 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:14.745635 20845 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.746820 20845 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.664618 21359 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.756035 16619 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.751573 16615 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.752292 16583 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.758225 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.750864 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:14.760082 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.761582 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.764001 21332 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:14.764793 21176 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:14.765419 21176 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:14.766417 21176 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.735427 21175 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.768148 21175 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:14.772074 21339 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:14.772958 20919 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.773891 21208 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:14.774883 21340 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:14.776470 16613 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
W20260709 13:08:14.757803 21164 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.007s	sys 0.010s
W20260709 13:08:14.750764 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47251us
I20260709 13:08:14.784291 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.784634 16536 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:14.785382 21359 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.785382 21373 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.786125 21338 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.786689 21338 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.787909 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.789258 16619 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:14.789954 21364 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:14.790959 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:14.791044 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.775799 21314 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.802748 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.803891 20906 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.804167 21368 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:14.804920 21359 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.804538 20906 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.807320 21180 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:14.778676 21301 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.766420 21369 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:14.808969 21301 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:14.809597 20906 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:14.810036 21301 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.810781 21330 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.811740 21301 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.812043 17124 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:14.814566 16543 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:14.816746 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260709 13:08:14.819478 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.820199 17121 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:14.783900 21164 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.007s	sys 0.010s
I20260709 13:08:14.755021 21172 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:14.755838 21349 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:08:14.791016 21175 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.825318 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:14.825618 21359 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.747673 21163 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.829650 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.831009 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.858338 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.858917 17118 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.859053 16536 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:14.788709 21373 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.834867 17121 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:14.850215 17122 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:14.851164 16542 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.852826 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.854324 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.854236 20957 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.859221 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:14.862361 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48418.3us
I20260709 13:08:14.863236 21361 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:14.867734 16540 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:14.868453 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78408.1us
I20260709 13:08:14.881151 16539 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:08:14.881413 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.883672 16617 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:14.884055 16466 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:14.886911 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:14.852221 21359 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.893577 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:14.869069 21333 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:14.882261 21181 consensus_meta.cc:287] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.002s
I20260709 13:08:14.895964 21231 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.864655 21175 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:14.910015 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.913472 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:14.895097 21359 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.928126 21314 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.928349 20848 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:14.928819 20848 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:14.929738 20848 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.930989 20848 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.932865 21373 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.933429 21374 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:14.934405 21374 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:14.916875 21300 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:14.937945 21362 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:14.938370 21362 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:14.939168 21362 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.940357 21362 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.917518 20957 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.918784 21163 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.921526 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.922493 21319 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.925354 21330 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:14.934785 21374 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:14.958595 17118 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
W20260709 13:08:14.976990 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 91455.3us
W20260709 13:08:14.977340 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 55906us
I20260709 13:08:14.979434 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:08:14.985283 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 75430.7us
I20260709 13:08:14.985522 16509 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.983975 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.911157 21055 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:08:14.987079 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.989593 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.979836 21361 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.997787 16468 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:08:14.998013 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:14.911688 21181 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:14.996711 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.000217 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:14.984560 21333 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.002112 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.000609 16611 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.004033 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:14.987962 21339 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:15.023435 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.024300 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.990109 21234 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:15.008148 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:15.005448 20830 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.022594 21170 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.028427 21175 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.029006 21183 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:14.994735 21336 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.030889 21304 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:14.992064 21322 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.035518 21331 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.036378 21358 raft_consensus.cc:3055] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:15.000031 21361 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:15.039040 21181 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.040016 16611 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:15.040542 16466 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:15.049739 21358 raft_consensus.cc:740] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:15.047816 21331 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:15.041801 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 63095.3us
I20260709 13:08:15.042064 16511 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:08:15.006222 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.006271 16613 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:14.995153 21319 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.027205 21177 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.001384 21203 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.001648 21156 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.003315 21324 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:15.048022 17118 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.036430 21376 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:08:15.050058 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:14.988721 21379 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:08:15.057753 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:15.043138 21373 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.046208 21234 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:15.063079 16434 leader_election.cc:400] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:15.073238 16434 leader_election.cc:403] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.043927 21359 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.071983 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:15.055315 21314 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:15.046010 21208 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:15.044065 21339 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.078630 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:15.061375 21322 raft_consensus.cc:2804] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.081648 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:15.082958 21234 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.061789 21172 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:08:15.061651 21177 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.046193 20830 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.047814 21170 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.092432 17123 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:15.055269 21313 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:08:15.096387 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 96473.1us
I20260709 13:08:15.069381 21324 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.095115 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:15.098412 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.099454 16461 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:15.099891 21314 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:15.100860 21314 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.101702 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.050614 21336 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.103969 21336 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.067981 21183 consensus_queue.cc:1059] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:15.104822 21183 raft_consensus.cc:3055] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:15.104904 21322 raft_consensus.cc:697] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:15.105247 21183 raft_consensus.cc:740] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:15.105356 21360 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:15.072918 21181 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.098276 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.108867 16461 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:15.079900 21168 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.116138 21319 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:15.116585 21170 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.068086 21331 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.058485 21358 consensus_queue.cc:260] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.118021 21358 raft_consensus.cc:3060] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.107070 21324 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.087846 20957 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.088503 21332 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:08:15.121620 21357 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.501s	user 0.004s	sys 0.000s
I20260709 13:08:15.122649 21332 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.094517 21338 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.123624 21332 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.068591 21301 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:15.125033 20845 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:15.125176 21338 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.111233 21349 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.125590 20845 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:15.126233 16470 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:08:15.093708 21055 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:08:15.127676 21236 consensus_queue.cc:1175] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "98881185daee4f13b69385e36026216c" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:15.111455 16543 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:15.128850 21172 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.129127 20957 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:15.105933 21360 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:15.124343 21177 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.130209 20957 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.127332 21055 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.131382 21177 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.132040 21055 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.114300 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.133438 16469 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:15.135878 21339 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.136729 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:15.138096 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.112979 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:15.130412 20845 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:15.151280 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.151271 16461 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:15.098371 21323 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.012s	sys 0.045s
I20260709 13:08:15.105938 21322 consensus_queue.cc:237] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.135874 20830 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.161906 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.162731 17127 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:15.163185 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:15.106135 21183 consensus_queue.cc:260] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.163990 17124 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:15.156253 21323 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.012s	sys 0.045s
I20260709 13:08:15.185222 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:15.180694 21359 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.155987 21319 consensus_queue.cc:1243] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:15.189972 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:15.201139 16544 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 10. Current term is 11. Ops: [8.10-10.11]
W20260709 13:08:15.201228 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88350.7us
I20260709 13:08:15.202165 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:15.202572 21304 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:15.164955 21368 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:15.209059 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:15.209887 16541 raft_consensus.cc:2376] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 98881185daee4f13b69385e36026216c in term 14. Re-sending same reply.
I20260709 13:08:15.213470 16544 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:15.130342 21360 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.217139 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.217232 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:15.175153 20830 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:08:15.228983 21392 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:15.229075 21340 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:15.229633 21340 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.229995 21340 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.233189 21336 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:15.231163 21301 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:15.234076 21336 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:15.234325 21332 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.234469 21336 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:15.234802 21332 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.235458 21336 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.235664 21332 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.236866 21332 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.236676 21336 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:15.224733 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.243680 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:15.302765 17127 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:15.244237 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:15.242753 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:15.304581 17118 raft_consensus.cc:2368] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13.
I20260709 13:08:15.244163 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:15.248529 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:15.383551 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 158907us
I20260709 13:08:15.388015 17124 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:15.398550 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.404225 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 160100us
W20260709 13:08:15.404342 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 160148us
I20260709 13:08:15.410360 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:15.411060 16542 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:15.413589 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.219079 21116 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.418277 16582 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.243340 21183 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.420671 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:15.412633 21231 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:15.422775 21304 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:15.429654 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:15.431459 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:15.431591 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:15.441289 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.408466 21177 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:15.447938 17124 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:15.414072 21307 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.418234 21358 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:15.419102 21116 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.427294 20848 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:15.474177 21116 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.488999 16539 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.499987 16466 raft_consensus.cc:1275] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:15.501464 21177 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:15.502197 21177 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.502925 21340 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.438764 21231 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.506134 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.506987 21231 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.479135 21307 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:15.508800 21307 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.510387 21180 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:15.512660 21358 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:15.513322 21168 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:15.513798 21358 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.465824 20909 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:08:15.517171 20909 consensus_queue.cc:1243] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 98881185daee4f13b69385e36026216c log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:15.430806 21172 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:08:15.519112 21172 consensus_queue.cc:1243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:15.467777 21055 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:15.519934 21055 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.520339 21055 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:15.522620 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.523379 16464 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.441715 21175 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.528946 16463 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.530393 17124 pending_rounds.cc:85] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 7
I20260709 13:08:15.530817 17124 pending_rounds.cc:107] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:08:15.531109 17124 raft_consensus.cc:2889] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.531993 20848 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:15.534109 20848 consensus_queue.cc:1243] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:15.541941 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.543483 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.544194 16465 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:15.545149 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.546473 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.547420 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.548749 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.549582 16461 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:15.554975 16543 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.419394 21339 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:15.567373 21257 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.570071 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:15.561892 16539 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:15.580693 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.587071 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.561286 21177 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:15.562673 21319 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:08:15.603644 21231 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:15.641461 21319 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.641994 21319 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.645922 21319 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:15.646834 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:15.647594 16461 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:15.618767 21203 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.648932 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:15.604131 21340 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:15.638441 21324 consensus_meta.cc:287] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
W20260709 13:08:15.659235 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44251.7us
I20260709 13:08:15.663893 16464 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:15.653628 21257 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:15.657097 21319 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:15.649755 21231 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.674117 17127 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:08:15.676147 17127 pending_rounds.cc:85] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 10
I20260709 13:08:15.676486 17127 pending_rounds.cc:107] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:08:15.676793 17127 raft_consensus.cc:2889] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.620239 21361 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.610735 16465 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
W20260709 13:08:15.767073 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.656759 21203 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.659363 21324 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:15.767793 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 79211.4us
I20260709 13:08:15.689908 16541 raft_consensus.cc:1240] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:15.674914 21319 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.793799 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.794528 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.793959 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.795111 16610 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:15.786518 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:15.796988 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.798319 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.798601 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.798899 16610 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.801512 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.808573 16619 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.810232 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:15.793156 21391 log.cc:927] Time spent T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:08:15.813652 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.815236 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:15.816044 16617 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:15.677676 21257 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.785710 21322 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:15.825714 21397 log.cc:927] Time spent T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:15.849586 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:15.827088 21403 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:15.801316 21401 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.792516 21301 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.792295 20919 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:15.834319 16617 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:15.785907 21168 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:15.835347 16619 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:15.797021 21319 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:15.845077 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.826822 21398 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:08:15.797178 21361 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:15.850989 20845 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.852113 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:15.860510 21250 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:15.816624 21395 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:08:15.796808 21181 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:08:15.869529 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:15.882433 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:15.903209 16464 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.869115 20919 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.865124 21177 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:15.871515 21403 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.862481 21322 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.915107 21416 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:15.921335 21408 log.cc:927] Time spent T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:15.917104 21404 log.cc:927] Time spent T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:15.917330 21231 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.903328 21337 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:15.928761 21055 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.928854 21403 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.931658 16464 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
W20260709 13:08:15.919319 21332 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.000s
I20260709 13:08:15.870608 21301 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.937517 21203 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.939193 21337 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.959036 21349 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.959424 21349 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:15.960240 21349 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.960835 21337 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.961372 21322 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.961493 21349 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.879086 21168 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.965619 21168 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:15.966564 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 896225us
I20260709 13:08:15.968123 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:15.944679 21183 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.001s
I20260709 13:08:15.917456 21257 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.922273 21116 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.940492 20919 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:15.950730 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.978713 21116 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.871160 21401 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.979635 20919 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.979818 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:15.980480 17120 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.981068 21401 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:15.953612 21164 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.953974 21055 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:15.985078 21164 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:15.985944 21164 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:15.986949 21164 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.987543 17120 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:15.954468 21374 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.947429 16611 raft_consensus.cc:2410] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:08:15.989174 21374 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:15.955762 21409 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:15.879982 21250 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:15.969203 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:15.970527 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.971431 16610 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:15.993558 21116 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:15.993669 16463 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:15.994033 21116 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:15.994513 21116 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:16.005517 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.008648 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.015002 16612 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:16.014896 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45763.9us
I20260709 13:08:16.016206 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.024466 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.025702 21334 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.029795 21319 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:16.031253 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.043097 21319 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:16.035534 21314 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.049055 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.050995 16433 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.052104 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:16.056895 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:16.057650 16615 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:16.058315 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.056514 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:16.050539 21336 consensus_meta.cc:287] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.661s	user 0.013s	sys 0.000s
I20260709 13:08:16.063261 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:16.061980 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.064858 16615 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:16.051817 21334 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.055048 21188 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:16.049007 21236 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:08:16.067708 16610 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.073319 21301 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.074265 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.077992 16619 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:08:16.078907 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.064880 21183 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.082265 16615 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.063051 21314 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.083098 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:16.094008 16614 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.084004 16618 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:16.082015 21188 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:16.089218 21402 log.cc:927] Time spent T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.214s	user 0.000s	sys 0.003s
I20260709 13:08:16.091908 21324 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.068440 21181 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:16.096854 21188 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.097642 21181 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:16.099552 21181 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:16.105760 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.106297 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.107028 17122 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:16.107973 17122 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:16.108280 17122 pending_rounds.cc:85] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 11
I20260709 13:08:16.108394 17125 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:16.109333 17121 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.111308 16612 raft_consensus.cc:2410] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:08:16.111943 21360 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:16.113557 21407 log.cc:927] Time spent T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:08:16.114538 21207 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:16.094267 21168 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:16.115386 21168 consensus_queue.cc:1243] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:16.117707 21207 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:16.118741 21257 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.119089 21257 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:16.119881 21257 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.120779 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:16.121881 21415 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.170s	user 0.000s	sys 0.003s
I20260709 13:08:16.112617 16614 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:16.122764 21055 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.123271 21055 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.123415 21180 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.124277 21180 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:16.126967 16436 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:16.108471 17122 pending_rounds.cc:107] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:16.130476 17122 raft_consensus.cc:2889] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.124696 21180 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:16.136433 21301 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.137074 21170 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.159773 16536 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:16.133082 21181 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:08:16.137147 21207 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:16.137171 21314 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 13:08:16.179239 17123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53654 (request call id 776) took 1539 ms (client timeout 1961 ms). Trace:
I20260709 13:08:16.179975 17119 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [12.12-13.13]
I20260709 13:08:16.184895 21055 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:16.187117 17123 rpcz_store.cc:269] 0709 13:08:14.640181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.640322 (+   141us) service_pool.cc:224] Handling call
0709 13:08:16.179038 (+1538716us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400523854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:16.179159 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776558848}
I20260709 13:08:16.189770 16542 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:16.193300 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.198344 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.200021 16542 raft_consensus.cc:2393] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:16.185740 21170 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:16.189700 21180 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.220275 21230 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.219066 16545 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:16.219820 21055 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.188946 21207 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.234117 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:16.241496 21420 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:08:16.244128 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.248927 16540 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:16.249096 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.162482 21301 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.289501 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.291396 16433 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.292912 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.210003 16544 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:16.204591 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.203727 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.267071 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.267724 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 770) took 1484 ms. Trace:
I20260709 13:08:16.230150 21116 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.297199 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.297369 16542 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.297330 17119 rpcz_store.cc:276] 0709 13:08:14.780851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.780973 (+   122us) service_pool.cc:224] Handling call
0709 13:08:16.179702 (+1398729us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.188143 (+  8441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.265215 (+ 77072us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400523850. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:16.265361 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3215667968}
I20260709 13:08:16.299914 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.301812 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.304105 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.306794 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.307329 16544 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.308126 16537 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:16.314720 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.316109 21170 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.319130 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.305217 21180 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.320843 21236 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.320999 21338 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.321475 21338 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.323414 21338 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.329221 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.330045 16614 raft_consensus.cc:2410] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:08:16.333338 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.339682 21406 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
I20260709 13:08:16.341470 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2394) took 1091 ms. Trace:
I20260709 13:08:16.341861 16539 rpcz_store.cc:276] 0709 13:08:15.250434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.490031 (+239597us) service_pool.cc:224] Handling call
0709 13:08:15.561580 (+ 71549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.578952 (+ 17372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.341216 (+762264us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b5400205dd0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:16.341397 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163578112}
I20260709 13:08:16.345786 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:16.347688 21236 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.347822 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.349433 21338 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.361550 21331 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.364024 21116 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.365101 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:16.367161 21301 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.370106 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:16.294683 21300 consensus_queue.cc:1175] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 5 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:08:16.388752 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2276) took 1278 ms. Trace:
I20260709 13:08:16.389230 16468 rpcz_store.cc:276] 0709 13:08:15.113184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.113320 (+   136us) service_pool.cc:224] Handling call
0709 13:08:15.113619 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.113955 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.113982 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.118274 (+  4292us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.999591 (+881317us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b18003bfc80. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:16.047116 (+ 47525us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:16.047179 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.047291 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.388440 (+341149us) raft_consensus.cc:1685] finished
0709 13:08:16.388459 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.388674 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1085,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":22978176,"thread_start_us":47063,"threads_started":1,"wal-append.queue_time_us":951205}
I20260709 13:08:16.394460 16613 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:16.396838 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.397589 16541 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:16.398336 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.399495 16541 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:16.402199 21403 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.402523 21332 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.402809 21403 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.377489 20845 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.285318 21230 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.305693 21183 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.293927 21314 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:08:16.305583 21336 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:08:16.313396 21226 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:08:16.409673 21230 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.300601 21294 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:08:16.294512 21207 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.411763 21403 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.413110 21207 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.289479 21055 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.414091 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.414597 16583 leader_election.cc:400] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13.
I20260709 13:08:16.414685 17119 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:16.415083 16583 leader_election.cc:403] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.415237 21055 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:16.403083 21332 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.415894 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:16.416759 16614 raft_consensus.cc:606] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:16.416164 16509 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:16.418114 21332 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.294392 21334 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.419242 21294 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.295589 21188 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.419922 21294 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.420598 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 707) took 1222 ms. Trace:
I20260709 13:08:16.420957 16536 rpcz_store.cc:276] 0709 13:08:15.197849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.201818 (+  3969us) service_pool.cc:224] Handling call
0709 13:08:16.420422 (+1218604us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002b7854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:16.420523 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125503744}
I20260709 13:08:16.421973 21294 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.423029 21250 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.424028 21300 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.424661 21300 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.426858 21300 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:16.427357 21300 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13.
I20260709 13:08:16.429020 21055 consensus_queue.cc:1048] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:16.434433 17118 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.434909 17118 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:16.446066 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:16.446832 16614 raft_consensus.cc:606] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:16.447238 16614 raft_consensus.cc:614] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.452051 21257 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.454700 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:16.455438 16614 raft_consensus.cc:606] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:16.455722 16614 raft_consensus.cc:614] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.472518 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.473176 16614 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:16.475152 16611 pending_rounds.cc:85] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 5
I20260709 13:08:16.475244 16615 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.475622 16611 pending_rounds.cc:107] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:08:16.475976 16611 raft_consensus.cc:2889] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.476171 16542 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:16.477381 16614 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:16.478350 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:16.478884 16615 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.481434 16468 raft_consensus.cc:1275] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:16.481709 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.435935 17118 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.490880 16470 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:16.482447 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.495829 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:16.496394 16468 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.499209 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.501196 16470 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:16.502506 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 183430us
I20260709 13:08:16.509150 17119 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:16.510673 16610 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:16.511874 17118 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.512032 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.512748 16464 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:16.517210 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:16.517535 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.518296 17122 raft_consensus.cc:2393] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 9: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:16.518837 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.419154 21374 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.519640 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.520407 16614 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:16.523159 16614 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:16.524164 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.523823 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.531678 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.532729 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.534807 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.534605 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.535351 17119 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:16.535574 17127 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:16.533710 17120 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:16.535389 17123 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:16.537199 16544 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:16.538425 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:16.538980 16613 raft_consensus.cc:606] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:16.539310 16613 raft_consensus.cc:614] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.541095 16465 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.530330 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.544737 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.545558 16618 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:16.545894 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.546700 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.547407 16619 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:16.557273 16436 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:16.487752 21359 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:16.558969 21334 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.563424 21226 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:16.511256 21181 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.506104 21203 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:16.567624 16616 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:16.527001 21374 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.570169 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.570844 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:16.571357 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 222356us
I20260709 13:08:16.538425 21175 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.563084 21301 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.576896 17118 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:08:16.576289 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.582247 16541 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:16.559926 21234 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.583096 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 788) took 1030 ms. Trace:
I20260709 13:08:16.585472 16466 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.585773 16468 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:16.589056 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:16.564074 21230 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.588761 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:16.594112 17123 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:16.595201 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.596241 16463 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.568190 21334 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.596652 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:16.553918 21313 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:08:16.605849 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.575989 21374 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.600620 21334 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.602278 21294 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.609831 16616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:16.640625 16616 raft_consensus.cc:606] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:16.641011 16616 raft_consensus.cc:614] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.602375 21230 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.597012 21314 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.647897 16464 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:16.610620 20919 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.611874 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.651403 16544 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:16.651965 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.652242 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.616789 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.617436 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.653040 16545 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:16.653165 16541 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:16.597699 17118 rpcz_store.cc:276] 0709 13:08:15.553034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.553225 (+   191us) service_pool.cc:224] Handling call
0709 13:08:15.564521 (+ 11296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.434310 (+869789us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54001205a0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37474dc0 00007ffa374ff1c0 00007ffa37500231 00007ffa374fcd8f 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c
0709 13:08:16.581890 (+147580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.583047 (+  1157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164330880}
I20260709 13:08:16.618873 21412 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.595885 21376 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:08:16.621430 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:16.573515 21359 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.625308 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:16.636855 21417 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.684s	user 0.002s	sys 0.002s
I20260709 13:08:16.580199 21203 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.638777 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:16.664075 16536 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:16.650871 21314 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.583405 21324 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:08:16.584024 21341 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:08:16.639873 21322 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.642755 21294 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.645938 16615 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:16.590879 21175 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.597461 21301 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.660027 21156 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.673975 16537 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:08:16.670898 21294 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.678741 21203 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.668859 21314 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.682601 21374 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.684759 21374 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.662238 21412 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.689879 21230 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.690796 21412 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.700810 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:16.656240 21176 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:16.727054 16537 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:16.692297 21338 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:16.756873 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:16.733202 21230 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:16.781008 21324 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.784161 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 217728us
I20260709 13:08:16.795073 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.713742 21156 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.815888 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:16.822207 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 245037us
I20260709 13:08:16.823122 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:08:16.825481 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 186551us
I20260709 13:08:16.829078 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:16.779485 21334 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:16.838949 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.830955 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:16.841372 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:16.841958 17120 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.822005 21437 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.842082 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:16.849267 16540 raft_consensus.cc:2410] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:08:16.854324 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.855669 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:16.833617 21416 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:16.814150 21324 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.857720 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:16.855669 16582 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:16.865146 17120 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:16.827713 21230 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:16.935562 21230 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.886739 16509 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:16.848459 21341 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.853013 21360 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:16.841424 21438 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.859782 20919 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:16.861304 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:16.926492 21203 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:16.866389 21257 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.933342 21207 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:16.933704 21175 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:16.845103 21322 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:17.078341 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 213478us
W20260709 13:08:17.140055 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 278800us
I20260709 13:08:17.140791 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:17.080912 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 194284us
I20260709 13:08:16.932986 21156 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:16.867501 21434 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.157179 21453 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:17.157737 21453 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:17.158080 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:17.158527 21231 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:16.939122 21437 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:17.143424 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.074976 21341 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.949860 21403 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:17.144678 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.148474 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:17.148705 21435 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:08:17.149076 21156 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:17.149612 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.158624 21453 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.081967 21438 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:17.153714 21444 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.130543 21359 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.138864 21313 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.142951 21301 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:16.851696 21338 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:17.172605 21430 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:17.161712 21250 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.230655 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 69969.4us
I20260709 13:08:17.241631 16511 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:17.171365 21341 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.159220 21231 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.171053 21175 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.172747 21403 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:17.246138 16539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.001s	sys 0.005s
I20260709 13:08:17.271863 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:08:17.287299 16539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.005s
I20260709 13:08:17.288705 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:17.294453 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:17.295596 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:17.224610 21322 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:17.230269 21444 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.230006 21438 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.229301 21156 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:17.285257 21451 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:08:17.320086 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 464442us
I20260709 13:08:17.279870 21301 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.292486 21403 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.298285 21359 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.307722 21207 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.240967 21313 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.340180 16583 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:17.315656 21203 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.321146 20906 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.329340 21447 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:08:17.345484 21156 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.314383 21444 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.297726 21412 consensus_queue.cc:1048] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:08:17.343209 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 46611.1us
I20260709 13:08:17.279189 21250 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.336071 21301 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.351528 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:17.341881 21257 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:17.358887 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 715) took 1072 ms. Trace:
I20260709 13:08:17.341605 21359 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:17.343837 21207 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:17.291785 20919 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.347157 21334 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.366917 16539 rpcz_store.cc:276] 0709 13:08:16.286310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.344706 (+ 58396us) service_pool.cc:224] Handling call
0709 13:08:16.473759 (+129053us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.509626 (+ 35867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.509653 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.543292 (+ 33639us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.292652 (+749360us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:17.292708 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.292830 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.358668 (+ 65838us) raft_consensus.cc:1685] finished
0709 13:08:17.358689 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.358826 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":23102,"thread_start_us":714787,"threads_started":1,"wal-append.queue_time_us":791305}
W20260709 13:08:17.358846 21314 consensus_meta.cc:287] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.679s	user 0.005s	sys 0.003s
W20260709 13:08:17.359989 21294 consensus_meta.cc:287] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.683s	user 0.005s	sys 0.005s
I20260709 13:08:17.344648 21451 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:17.369763 16583 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:17.353407 21175 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:17.343851 21180 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:08:17.372677 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 213395us
I20260709 13:08:17.353605 21452 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:17.368556 21359 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.377203 21349 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:17.380862 21314 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.353741 20906 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.381965 21313 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.360966 21455 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.372557 21324 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.371443 21207 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.400920 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.366917 21301 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.371012 21360 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:17.372905 21443 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.423061 16468 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:17.389663 21332 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:17.427165 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.396591 21412 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.428261 21231 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.428066 21412 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.428926 21324 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.429435 21324 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.430186 21412 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.431499 21324 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:17.386597 21294 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.443429 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.422704 21443 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.465768 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:17.469375 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 109565us
I20260709 13:08:17.470357 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:17.373836 21322 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.475548 16470 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:17.471969 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.476279 17119 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:17.478541 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.413134 21455 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.479152 16463 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:17.422387 21175 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:17.493291 17127 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.493168 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:17.410027 21452 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.500041 16616 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:17.504837 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.506870 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:17.507654 16619 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.513293 21250 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:17.517659 21314 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.517917 16619 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:17.519654 17118 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:17.520691 21455 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:17.525211 21450 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:08:17.527208 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2416) took 1021 ms. Trace:
I20260709 13:08:17.527592 16536 rpcz_store.cc:276] 0709 13:08:16.506243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.664881 (+158638us) service_pool.cc:224] Handling call
0709 13:08:16.665214 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.665639 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.665678 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.671512 (+  5834us) log.cc:844] Serialized 52 byte log entry
0709 13:08:16.921709 (+250197us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:16.926227 (+  4518us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.081065 (+154838us) log.cc:844] Serialized 14 byte log entry
0709 13:08:17.081234 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.081308 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.526997 (+445689us) raft_consensus.cc:1685] finished
0709 13:08:17.527018 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.527151 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154376,"prepare.queue_time_us":5639,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":236806,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":62117,"spinlock_wait_cycles":33808256,"thread_start_us":125728,"threads_started":1,"wal-append.queue_time_us":635609}
I20260709 13:08:17.529448 21360 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.471468 21443 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.469477 21324 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:17.537217 21324 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.539389 21324 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.540271 20906 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.469368 21434 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:17.545055 21434 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.547206 21434 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.553267 21334 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:17.553932 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:17.554486 16541 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.557787 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.559320 16544 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:17.496521 21451 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.566744 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:17.567626 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.568816 16463 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:17.570350 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.571374 16469 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.572897 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.573437 16463 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:17.479833 21412 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.591239 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.603046 16619 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:17.591876 17123 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:17.598816 16541 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:17.600570 16536 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:08:17.601367 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 95768.8us
I20260709 13:08:17.606295 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.607025 16536 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 10.
I20260709 13:08:17.607708 16537 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:17.608016 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.609009 16536 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:17.611390 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.490785 21332 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.616899 16544 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.552232 21438 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.625244 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.625348 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.624908 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.631788 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:17.631659 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.632718 17123 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
W20260709 13:08:17.607383 21440 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.776s	user 0.008s	sys 0.000s
I20260709 13:08:17.640075 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.640997 16616 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:17.637862 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.504639 21463 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:08:17.631435 21412 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.653689 21294 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.621208 21447 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.654313 21447 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.654742 21447 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.627700 21416 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:17.655236 21416 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.657469 21416 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:17.658080 21300 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:17.658664 21300 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:17.627733 21055 consensus_queue.cc:1059] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:08:17.642002 21441 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.671260 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:17.653462 21412 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.661167 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2306) took 1041 ms. Trace:
I20260709 13:08:17.644536 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.662043 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:17.676257 16468 rpcz_store.cc:276] 0709 13:08:16.619714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.621204 (+  1490us) service_pool.cc:224] Handling call
0709 13:08:17.660965 (+1039761us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54003e4254. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:17.661107 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753888000}
I20260709 13:08:17.669154 21300 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:17.631636 21401 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:17.674336 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:17.691480 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.681958 21442 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:17.682588 21339 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.682853 21412 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.683531 21175 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:17.683919 21434 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:17.684748 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.685618 21340 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.628494 21332 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.738287 21339 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.679507 21467 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:08:17.689221 21401 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:17.787710 16612 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:17.790726 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.795043 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.807546 16466 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:17.795979 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:17.745649 21324 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.737812 21441 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.791592 17122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 783) took 1256 ms. Trace:
I20260709 13:08:17.764973 21340 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.812352 16462 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:17.813479 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:17.781850 21177 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:08:17.772691 21431 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.975s	user 0.008s	sys 0.003s
W20260709 13:08:17.792855 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37072 (request call id 716) took 1506 ms (client timeout 1806 ms). Trace:
I20260709 13:08:17.815590 17122 rpcz_store.cc:276] 0709 13:08:16.547562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.547670 (+   108us) service_pool.cc:224] Handling call
0709 13:08:16.547939 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.562247 (+ 14308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.562292 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.562834 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.748992 (+186158us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:16.749025 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.749079 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.528350 (+779271us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:17.791241 (+262891us) raft_consensus.cc:1685] finished
0709 13:08:17.791271 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.791525 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13867,"raft.queue_time_us":15570,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":45607168,"thread_start_us":145006,"threads_started":1,"wal-append.queue_time_us":193361}
I20260709 13:08:17.787405 21332 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:17.824324 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 232743us
I20260709 13:08:17.770236 21339 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.818127 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:17.828840 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 218289us
W20260709 13:08:17.827361 16540 rpcz_store.cc:269] 0709 13:08:16.286595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.286725 (+   130us) service_pool.cc:224] Handling call
0709 13:08:17.792637 (+1505912us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b5400291dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:17.792760 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1257075968}
I20260709 13:08:17.792466 21452 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:17.835112 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 222518us
I20260709 13:08:17.815688 21324 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.840199 16464 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:17.823833 21177 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:17.854262 21177 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.855405 21177 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.828066 21443 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.857983 21443 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.812006 21403 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.860755 21403 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.790560 21301 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.862775 21301 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:17.839469 21470 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.863647 21470 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.864019 21470 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:17.816736 21207 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.866230 16541 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:17.867554 21207 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:17.865056 21324 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.826659 21340 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.850486 21226 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.870994 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:17.871915 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:17.880007 17122 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.834599 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:17.872745 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.881342 16469 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:17.875290 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:17.882082 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:17.883051 17123 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:08:17.883400 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 493637us
I20260709 13:08:17.886624 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.887939 16540 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:17.847182 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:17.891263 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44199.5us
I20260709 13:08:17.896863 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.897540 16544 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:17.900182 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 415281us
W20260709 13:08:17.900910 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 66503.2us
I20260709 13:08:17.902180 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:17.886801 21341 consensus_meta.cc:287] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.589s	user 0.005s	sys 0.005s
I20260709 13:08:17.852571 21188 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:17.908908 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:17.912977 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:17.903008 21453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.009s	sys 0.022s
I20260709 13:08:17.920238 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:17.899899 21452 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:17.924753 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:17.928089 16537 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.824923 21441 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.941250 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.944396 16469 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:17.955034 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.959861 21301 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:17.961011 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.914664 21472 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.924662 21453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.009s	sys 0.022s
W20260709 13:08:17.921880 21359 consensus_meta.cc:287] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.003s
I20260709 13:08:17.886672 21226 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.967291 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.971000 17122 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:17.971199 16462 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:17.875590 21401 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.973901 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:17.972509 21472 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:17.957468 21464 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:17.978783 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:17.979431 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2414) took 1473 ms. Trace:
I20260709 13:08:18.020409 16464 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:17.981412 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:18.021711 16541 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.986884 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:17.992111 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:18.022635 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:17.926369 21361 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:17.996344 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:17.999642 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.003669 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.944386 21452 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:17.944042 21322 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.036866 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.037920 16616 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:18.039009 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.013444 16537 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
W20260709 13:08:18.025873 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52062.7us
I20260709 13:08:17.963889 20845 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.917972 21341 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.020304 16545 rpcz_store.cc:276] 0709 13:08:16.505748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.660816 (+155068us) service_pool.cc:224] Handling call
0709 13:08:16.661150 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.689847 (+ 28697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.689879 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.690345 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.834059 (+143714us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:16.834111 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.979026 (+1144915us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b54001aa754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:17.979074 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.979120 (+    46us) raft_consensus.cc:1685] finished
0709 13:08:17.979134 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.979371 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1092,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":65217280,"thread_start_us":143242,"threads_started":1,"wal-append.queue_time_us":255882}
I20260709 13:08:18.041759 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.042125 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:17.960451 21301 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:17.974923 21438 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.061595 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:18.094614 16541 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:18.028127 21172 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.028288 21361 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.036254 21452 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.035796 21401 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.106453 17119 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:18.046180 21453 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:08:18.038079 21250 consensus_queue.cc:1175] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 15 status { last_received { term: 13 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:18.054883 20845 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.113164 21172 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.124480 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.156402 16464 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:18.125767 21483 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:18.173606 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.129065 21447 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.043942 21481 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:18.130510 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.184118 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 241426us
I20260709 13:08:18.185302 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:18.128108 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:17.997844 21359 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.132519 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:18.083573 21338 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:18.087021 21403 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:18.110252 21446 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:08:18.197832 16614 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:18.125636 21301 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:18.128643 21444 consensus_meta.cc:287] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.000s
I20260709 13:08:18.110662 21361 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.055050 21322 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:18.155493 21449 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:18.207439 16543 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:18.103770 21300 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:08:18.198522 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 175943us
I20260709 13:08:18.155584 21188 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:18.218089 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 210321us
I20260709 13:08:18.196362 21403 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:18.213634 21301 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.183820 21483 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:18.265414 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 224183us
W20260709 13:08:18.245749 21468 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
W20260709 13:08:18.287233 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 101684us
I20260709 13:08:18.237905 21403 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.288370 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:18.299296 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:18.203425 21444 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.238085 21338 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:08:18.302251 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:18.270844 21487 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.239449 21188 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.332002 21362 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.333881 21483 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.412214 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.301268 21455 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.336223 20845 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:18.330585 21176 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:18.371030 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 68860.4us
I20260709 13:08:18.308753 21481 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:18.435745 21362 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.441547 21481 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.443681 21362 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.387900 21156 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:18.445242 21156 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:18.445653 21156 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:18.449533 21510 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:18.411119 16611 raft_consensus.cc:3055] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.271140 21301 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.430738 21452 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.431910 21226 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.439344 21455 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.458462 16611 raft_consensus.cc:740] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:18.458971 17093 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:18.417961 21341 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.547114 21452 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:18.548070 21505 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:08:18.551072 21487 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:18.551602 21487 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.553892 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.554736 16610 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:18.556161 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:18.556348 21496 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:08:18.556434 16613 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:18.556921 16610 raft_consensus.cc:2393] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:18.342568 21332 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:18.558470 16610 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.558836 21332 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.561350 21301 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:18.474468 21176 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.342818 21441 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:18.440586 21484 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:08:18.491293 16583 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:18.564447 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 73287.7us
I20260709 13:08:18.521466 21455 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.565764 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.566675 21177 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:18.567337 21177 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:18.500520 21361 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.500978 21236 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.571341 21236 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:18.507565 16470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2308) took 1885 ms (client timeout 1991 ms). Trace:
W20260709 13:08:18.572258 16470 rpcz_store.cc:269] 0709 13:08:16.622441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.625074 (+  2633us) service_pool.cc:224] Handling call
0709 13:08:18.507348 (+1882274us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400356bd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:18.507474 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868501248}
I20260709 13:08:18.505805 21461 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.500787 21523 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.489216 16611 consensus_queue.cc:260] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.576071 16611 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.577239 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.518069 21472 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.523466 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2408) took 2310 ms. Trace:
I20260709 13:08:18.581446 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.572640 16463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2321) took 1001 ms. Trace:
I20260709 13:08:18.525183 21322 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:18.527411 21476 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:08:18.527580 21359 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.520995 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:18.539330 21340 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.651s	user 0.007s	sys 0.002s
I20260709 13:08:18.539973 21447 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.470351 21483 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.548118 21188 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.498760 21334 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:18.569430 21324 consensus_meta.cc:287] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 13:08:18.571720 21361 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:18.613163 21324 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.614142 16612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 730) took 1011 ms. Trace:
I20260709 13:08:18.614511 16612 rpcz_store.cc:276] 0709 13:08:17.603123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.603978 (+   855us) service_pool.cc:224] Handling call
0709 13:08:17.604325 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.800602 (+196277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.613917 (+813315us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b540025dd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:18.614086 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421010176}
I20260709 13:08:18.508095 21156 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.615440 21324 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.568322 21177 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.617197 21156 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:18.517764 21494 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.279s	user 0.003s	sys 0.000s
I20260709 13:08:18.619397 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 786) took 1147 ms. Trace:
I20260709 13:08:18.579501 21523 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:18.620647 21523 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.621279 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 731) took 1014 ms. Trace:
I20260709 13:08:18.621667 16619 rpcz_store.cc:276] 0709 13:08:17.607182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.608966 (+  1784us) service_pool.cc:224] Handling call
0709 13:08:17.634478 (+ 25512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.634773 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.634805 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.635257 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.997234 (+361977us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:17.997273 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.997336 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.517079 (+519743us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:18.621003 (+103924us) raft_consensus.cc:1685] finished
0709 13:08:18.621026 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.621222 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21328,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":7095040,"thread_start_us":306920,"threads_started":1,"wal-append.queue_time_us":473054}
I20260709 13:08:18.577339 16470 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:08:18.578349 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 449307us
I20260709 13:08:18.632798 21483 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.579104 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.579679 16466 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:18.561148 21332 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:18.581610 16538 rpcz_store.cc:276] 0709 13:08:16.212820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.310587 (+ 97767us) service_pool.cc:224] Handling call
0709 13:08:16.310881 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.311254 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:16.311294 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.716176 (+404882us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b18003f3a00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343de2a6 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a
0709 13:08:17.793335 (+1077159us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b2c0000e678. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:08:17.793781 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.146506 (+352725us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:18.146566 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.146662 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.523212 (+376550us) raft_consensus.cc:1685] finished
0709 13:08:18.523237 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.523381 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":5839,"spinlock_wait_cycles":147688576,"thread_start_us":352318,"threads_started":1,"wal-append.queue_time_us":637941}
I20260709 13:08:18.584800 16610 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:18.582259 16463 rpcz_store.cc:276] 0709 13:08:17.571331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.574085 (+  2754us) service_pool.cc:224] Handling call
0709 13:08:17.574318 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.574492 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:18.069097 (+494605us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.572271 (+503174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:18.572337 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:18.572394 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.572456 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.572585 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":548837,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":5877,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":878106,"threads_started":2,"wal-append.queue_time_us":498408}
I20260709 13:08:18.635076 21483 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.602552 21340 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.619788 17124 rpcz_store.cc:276] 0709 13:08:17.471907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.472029 (+   122us) service_pool.cc:224] Handling call
0709 13:08:17.852110 (+380081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:17.865040 (+ 12930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.865069 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:17.865575 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:08:18.088145 (+222570us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:18.088198 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.088289 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.568912 (+480623us) raft_consensus.cc:1685] finished
0709 13:08:18.568932 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.619139 (+ 50207us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54004ac750. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:18.619337 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12465,"raft.queue_time_us":12608,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":471,"spinlock_wait_cycles":873385344,"thread_start_us":222199,"threads_started":1,"wal-append.queue_time_us":699963}
I20260709 13:08:18.637584 16366 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.588581 16465 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:18.590873 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 69959us
I20260709 13:08:18.642704 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.644860 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.645607 16465 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.600045 16611 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:18.545948 21444 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.601758 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.575395 21461 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.652144 17124 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:18.652617 17124 pending_rounds.cc:85] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 11
I20260709 13:08:18.653116 17124 pending_rounds.cc:107] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:18.653366 17124 raft_consensus.cc:2889] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.653555 16610 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:18.608239 21172 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:18.610476 21480 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.378s	user 0.002s	sys 0.000s
I20260709 13:08:18.658435 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:18.659137 17123 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.600924 21250 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.648327 16611 pending_rounds.cc:85] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 11
I20260709 13:08:18.661098 16611 pending_rounds.cc:107] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:18.661373 16611 raft_consensus.cc:2889] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.663287 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.664225 16611 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:18.665470 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:18.666033 17119 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.605914 21176 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.676707 17123 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
W20260709 13:08:18.651890 21339 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.777s	user 0.007s	sys 0.004s
I20260709 13:08:18.637598 21340 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.654567 21461 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.686443 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:18.670830 21180 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:08:18.690649 16461 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:18.686647 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.687924 16465 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
W20260709 13:08:18.679029 21470 consensus_meta.cc:287] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.815s	user 0.012s	sys 0.000s
I20260709 13:08:18.695570 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:18.698503 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.701004 16611 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:18.702296 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.703059 16611 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:18.704279 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.707161 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.707957 16617 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:18.709270 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:18.654567 21156 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:18.715790 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:18.713411 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.718447 16465 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:18.655177 21324 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:18.727022 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.727535 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:18.727845 16618 raft_consensus.cc:2410] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:18.728832 21401 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.730248 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:18.721242 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 262836us
I20260709 13:08:18.723043 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.734472 16617 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:18.737998 21250 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:18.738902 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.739782 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.740576 16467 raft_consensus.cc:2410] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:18.743249 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.744555 21532 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:18.745102 21532 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.747233 21532 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.724582 21361 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.750028 21236 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:18.750698 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:18.752530 16585 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:18.725196 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:18.754480 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 43625.5us
I20260709 13:08:18.714401 21470 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.758991 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:18.723358 17119 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:18.761309 21176 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.802599 17118 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.762360 21334 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:18.803272 21334 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:18.763692 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:18.806085 21176 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.808177 16585 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:18.809068 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:18.769183 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:18.809634 21447 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.810067 21447 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.804272 21334 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.810402 21447 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.813381 21175 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.814947 16536 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:18.815194 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:18.755389 16436 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:18.824661 21301 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.825191 21301 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.826038 21294 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:18.826210 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 70936us
I20260709 13:08:18.827251 21294 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:18.831202 21294 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:18.831974 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:18.832619 21294 consensus_queue.cc:1243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:18.833117 21481 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.833349 21236 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.833520 21481 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:18.833961 21236 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.834376 21236 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.835317 21481 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.836405 21481 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.816351 21361 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.825593 21301 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.696382 21339 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.849319 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:18.866106 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:18.816100 21470 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:18.752472 21487 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:18.885076 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 126158us
I20260709 13:08:18.851830 21453 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:18.873449 21177 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:18.851783 21369 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:18.878811 21412 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.873222 21463 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:18.896914 16470 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:18.902112 21374 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:18.899891 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:18.891010 21324 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:18.893159 21177 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.924093 21324 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:18.904064 21412 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:18.943866 21177 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.922067 21374 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:18.922840 21463 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.086263 21412 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.086678 21463 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.087488 17123 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:19.088886 21250 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.089735 21250 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.097277 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:19.070322 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 170477us
I20260709 13:08:19.072206 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:18.891330 21518 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:18.942471 21453 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.080173 21324 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.078764 21156 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:19.116861 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:19.097536 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.099011 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.117105 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.118957 16544 raft_consensus.cc:2410] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:19.119302 16537 raft_consensus.cc:2410] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:19.099931 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.103986 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.110080 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.120184 16540 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:18.903123 21513 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.125933 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:19.126258 17123 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:19.119837 16545 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 8.
I20260709 13:08:19.128958 16545 raft_consensus.cc:1240] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:19.119172 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:19.119953 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:19.079428 21403 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.766s	user 0.017s	sys 0.001s
I20260709 13:08:19.134783 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:19.135546 17121 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:19.137756 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.138470 16544 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:19.141114 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:19.145681 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.146390 16544 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:19.091135 21401 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.110204 21416 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.110785 21451 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.109254 21523 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.159374 21461 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.161087 21550 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:19.162153 21540 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:19.161896 21301 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.194185 21301 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.094120 21236 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.196235 21236 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:19.163269 21538 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 13:08:19.163582 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44506.4us
I20260709 13:08:19.198536 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.199746 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.164065 21374 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.164129 21532 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.164539 21457 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.164628 21250 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.170085 21535 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.113874 21546 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.172880 21401 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.173735 21451 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.118033 21463 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.175109 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.192461 21177 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.176448 21203 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.142102 21376 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.177103 21416 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.178592 21548 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.179893 21412 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.183758 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.262580 16544 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.190451 21461 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.190778 21550 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.191321 17119 raft_consensus.cc:2368] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:19.144265 21513 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.201470 16511 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:19.147511 21230 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:19.233498 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 329647us
I20260709 13:08:19.114362 21518 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.175853 21234 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:19.240939 21546 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.222983 21547 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.242093 21447 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.312335 21447 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.254869 21463 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.314865 21463 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.317755 21177 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.296415 20845 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.234843 21535 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.253216 21203 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.318663 20845 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.320143 21203 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.320231 21535 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.320797 20845 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.326184 21339 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.260901 16543 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:19.327337 21518 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.281936 21236 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:19.329567 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.226642 21470 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:19.253276 21376 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:19.289206 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 87795.5us
I20260709 13:08:19.201215 21532 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.296013 16612 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:19.149471 21403 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:19.321048 21416 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.298688 21230 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:19.259138 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84114.4us
I20260709 13:08:19.322959 16619 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:19.324535 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.286392 21487 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.341763 16544 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:19.342316 16615 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:19.295965 21549 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.345451 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.348834 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.331301 21234 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.355510 21234 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.357364 21546 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.359369 16544 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:19.334856 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44049us
I20260709 13:08:19.358879 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:19.333179 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.283636 21550 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.336182 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.281754 21548 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.367841 16543 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.368319 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.370052 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.364689 21055 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:19.376838 16461 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.374053 21230 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.379949 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.381054 16462 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:19.336208 21470 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.382936 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.348825 21172 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.389449 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:19.384748 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.348031 21461 consensus_queue.cc:1059] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:19.395927 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.399644 16462 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.378895 21549 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.402741 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.387964 21361 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.426568 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.388020 21230 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:19.386523 21156 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.393436 21177 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.432875 21361 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.433910 21156 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.424795 21250 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.424482 21401 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.439175 21376 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.439266 21532 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.396265 21332 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.396639 21236 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:19.433039 20845 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.449224 16544 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:19.489104 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.396950 21172 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.490068 16462 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:19.423774 21513 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.404069 21549 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.429600 21548 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.445096 16543 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:19.467168 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.396776 21188 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:19.491364 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.454991 16461 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:19.494145 16585 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:19.463645 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.428848 21523 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.497357 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.462483 21518 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.397150 21535 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.444006 21463 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.456945 21203 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:19.466620 21451 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.468432 21376 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.486692 21236 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.508497 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.521247 16543 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:19.500002 16544 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.510133 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.397588 21234 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:08:19.503129 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:19.501232 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.496201 21483 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.496189 21332 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.507252 21324 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.501219 20845 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:19.518042 21339 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:19.518415 21203 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.520351 21463 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.573230 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.574741 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.544394 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.624532 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.532099 16544 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:19.500000 21188 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.519352 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.704177 16545 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:19.498752 21549 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.443441 21177 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.503860 21548 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:19.715216 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.715905 16467 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:19.715992 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:19.719554 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.528959 16464 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:19.721236 16617 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:19.723361 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:19.699380 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.703979 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.500095 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:19.709299 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 206240us
I20260709 13:08:19.725481 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:19.727499 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.727824 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.720340 16610 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
W20260709 13:08:19.721557 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 324806us
I20260709 13:08:19.730212 16617 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:19.734866 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.730842 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 733) took 1610 ms. Trace:
I20260709 13:08:19.735522 16539 rpcz_store.cc:276] 0709 13:08:18.120849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.130308 (+  9459us) service_pool.cc:224] Handling call
0709 13:08:18.391616 (+261308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:18.873734 (+482118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:18.873778 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:18.874360 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.091913 (+217553us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:19.091984 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.092110 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:19.252865 (+160755us) raft_consensus.cc:1685] finished
0709 13:08:19.252888 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.563944 (+311056us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002b7850. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fc8ad 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:19.730718 (+166774us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":646957,"raft.queue_time_us":505236,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":23043,"spinlock_wait_cycles":492017024,"thread_start_us":217109,"threads_started":1,"wal-append.queue_time_us":370078}
I20260709 13:08:19.736846 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.523785 21236 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:19.745695 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.515249 21518 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.748093 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.780022 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.544896 21403 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.777499 16463 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:08:19.788288 16463 pending_rounds.cc:85] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 7
I20260709 13:08:19.788604 16463 pending_rounds.cc:107] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:08:19.790057 16463 raft_consensus.cc:2889] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.791563 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.778200 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.784471 16616 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:19.746459 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.733460 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:19.728863 21556 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.233s	user 0.005s	sys 0.007s
I20260709 13:08:19.780699 16545 raft_consensus.cc:2376] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14. Re-sending same reply.
I20260709 13:08:19.785346 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.703696 21188 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:19.779217 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.810874 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:19.805400 16538 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.000s	sys 0.020s
I20260709 13:08:19.796707 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:19.798734 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 65394.9us
I20260709 13:08:19.799026 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.705631 21339 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:19.715653 21467 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.801921 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:19.800304 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 415635us
I20260709 13:08:19.729575 21055 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.815762 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.519820 21535 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.776718 21180 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.816915 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.870232 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.871272 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.824038 16543 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:19.822731 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.829669 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.830672 21442 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.831462 21055 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:19.831993 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.834048 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.885479 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:19.886027 16614 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.835014 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 731) took 1991 ms. Trace:
I20260709 13:08:19.886472 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.886746 16536 rpcz_store.cc:276] 0709 13:08:17.843237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.843408 (+   171us) service_pool.cc:224] Handling call
0709 13:08:17.843785 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.815371 (+971586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.834783 (+1019412us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400291dd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:19.834953 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232995712}
I20260709 13:08:19.836336 21555 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.837898 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.838995 21369 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.840688 21324 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.845304 21156 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.815075 21374 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.787851 21457 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:19.854480 21332 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.855350 21361 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.856154 21172 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.776559 21548 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.523494 21376 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.857440 21518 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.858111 21250 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:19.903741 21369 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.923305 21250 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:19.924064 21535 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.924357 21250 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.859025 21550 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.927922 21550 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:19.862457 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.868867 21467 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.930395 21467 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.931077 21055 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:19.933001 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2348) took 1050 ms. Trace:
I20260709 13:08:19.865509 16467 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:19.823009 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.933436 16470 rpcz_store.cc:276] 0709 13:08:18.882454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.882617 (+   163us) service_pool.cc:224] Handling call
0709 13:08:18.883059 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.900666 (+ 17607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.932704 (+1032038us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54002a6cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:19.932937 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30960512}
I20260709 13:08:19.934284 16461 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:08:19.934664 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 111752us
I20260709 13:08:19.935726 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.884128 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.821165 21403 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:19.892283 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.727418 21483 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.896799 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.815968 21470 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.897768 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:19.970731 16536 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.002920 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.003679 17121 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:20.005066 17123 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:20.011829 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.013747 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.020066 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.027462 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:20.029201 21203 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:19.901197 21555 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:19.900095 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 541238us
I20260709 13:08:19.905762 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:19.892074 21487 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:20.038569 21487 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:19.890952 21481 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.924930 21369 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:19.914223 16614 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:19.866791 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:19.883771 21442 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.041129 21481 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:20.042299 16614 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:20.043041 21442 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.043371 21481 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.030802 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.045368 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.884119 20845 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.018422 16611 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:20.033849 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:20.021482 16536 raft_consensus.cc:2468] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:20.027745 16610 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:08:20.031667 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.045785 16614 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:08:20.029366 21294 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:20.019472 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:20.055450 17123 raft_consensus.cc:2393] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:20.055567 16436 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:20.056576 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.048656 17125 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:20.057670 16436 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:20.051235 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.051364 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.051208 16614 pending_rounds.cc:85] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:08:20.060415 16614 pending_rounds.cc:107] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:08:20.061348 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.062047 16462 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:20.060817 16614 raft_consensus.cc:2889] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:20.051354 16610 pending_rounds.cc:85] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 6
I20260709 13:08:20.063226 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.016994 21535 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:19.898192 16539 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:20.064515 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:19.979311 21561 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:20.071043 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:19.979004 21361 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:20.017534 21403 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:20.018018 21461 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 13:08:20.065647 21416 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.008s	sys 0.027s
I20260709 13:08:20.050284 21331 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:20.101567 16542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.027s	sys 0.048s
W20260709 13:08:20.117134 16542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.027s	sys 0.049s
I20260709 13:08:20.068214 21467 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.107064 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:20.053031 21301 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.015s	sys 0.013s
I20260709 13:08:20.063627 16610 pending_rounds.cc:107] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:08:20.059428 21563 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:19.918490 21457 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.063910 21481 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.138851 21481 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.139451 21481 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.139796 21376 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.059175 21334 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.053359 21369 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:20.140930 21563 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:20.141408 21369 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.141966 21563 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.143805 21369 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.107448 21535 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.148008 21535 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.148056 21555 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.149891 16619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2410) took 1425 ms. Trace:
I20260709 13:08:20.150336 16619 rpcz_store.cc:276] 0709 13:08:18.724308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.724467 (+   159us) service_pool.cc:224] Handling call
0709 13:08:20.149662 (+1425195us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540036bd54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:20.149802 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179233024}
I20260709 13:08:20.120507 21331 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.151940 21331 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.113853 21177 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.157120 21463 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.101329 21442 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:08:20.161880 21442 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:20.162345 21442 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:20.122640 21461 consensus_queue.cc:1243] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:20.185171 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.187956 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.114078 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.068287 21313 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:20.103044 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.196203 21313 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:20.117697 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:19.069919 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.121829 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.202041 16545 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:20.177455 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:19.937372 21339 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.125372 16610 raft_consensus.cc:2917] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
W20260709 13:08:20.113220 21416 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.009s	sys 0.027s
I20260709 13:08:20.129177 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:20.190099 16539 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:20.132653 21487 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.133992 21453 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:20.134790 21532 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:20.100123 21172 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:20.135192 21483 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.054379 21549 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.135577 21403 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.193442 21236 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.205073 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 736) took 1031 ms. Trace:
I20260709 13:08:20.227897 21481 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.131018 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2424) took 2120 ms. Trace:
W20260709 13:08:20.122853 21301 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.016s	sys 0.014s
I20260709 13:08:20.212978 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.213222 16610 raft_consensus.cc:2889] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:20.214136 21180 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:08:20.218575 16544 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.208534 21177 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.221115 21568 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:20.258555 21568 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:20.258724 21236 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.259491 16466 raft_consensus.cc:1240] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:20.259557 21568 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.223217 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2425) took 1130 ms. Trace:
I20260709 13:08:20.261121 16538 rpcz_store.cc:276] 0709 13:08:19.092663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.094781 (+  2118us) service_pool.cc:224] Handling call
0709 13:08:19.095201 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.304018 (+208817us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:19.812568 (+508550us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.206940 (+394372us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.206992 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.207041 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.222969 (+ 15928us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002b6954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.223024 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.223156 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214692,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":38723,"raft.queue_time_us":84,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6122,"spinlock_wait_cycles":479580544,"thread_start_us":901490,"threads_started":2}
I20260709 13:08:20.178932 21188 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.264541 21188 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.211995 21470 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:20.230181 21172 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.266948 21470 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:20.267479 21568 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:20.149910 21548 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.268926 21172 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.264762 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 2011) took 1853 ms. Trace:
I20260709 13:08:20.135607 21361 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:08:20.205508 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 76431.1us
I20260709 13:08:20.229972 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.246727 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.271677 16509 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:20.245539 21457 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.218595 21549 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.273108 21555 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.248132 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.215971 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.274070 16545 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:20.274583 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.274312 21361 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.269868 16615 rpcz_store.cc:276] 0709 13:08:18.410974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.411147 (+   173us) service_pool.cc:224] Handling call
0709 13:08:18.411551 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.342736 (+931185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.264494 (+921758us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b5400233cd4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.264673 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140070656}
I20260709 13:08:20.208834 21334 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:08:20.246763 21532 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.197489 21313 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.267473 21470 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.234894 16536 rpcz_store.cc:276] 0709 13:08:19.173412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.119405 (+945993us) service_pool.cc:224] Handling call
0709 13:08:20.204537 (+ 85132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.204720 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.204747 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.204809 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.204847 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.204901 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.205016 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:20.250811 21467 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.278684 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.289317 16465 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:20.280419 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.280742 16545 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:20.281052 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.211423 21453 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.284392 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.285959 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.238327 16542 rpcz_store.cc:276] 0709 13:08:18.010483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.013558 (+  3075us) service_pool.cc:224] Handling call
0709 13:08:18.014145 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.014573 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:18.043954 (+ 29381us) log.cc:844] Serialized 14 byte log entry
0709 13:08:18.843646 (+799692us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b18002f8120. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:08:19.090521 (+246875us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b18002f8120. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287
0709 13:08:19.393448 (+302927us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.126992 (+733544us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.130618 (+  3626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.130674 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.130730 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.130817 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.130957 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77784,"prepare.queue_time_us":437312,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":3270,"raft.queue_time_us":836664,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":8216,"spinlock_wait_cycles":24913408,"thread_start_us":1053718,"threads_started":3}
I20260709 13:08:20.294034 16545 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:20.290289 16611 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:20.298560 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:20.300575 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.303259 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.304214 16467 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:20.305282 16461 raft_consensus.cc:2393] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:20.307078 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.288048 16544 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:20.285502 21549 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.310871 16469 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.313513 16610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58162 (request call id 6) took 9572 ms. Trace:
I20260709 13:08:20.315140 16461 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:20.306756 21175 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:20.286897 21331 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.310499 21549 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.314354 16610 rpcz_store.cc:276] 0709 13:08:10.735674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.613720 (+878046us) service_pool.cc:224] Handling call
0709 13:08:11.783262 (+169542us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b2c000fd7b8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e05a0a 00007ffa35e05693 00007ffa35e05631 00007ffa375383f1 00007ffa374719fe 00007ffa374f8749 00007ffa374f976a 00007ffa374f891b 00007ffa3750403c 00007ffa375036b3
0709 13:08:11.787913 (+  4651us) log.cc:844] Serialized 501 byte log entry
0709 13:08:11.821730 (+ 33817us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b5400105520. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37476142 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354 000000000038f199 00007ffa34410475
0709 13:08:11.825114 (+  3384us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5400105520. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa3747db26 00007ffa3747749a 00007ffa37476714 00007ffa37456eaa 00007ffa3745dd53 00007ffa3745dcd9 00007ffa3745dc69 00007ffa3745dc31 00007ffa3745cdfd 000000000038f354
0709 13:08:20.305463 (+8480349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17479,"raft.queue_time_us":19680,"raft.run_cpu_time_us":4096,"raft.run_wall_time_us":33171,"spinlock_wait_cycles":15047296}
I20260709 13:08:20.301194 21467 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:20.328991 17093 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.020s
I20260709 13:08:20.330565 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:20.329418 17093 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.020s
W20260709 13:08:20.343931 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 530473us
I20260709 13:08:20.317890 21455 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.324931 21549 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.354619 21455 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.359530 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.363466 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:20.364212 16461 raft_consensus.cc:2368] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:20.365092 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.325306 21175 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.366775 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:20.367298 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.373095 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.387329 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:20.353320 21177 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:20.415161 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:20.415330 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.370915 21324 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.436847 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.436532 17122 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.436944 16511 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:20.442359 16611 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:20.449739 16511 leader_election.cc:400] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:20.449918 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53652 (request call id 925) took 1368 ms. Trace:
I20260709 13:08:20.450145 16511 leader_election.cc:403] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.450829 17119 rpcz_store.cc:276] 0709 13:08:19.081234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.081372 (+   138us) service_pool.cc:224] Handling call
0709 13:08:20.449676 (+1368304us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54006beed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:20.449841 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167308032}
I20260709 13:08:20.455322 21463 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.457265 21467 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.440810 21457 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:08:20.463819 17122 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:20.464856 21412 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:20.466236 21412 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:20.467535 21412 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.471745 21463 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:20.400040 21481 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.475016 16583 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.477229 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.435295 21374 raft_consensus.cc:2764] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:08:20.480417 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.480857 16583 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:20.547518 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 66776.1us
I20260709 13:08:20.610981 16462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2016) took 1094 ms. Trace:
I20260709 13:08:20.611714 16462 rpcz_store.cc:276] 0709 13:08:19.516303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.817603 (+301300us) service_pool.cc:224] Handling call
0709 13:08:19.817846 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.062596 (+244750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.610689 (+548093us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540037a854. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.610907 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":560561920}
I20260709 13:08:20.613940 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.615345 17119 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:20.626137 21250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.016s	sys 0.027s
I20260709 13:08:20.610249 21486 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.509114 21188 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:20.628553 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.596493 21467 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.507542 21434 consensus_queue.cc:1059] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.120s
W20260709 13:08:20.644574 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.013s	sys 0.030s
W20260709 13:08:20.647395 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.013s	sys 0.030s
W20260709 13:08:20.647969 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 583517us
I20260709 13:08:20.595762 21457 consensus_queue.cc:1059] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:20.610011 21447 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 13:08:20.630951 21250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.017s	sys 0.027s
W20260709 13:08:20.662528 16468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.017s	sys 0.039s
W20260709 13:08:20.662972 16468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.017s	sys 0.039s
W20260709 13:08:20.663605 21055 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.018s	sys 0.020s
W20260709 13:08:20.664033 21055 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.020s
W20260709 13:08:20.664570 21572 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:08:20.666255 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:20.664645 17091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.014s	sys 0.009s
W20260709 13:08:20.667933 17091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.009s
I20260709 13:08:20.670670 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.673840 17125 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.654641 21331 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.642935 21177 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:08:20.688311 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:20.685643 21570 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:20.680462 21231 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:20.676486 21578 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:20.649520 21188 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.680820 21374 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:20.713680 21455 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.715464 21231 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:20.714778 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2147) took 1370 ms. Trace:
W20260709 13:08:20.722064 21523 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.018s	sys 0.029s
I20260709 13:08:20.721554 21374 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.719684 21578 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:20.735774 21523 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.018s	sys 0.029s
I20260709 13:08:20.729270 16538 rpcz_store.cc:276] 0709 13:08:19.344625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.262884 (+918259us) service_pool.cc:224] Handling call
0709 13:08:20.263188 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.263385 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:20.263690 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.714315 (+450625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.714387 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:20.714447 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.714534 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.714706 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4443,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":1352,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3186,"thread_start_us":448848,"threads_started":1}
W20260709 13:08:20.743717 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.732487 21175 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:20.747551 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:20.756055 16539 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:20.754338 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:20.743733 21231 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.778870 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.779711 16538 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:20.780738 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.781298 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:20.784087 21577 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:20.785432 21401 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:20.785838 21401 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:20.786265 21578 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.786619 21401 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.787681 21401 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.779737 21231 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:20.792140 21374 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.798276 21340 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:20.798764 21340 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:20.799845 21340 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.801496 16366 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 13, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:20.803153 16366 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 3 to 9, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 9 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:20.805372 21581 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:20.808960 16366 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 13, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 13 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.798656 21176 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:20.811321 16366 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 8 to 10, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 10 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.812251 16468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 654) took 1306 ms. Trace:
I20260709 13:08:20.742595 21470 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.817061 16468 rpcz_store.cc:276] 0709 13:08:19.505661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.815895 (+310234us) service_pool.cc:224] Handling call
0709 13:08:19.853879 (+ 37984us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:19.854275 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.854306 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:19.854891 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:08:20.663381 (+808490us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:20.663427 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.663518 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.811973 (+148455us) raft_consensus.cc:1685] finished
0709 13:08:20.812002 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.812175 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1229,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":808104,"threads_started":1,"wal-append.queue_time_us":810312}
I20260709 13:08:20.819458 16539 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
W20260709 13:08:20.808588 16362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 279) took 21002 ms (client timeout 15000 ms). Trace:
I20260709 13:08:20.829759 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2131) took 1675 ms. Trace:
I20260709 13:08:20.831413 16541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2133) took 1661 ms. Trace:
I20260709 13:08:20.831907 16541 rpcz_store.cc:276] 0709 13:08:19.169957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.929214 (+759257us) service_pool.cc:224] Handling call
0709 13:08:19.929535 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.208159 (+278624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.208201 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.208275 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.208328 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.831145 (+622817us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000334d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.831203 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.831347 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640233856}
I20260709 13:08:20.830986 16509 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.830196 16537 rpcz_store.cc:276] 0709 13:08:19.154979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.155181 (+   202us) service_pool.cc:224] Handling call
0709 13:08:19.155490 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.291629 (+136139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.291663 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.292130 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.883311 (+591181us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b180043bca0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:20.317142 (+433831us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:20.317190 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.829398 (+512208us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400381154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.829465 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.829525 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:20.829542 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.829702 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":723,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6280,"spinlock_wait_cycles":365768832,"thread_start_us":432812,"threads_started":1,"wal-append.queue_time_us":1335890}
I20260709 13:08:20.838300 16543 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:20.819535 21455 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.838838 16366 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.845242 16542 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:20.846884 16366 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 13 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.848440 16366 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 12 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:20.850327 16366 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.853547 16509 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.820381 21176 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.855849 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.846247 21457 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.842353 21455 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.873613 16509 leader_election.cc:400] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13.
I20260709 13:08:20.884286 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.885206 16537 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:20.891314 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:20.897003 21579 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:20.897761 21579 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.900995 21183 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:20.901721 21183 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.904345 21183 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:20.905311 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:20.906075 16544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 2145) took 1562 ms (client timeout 2013 ms). Trace:
I20260709 13:08:20.912292 21563 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:20.914039 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:20.924183 16544 rpcz_store.cc:269] 0709 13:08:19.343994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.699029 (+355035us) service_pool.cc:224] Handling call
0709 13:08:20.905848 (+1206819us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001aac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:20.905997 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133767936}
I20260709 13:08:20.914799 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2441) took 1217 ms. Trace:
I20260709 13:08:20.926402 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.926849 16543 rpcz_store.cc:276] 0709 13:08:19.697460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.276531 (+579071us) service_pool.cc:224] Handling call
0709 13:08:20.288457 (+ 11926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.838737 (+550280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.914565 (+ 75828us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002b5a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:20.914745 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260638976}
I20260709 13:08:20.915072 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.915719 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:20.916396 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:20.863723 21168 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.930615 16544 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:20.920060 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:20.923627 21481 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:20.930752 21168 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:20.919474 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.881278 21578 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.949122 16543 raft_consensus.cc:3055] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:20.944625 16544 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:08:20.947124 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.950493 16537 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:20.951962 21594 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:08:20.957201 21580 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:08:20.958261 21590 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:08:20.958949 21188 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:20.932102 21574 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:08:20.959900 21593 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:08:20.961194 16613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2418) took 1241 ms. Trace:
I20260709 13:08:20.931509 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.925386 21579 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:20.949743 16543 raft_consensus.cc:740] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:20.957490 21585 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:08:20.966579 16543 consensus_queue.cc:260] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:20.971872 16543 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.961985 21334 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:20.975123 21334 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:20.977286 21589 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:08:20.977766 21334 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:20.978060 21587 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:08:20.981477 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
W20260709 13:08:20.982395 21562 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.050s	user 0.009s	sys 0.000s
W20260709 13:08:20.985556 21557 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.010s	user 0.002s	sys 0.006s
W20260709 13:08:20.986788 21588 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:08:20.989092 16467 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:20.989961 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.989059 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:20.991144 16463 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:20.992403 16464 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:20.994753 21579 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.995334 21579 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:20.997619 21597 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:20.999302 21470 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.000337 21403 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.000880 21403 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.001336 21176 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.002689 16464 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:21.002892 21403 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:21.005722 21549 consensus_meta.cc:287] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:08:21.006129 21549 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.007149 16536 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:21.008104 21591 log.cc:927] Time spent T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:08:21.008872 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2152) took 1171 ms. Trace:
I20260709 13:08:21.009238 16536 rpcz_store.cc:276] 0709 13:08:19.837062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.292565 (+455503us) service_pool.cc:224] Handling call
0709 13:08:20.308410 (+ 15845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.007510 (+699100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.008624 (+  1114us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540024fed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:21.008814 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606548864}
I20260709 13:08:21.010627 21332 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:21.011293 21332 consensus_queue.cc:1243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:08:21.012521 21455 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.012964 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:21.014295 21168 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.014206 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.014945 16464 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:21.016189 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.017545 21332 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:21.018054 21332 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.018352 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:20.961711 16613 rpcz_store.cc:276] 0709 13:08:19.720197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.720318 (+   121us) service_pool.cc:224] Handling call
0709 13:08:19.720602 (+   284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:19.728817 (+  8215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.728860 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:19.775725 (+ 46865us) log.cc:844] Serialized 52 byte log entry
0709 13:08:20.293234 (+517509us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:20.293274 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.293340 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.960879 (+667539us) raft_consensus.cc:1685] finished
0709 13:08:20.960911 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.961115 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7782,"raft.queue_time_us":7886,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":39152,"thread_start_us":448188,"threads_started":1,"wal-append.queue_time_us":931012}
I20260709 13:08:21.019556 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:20.997560 21579 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.023088 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:21.018648 21332 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.024761 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:20.908514 21442 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.024138 21339 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.042982 16582 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.043681 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:21.045145 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.933301 21563 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.044226 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.050797 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:21.048517 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 391983us
I20260709 13:08:21.056886 17125 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:21.061528 21443 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.065946 21055 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:20.949406 21481 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.057307 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:20.852195 16366 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:21.077842 16465 raft_consensus.cc:1240] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:21.038695 21453 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.080510 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:20.964818 21183 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:08:21.080868 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:20.830214 16362 rpcz_store.cc:269] 0709 13:07:59.806359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.806753 (+   394us) service_pool.cc:224] Handling call
0709 13:08:20.808335 (+21001582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.265154 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.265847 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.265903 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:13.265939 (+    36us) tablet.cc:662] Decoding operations
0709 13:08:13.267272 (+  1333us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.267361 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.267396 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:13.268588 (+  1192us) tablet.cc:701] Row locks acquired
0709 13:08:13.268639 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:08:13.312018 (+ 43379us) write_op.cc:270] Start()
0709 13:08:13.332885 (+ 20867us) write_op.cc:276] Timestamp: P: 1783602493268743 usec, L: 0
0709 13:08:13.332927 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.342618 (+  9691us) log.cc:844] Serialized 4780 byte log entry
0709 13:08:14.121428 (+778810us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.875908 (+754480us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa343f30ac 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3af33ef0
0709 13:08:15.059940 (+184032us) write_op.cc:301] APPLY: starting
0709 13:08:15.060062 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.176984 (+116922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.177021 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.618544 (+441523us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.676005 (+ 57461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:15.767069 (+ 91064us) write_op.cc:312] APPLY: finished
0709 13:08:15.829117 (+ 62048us) log.cc:844] Serialized 113 byte log entry
0709 13:08:15.877438 (+ 48321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.904994 (+ 27556us) write_op.cc:454] Released schema lock
0709 13:08:15.913918 (+  8924us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.930486 (+ 16568us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.930527 (+    41us) write_op.cc:454] Released schema lock
0709 13:08:16.121394 (+190867us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
Metrics: {"mutex_wait_us":248929,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":908680,"apply.run_cpu_time_us":25668,"apply.run_wall_time_us":875373,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":377436,"prepare.run_cpu_time_us":38648,"prepare.run_wall_time_us":359465,"raft.queue_time_us":340825,"raft.run_cpu_time_us":58961,"raft.run_wall_time_us":1113895,"replication_time_us":759601,"spinlock_wait_cycles":55969536,"thread_start_us":1649557,"threads_started":5,"wal-append.queue_time_us":463622,"wal-append.run_cpu_time_us":38245,"wal-append.run_wall_time_us":2516593}]]}
I20260709 13:08:21.056169 21486 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.055718 21403 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.074553 21444 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.037935 21177 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:21.085597 21416 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.077209 21555 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.073735 21188 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:21.081658 21523 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.103013 16511 leader_election.cc:400] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:21.103853 21203 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.123816 16464 pending_rounds.cc:85] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 12
I20260709 13:08:21.125968 16464 pending_rounds.cc:107] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:21.126243 16464 raft_consensus.cc:2889] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.123764 16466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2359) took 1692 ms. Trace:
I20260709 13:08:21.127020 16466 rpcz_store.cc:276] 0709 13:08:19.431265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.431505 (+   240us) service_pool.cc:224] Handling call
0709 13:08:19.431807 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.260092 (+828285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.123561 (+863469us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54000b3954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:21.123714 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903050496}
I20260709 13:08:21.124747 17118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 934) took 1092 ms. Trace:
W20260709 13:08:21.125054 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.129271 17118 rpcz_store.cc:276] 0709 13:08:20.032846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.054748 (+ 21902us) service_pool.cc:224] Handling call
0709 13:08:20.102185 (+ 47437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.169141 (+ 66956us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:20.709200 (+540059us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.963565 (+254365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:20.963629 (+    64us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:20.963692 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.124557 (+160865us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b5400661554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:21.124598 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.124696 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":587798,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":630,"raft.queue_time_us":95,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2436,"spinlock_wait_cycles":153196800,"thread_start_us":739609,"threads_started":2,"wal-append.queue_time_us":402411}
I20260709 13:08:21.122653 16511 leader_election.cc:403] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:21.122113 16366 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:21.184064 16436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.67:44347 timed out after 2.471s (SENT) [suppressed 7 similar messages]
I20260709 13:08:21.185129 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 936) took 1092 ms. Trace:
I20260709 13:08:21.185515 17124 rpcz_store.cc:276] 0709 13:08:20.093243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.094439 (+  1196us) service_pool.cc:224] Handling call
0709 13:08:20.094859 (+   420us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:20.116818 (+ 21959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.116857 (+    39us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:20.123688 (+  6831us) log.cc:844] Serialized 78 byte log entry
0709 13:08:20.687629 (+563941us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.687686 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.687778 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.184909 (+497131us) raft_consensus.cc:1685] finished
0709 13:08:21.184929 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.185077 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92153,"raft.queue_time_us":19740,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"thread_start_us":472684,"threads_started":1,"wal-append.queue_time_us":617228}
W20260709 13:08:21.189707 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 90729.9us
I20260709 13:08:21.210158 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:21.214044 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 170410us
I20260709 13:08:21.214860 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.113142 21416 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.217018 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.213188 21156 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.188998 21486 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.114595 21555 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.188601 21444 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.224546 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.221256 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.222496 21203 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.219072 21156 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.225620 21578 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:21.232652 21600 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:21.233003 21578 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.233739 21156 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.233911 21444 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:21.234498 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.234472 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.235805 21578 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.236147 21444 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.199528 21447 consensus_queue.cc:1059] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:08:21.235817 21563 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:21.199451 21599 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:21.239037 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.242660 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.241767 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:21.197937 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 138790us
I20260709 13:08:21.242059 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.219777 21176 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:21.246518 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.247148 16461 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:21.231469 21183 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.231459 21579 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.219204 21231 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:08:21.259207 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 75170.4us
I20260709 13:08:21.229300 21486 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.257922 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.260001 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:21.262987 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:21.203707 16366 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.263614 17119 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:21.246104 21549 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:21.257172 21592 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:08:21.245808 21470 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.268141 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:21.268352 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.261472 21578 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.273617 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.278401 21486 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.264917 21608 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.266449 16366 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.281901 21555 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.271345 21177 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:21.281869 16366 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.282881 21177 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.283974 21416 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.257462 21176 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.286829 17090 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.287031 21176 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.288002 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.290246 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:21.292691 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:21.294910 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:21.295754 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:21.279460 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.296864 21177 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:21.297508 21177 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.297886 21177 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.298251 21177 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.288797 21579 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.296489 21486 consensus_queue.cc:1059] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:21.305052 21486 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.305434 21486 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.305760 21486 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.305925 21332 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.308625 21332 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:21.309281 21607 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:21.310118 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:21.311779 21579 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:21.313927 21579 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.314431 21369 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.314548 21486 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.289672 21549 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.269696 21444 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:21.310876 21608 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:21.311162 21523 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:21.311400 21401 raft_consensus.cc:2804] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.311652 21334 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.311589 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:21.355818 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44298.2us
I20260709 13:08:21.312013 21313 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:21.267824 21601 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.317425 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:21.324209 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44838.5us
I20260709 13:08:21.328656 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:21.331924 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58392.7us
I20260709 13:08:21.361819 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.366907 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:21.363493 17090 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.362493 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.386078 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:21.341239 21470 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:21.389654 17090 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.361059 21555 raft_consensus.cc:3055] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:21.392731 17090 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:21.393405 21555 raft_consensus.cc:740] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:21.395900 17090 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.389664 21583 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.396976 21324 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:21.397500 21324 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.397579 21322 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:21.398077 21324 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.397861 21555 consensus_queue.cc:260] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.398696 21322 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:21.398888 21555 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.399067 21322 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:21.399916 21322 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:21.357700 21334 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.401000 21334 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.410122 21486 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:21.413205 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.414353 16462 raft_consensus.cc:2410] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:21.419592 21548 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:21.438910 17120 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:21.362171 21582 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:21.384675 21156 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:21.361618 21401 raft_consensus.cc:697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:21.480901 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.482227 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:21.505453 16464 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.354418 21444 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:21.506493 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 110776us
I20260709 13:08:21.391958 21578 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:21.512151 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 116821us
I20260709 13:08:21.394541 21369 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.513541 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.359248 21177 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.358001 21523 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.540126 16613 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:21.508412 21583 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.511123 21176 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.541280 21583 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.541836 21176 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.542403 21176 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.538674 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.542937 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:21.506207 21582 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:21.513743 21455 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:21.559773 16463 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:21.532716 16464 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:21.553530 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.513907 21188 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:21.564321 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:21.538651 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.566015 16612 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:21.566906 21177 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.568485 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.568979 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:21.569657 17118 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.569737 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.570380 16614 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:21.571163 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.571791 16614 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:21.572422 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:21.579909 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.525804 21608 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.580796 21608 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.581200 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.582149 21444 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.582203 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.582800 21608 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.574934 21188 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.583451 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.583540 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.584512 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.584986 21188 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.525302 21548 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.577656 21401 consensus_queue.cc:237] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.579898 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:21.586128 16610 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.586318 21168 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.586766 21168 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:21.587610 21168 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.521150 21470 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:21.588709 21470 consensus_queue.cc:1243] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 98881185daee4f13b69385e36026216c log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:21.592660 21481 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.592717 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:21.594930 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:21.595615 16543 raft_consensus.cc:2393] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:21.601365 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:21.602022 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.602623 16466 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:21.569098 16613 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:21.580116 16465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2030) took 1282 ms. Trace:
I20260709 13:08:21.606536 17120 pending_rounds.cc:85] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Aborting all ops after (but not including) 11
I20260709 13:08:21.606874 17120 pending_rounds.cc:107] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:21.607115 17120 raft_consensus.cc:2889] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.607128 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:21.596666 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.606114 16465 rpcz_store.cc:276] 0709 13:08:20.297830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.298335 (+   505us) service_pool.cc:224] Handling call
0709 13:08:20.298653 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.078318 (+779665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.579867 (+501549us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54002a80d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:21.580055 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791550336}
I20260709 13:08:21.579423 21583 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:21.510843 21566 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:21.622517 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 236511us
I20260709 13:08:21.631697 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:21.618489 17118 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:21.546123 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.536049 21322 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.636662 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.639801 16462 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:21.536338 21617 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:21.666585 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.679430 16610 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
W20260709 13:08:21.681777 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 71731.4us
I20260709 13:08:21.684942 16610 raft_consensus.cc:1240] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:08:21.686901 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:21.687227 16610 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:21.691924 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.681334 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:21.653580 21168 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:21.698429 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:21.705229 16462 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:21.699661 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.708425 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:21.657085 21447 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.702462 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49220.7us
I20260709 13:08:21.715253 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:21.716989 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 205016us
I20260709 13:08:21.694514 21369 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:21.702448 21301 raft_consensus.cc:3055] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:21.657665 21470 consensus_queue.cc:1059] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:08:21.756026 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.680672 21555 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:08:21.711361 21563 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:21.677929 21055 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:08:21.738516 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:21.766923 16462 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
W20260709 13:08:21.779578 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64351.7us
I20260709 13:08:21.781852 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:21.770869 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51489.2us
I20260709 13:08:21.698839 21599 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:08:21.792337 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:21.751995 21401 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:21.680307 21617 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:21.793358 21575 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:21.752720 21301 raft_consensus.cc:740] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:21.773712 21563 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:21.721330 21447 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.793829 21618 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.796494 21055 consensus_queue.cc:1243] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:08:21.826944 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 126552us
I20260709 13:08:21.805562 21203 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.769840 21369 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.809885 21401 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.805266 21578 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.854405 21416 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:21.814977 21324 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.830708 21334 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.736871 21582 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.817481 21548 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.859548 16614 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:21.901214 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 68894.4us
W20260709 13:08:21.878104 21633 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 13:08:21.910467 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 67324.3us
I20260709 13:08:21.873106 21579 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:21.865089 21401 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.857026 21523 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.863173 21455 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:21.869827 21324 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.872210 21334 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.859113 21447 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:21.890388 21625 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.876253 21630 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:21.872574 21548 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.867561 21176 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.910509 21627 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:21.865552 21578 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.940699 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:21.916189 21369 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:21.872272 21203 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.995281 21203 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:21.946456 20845 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:21.916723 21579 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:21.997438 21579 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.001307 21176 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:22.002404 16611 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:21.998885 21579 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.975730 17118 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:21.982918 21632 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:08:21.987907 21324 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:21.990553 21467 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:21.877130 21301 consensus_queue.cc:260] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.006038 21444 consensus_queue.cc:1059] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:22.010316 21627 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.011070 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.068585 16543 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:22.069883 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:22.071209 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.011333 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.073544 17122 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:22.012192 16544 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:08:22.013371 16537 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:22.072526 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:22.077271 16543 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:22.077996 16537 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:22.014086 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.015136 16542 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:22.015520 21234 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.018122 21639 log.cc:927] Time spent T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:08:21.971971 21630 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:21.857523 21563 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:21.856693 21617 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:22.035104 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.038221 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:21.931885 21623 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:22.061372 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.110993 16538 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:22.111346 16539 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
W20260709 13:08:22.083498 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.091632 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 310034us
I20260709 13:08:22.095718 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.098239 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:22.099577 16542 pending_rounds.cc:85] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 10
I20260709 13:08:22.113134 16542 pending_rounds.cc:107] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:22.113096 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.113725 16542 raft_consensus.cc:2889] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.115128 16544 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:22.134565 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.137665 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.140232 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.088398 16465 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:22.145370 16543 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:22.114810 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:22.115803 21623 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.118718 21548 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.119642 21301 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.108665 21234 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.153142 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.153975 16618 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:22.156524 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:22.152151 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 434503us
I20260709 13:08:22.122677 21630 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.168177 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.168586 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.175940 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.176258 17122 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:22.178436 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.132800 21653 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:22.263304 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84952.5us
W20260709 13:08:22.270532 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.270982 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.177608 16436 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:22.271927 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.274089 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.274884 17120 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
W20260709 13:08:22.279655 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 102126us
I20260709 13:08:22.284209 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.272837 21599 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.285210 21313 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:22.285727 21313 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:22.285594 21599 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.286582 21313 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.287711 21599 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:22.288702 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 96766.2us
I20260709 13:08:22.289040 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.289681 17122 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:22.289736 21340 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:22.289767 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:22.294796 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.295410 16612 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:22.296007 21566 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:22.296561 21566 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.297075 21566 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:22.168716 21168 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:22.304901 17122 raft_consensus.cc:1240] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:22.304868 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:22.311133 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:22.312877 16618 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:22.314810 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:22.316150 16585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.012s
W20260709 13:08:22.316592 16585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.012s
W20260709 13:08:22.316987 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 539723us
I20260709 13:08:22.176820 21334 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.263972 21463 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.281711 21574 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:08:22.325080 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.269095 21630 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.328398 17122 raft_consensus.cc:2393] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:22.326273 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:22.368321 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.307507 21168 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.305069 21638 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:22.280527 21643 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.365820 21599 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.325397 21176 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:08:22.376611 21168 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:22.329845 21629 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:08:22.326604 21467 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:08:22.380437 21638 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.331918 21463 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.391745 21599 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:22.418274 21620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.010s	sys 0.020s
W20260709 13:08:22.431615 21651 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:22.432350 21638 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:22.430256 21578 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.435482 21599 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:22.466075 21644 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:22.468611 21463 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:22.509788 21625 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:08:22.474004 21627 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.518731 21625 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:22.532276 21623 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:22.538587 21662 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:08:22.536454 21631 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:08:22.545831 21666 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 13:08:22.577275 16433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.010s
W20260709 13:08:22.578329 16433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.006s	sys 0.010s
W20260709 13:08:22.578806 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 800185us
W20260709 13:08:22.586033 16433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.329236 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 447884us
W20260709 13:08:22.588471 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.592021 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.580566 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:22.587237 16462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.028s	sys 0.053s
W20260709 13:08:22.600948 16462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.029s	sys 0.053s
I20260709 13:08:22.368762 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:22.603680 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:22.603721 16540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2467) took 1168 ms. Trace:
I20260709 13:08:22.609733 16540 rpcz_store.cc:276] 0709 13:08:21.434814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.434978 (+   164us) service_pool.cc:224] Handling call
0709 13:08:21.435389 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.451634 (+ 16245us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:21.697367 (+245733us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.914688 (+217321us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.921022 (+  6334us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.921222 (+   200us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:21.921271 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.921363 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.501996 (+580633us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b480021e058. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:08:22.602900 (+100904us) raft_consensus.cc:1685] finished
0709 13:08:22.603087 (+   187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.603451 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15738,"prepare.queue_time_us":264431,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":17934,"raft.run_cpu_time_us":17577,"raft.run_wall_time_us":1061011,"spinlock_wait_cycles":38681984,"thread_start_us":397082,"threads_started":2,"wal-append.queue_time_us":569523}
W20260709 13:08:22.612078 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 243262us
I20260709 13:08:22.615517 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:22.616956 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.618076 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2439) took 1055 ms. Trace:
I20260709 13:08:22.618583 16611 rpcz_store.cc:276] 0709 13:08:21.563856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.564013 (+   157us) service_pool.cc:224] Handling call
0709 13:08:22.617607 (+1053594us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54003e7954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:22.617862 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005262720}
I20260709 13:08:22.620477 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:22.621479 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2438) took 1080 ms. Trace:
I20260709 13:08:22.621598 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:22.621876 16615 rpcz_store.cc:276] 0709 13:08:21.544548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.544842 (+   294us) service_pool.cc:224] Handling call
0709 13:08:22.620069 (+1075227us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:22.621405 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36017536}
I20260709 13:08:22.616956 16463 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:22.633288 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:22.624807 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:22.638425 16434 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:22.618702 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:22.643821 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.646795 21055 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:22.676668 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60023.4us
I20260709 13:08:22.655706 21234 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:22.678884 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:22.685660 21374 raft_consensus.cc:3055] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:22.690876 17119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53652 (request call id 953) took 1262 ms. Trace:
I20260709 13:08:22.691494 17119 rpcz_store.cc:276] 0709 13:08:21.428200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.428568 (+   368us) service_pool.cc:224] Handling call
0709 13:08:21.509694 (+ 81126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:22.689084 (+1179390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:22.689169 (+    85us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.689254 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:22.689305 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.690308 (+  1003us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400684554. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:22.690368 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.690642 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2710663424}
I20260709 13:08:22.657799 21177 raft_consensus.cc:3055] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:22.705008 21177 raft_consensus.cc:740] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:22.676833 21055 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.706774 21188 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.707266 21442 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:22.707680 21188 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.693168 21434 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.709445 21334 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.709992 21434 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.686339 21374 raft_consensus.cc:740] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:22.694203 21332 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.712242 21374 consensus_queue.cc:260] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.713140 21332 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:22.713629 21374 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:22.702188 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.717605 21434 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.653316 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.726305 21434 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:22.726573 17120 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:22.706737 21177 consensus_queue.cc:260] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.727248 21188 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.713704 21332 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.728220 21177 raft_consensus.cc:3060] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.718354 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:22.719373 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:22.710248 21334 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.652475 20845 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:22.730398 20845 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.730844 20845 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:22.703150 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:22.732612 21055 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:22.733271 21055 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:22.697887 21339 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:22.734730 21055 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.735332 21339 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:22.739785 21339 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.719923 21183 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:22.672607 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 48013.6us
I20260709 13:08:22.727329 21434 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.720799 21168 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:22.777240 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.795624 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.752404 21334 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:22.837976 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:22.838104 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.840083 21648 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.842121 21188 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.842399 21650 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:22.842928 21650 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:22.843001 21188 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.843441 21650 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:22.841354 21625 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:22.841603 21657 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 13:08:22.818125 21434 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.856686 21625 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.859411 21625 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.861676 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:22.861966 21434 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.862774 21434 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:22.863452 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:22.829711 21183 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.865010 21640 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:22.865675 21640 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.867354 21183 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:22.868167 21183 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.872332 16617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2448) took 1302 ms. Trace:
W20260709 13:08:22.871970 16541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.015s
W20260709 13:08:22.873890 16541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.011s	sys 0.016s
I20260709 13:08:22.829329 21626 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.885632 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.872859 16617 rpcz_store.cc:276] 0709 13:08:21.569314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.621727 (+ 52413us) service_pool.cc:224] Handling call
0709 13:08:21.678602 (+ 56875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:21.699767 (+ 21165us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:21.734498 (+ 34731us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.939825 (+205327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:22.604536 (+664711us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b2c000fd7b8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:08:22.605866 (+  1330us) log.cc:844] Serialized 26 byte log entry
0709 13:08:22.606159 (+   293us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:22.606236 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.606370 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:22.871742 (+265372us) raft_consensus.cc:1685] finished
0709 13:08:22.871870 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.872099 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73636,"prepare.queue_time_us":36226,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":85007,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":9254,"spinlock_wait_cycles":15853824,"thread_start_us":110570,"threads_started":1,"wal-append.queue_time_us":559000}
W20260709 13:08:22.855778 21401 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.759s	user 0.007s	sys 0.011s
I20260709 13:08:22.897302 21401 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.897734 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:22.900069 21401 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.900230 21374 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.868914 21168 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:22.869707 16542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.009s
I20260709 13:08:22.901341 21234 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:22.864318 21624 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:22.902851 16436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.002s	sys 0.013s
I20260709 13:08:22.900409 21203 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.903324 16436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.002s	sys 0.013s
I20260709 13:08:22.903513 16616 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:22.903594 21203 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:22.901480 16542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.014s	sys 0.009s
I20260709 13:08:22.871059 21188 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.868203 21640 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:22.912233 16615 raft_consensus.cc:2468] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
W20260709 13:08:22.871589 21566 consensus_meta.cc:287] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.005s
I20260709 13:08:22.922678 16585 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:22.897307 21340 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.016s
I20260709 13:08:22.953691 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.954668 16538 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
W20260709 13:08:22.928110 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.956741 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.962651 21646 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:22.928128 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.963523 21646 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.928998 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:22.965231 17118 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:22.967234 21443 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.967841 21443 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.969508 16619 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:22.928252 21176 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.933290 21548 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:22.973090 21176 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.973318 21548 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:22.929867 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.975817 16537 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:22.934947 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:22.937328 21566 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.938587 16468 raft_consensus.cc:1240] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:08:22.939150 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.981839 16545 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:22.939675 21231 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.983160 21566 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:22.937080 21374 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.939670 21203 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.945003 16434 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:22.947113 16543 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:08:22.986582 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 59317.4us
I20260709 13:08:22.988142 21646 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:22.948729 21301 consensus_meta.cc:287] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.010s
I20260709 13:08:22.951421 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.952199 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:22.953094 21650 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:22.910352 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 623139us
I20260709 13:08:22.962393 20845 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:22.963034 21599 consensus_meta.cc:287] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.009s
I20260709 13:08:22.982897 21231 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:22.997277 16540 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:22.985381 21374 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:22.945705 16536 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:22.946448 21332 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.007989 21332 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:23.008265 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.008955 21231 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.012363 21176 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.013120 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:22.998016 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:22.944517 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42898 (request call id 764) took 1372 ms. Trace:
I20260709 13:08:23.015241 16616 rpcz_store.cc:276] 0709 13:08:21.572367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.585344 (+ 12977us) service_pool.cc:224] Handling call
0709 13:08:21.699510 (+114166us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800191198. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d8a22 00007ffa3d2f1c09 00007ffa3c44bee0 00007ffa3c5150ab 00007ffa3c515131 00007ffa3c4c30a0 00007ffa3c4c2984 00007ffa35a3d6d4 00007ffa35a3d662
0709 13:08:22.944269 (+1244759us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002486d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:22.944449 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2806432384}
I20260709 13:08:22.976087 21548 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:22.999715 21555 raft_consensus.cc:3060] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.000129 16542 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:23.000952 16436 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.001116 21486 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.002516 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:23.004372 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.022233 16613 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:23.016661 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:23.004375 21638 consensus_meta.cc:287] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 13:08:23.028369 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.039830 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.022588 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:23.026144 21673 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 13:08:23.057621 21563 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.059643 21301 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.060379 21301 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.053535 17120 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:23.049278 20845 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.024801 21599 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.062717 21313 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.062912 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 62123.1us
I20260709 13:08:23.063334 21301 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.063957 21599 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.065233 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.049474 21374 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.066546 21374 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.065302 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.067529 16543 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:23.052865 16611 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:23.068599 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 213665us
I20260709 13:08:23.069589 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.070868 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.071772 16616 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:23.043893 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.073153 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.053339 21618 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.074263 21618 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.074687 21618 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.043471 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.081437 16612 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:23.082437 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.083487 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.068636 21374 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:23.084450 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 82080.4us
I20260709 13:08:23.085256 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.086014 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.087486 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.093227 21625 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.093732 21625 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.094099 21625 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.072628 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.049079 17093 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:23.102566 21640 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:23.102823 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 54025.8us
I20260709 13:08:23.103071 21640 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.103564 21640 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.104614 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.056860 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:23.107777 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51030.8us
I20260709 13:08:23.111618 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.114902 16613 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:23.115197 17125 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:23.108590 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:23.118373 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.119953 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.120900 16509 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.042436 21650 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.115314 21313 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.128392 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.120584 20845 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:08:23.136828 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.142251 21331 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:23.142488 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78239us
I20260709 13:08:23.142866 21331 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:23.143450 21331 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.139381 21548 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:23.145615 21168 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:23.138772 20845 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.149231 20845 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.153254 21548 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:23.154358 21548 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.157001 16463 raft_consensus.cc:1240] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:23.157999 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8e851f11d27b4a83aa395e05c4be6808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:23.158202 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.158742 21443 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:23.159005 16539 raft_consensus.cc:1240] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
W20260709 13:08:23.167929 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 59405.4us
I20260709 13:08:23.169150 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:23.170519 21650 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.170996 21650 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.171460 21650 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:23.173605 21334 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:23.174873 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:23.116544 21599 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.176333 21599 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.179102 21599 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.182039 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.183079 16541 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:23.182128 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.183836 16538 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:23.185547 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.185678 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.186877 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:23.187706 16538 raft_consensus.cc:2393] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:23.187809 16543 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:23.105051 21638 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.197789 16538 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:23.130358 21313 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.195806 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:23.199048 16542 pending_rounds.cc:85] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 10
I20260709 13:08:23.204982 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:23.203135 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:23.209076 16539 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:23.209898 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 65710.6us
I20260709 13:08:23.208477 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:23.194607 21168 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:23.156256 21618 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.212857 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:23.204319 16542 pending_rounds.cc:107] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:08:23.218016 16542 raft_consensus.cc:2889] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.219713 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:23.220331 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.218446 17093 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.200553 21555 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.221031 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:23.203119 21313 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.233742 16541 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:23.235266 16536 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:23.238657 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44144.9us
I20260709 13:08:23.239660 17093 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.216746 21168 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.211391 21301 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:23.249747 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44841.7us
I20260709 13:08:23.237201 21599 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.243271 21626 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.218819 21188 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:08:23.246519 21434 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:23.270509 21481 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.248875 21168 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:23.270922 21583 raft_consensus.cc:2804] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:23.343945 21583 raft_consensus.cc:697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:23.345525 21583 consensus_queue.cc:237] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.273900 21401 raft_consensus.cc:2804] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:23.274577 21301 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.353210 21401 raft_consensus.cc:697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:23.354573 21301 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.270958 16614 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.275739 21659 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.300215 21434 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:23.287029 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 389573us
I20260709 13:08:23.355538 21434 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:23.283591 21625 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.292116 16467 raft_consensus.cc:1240] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.356189 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.357056 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.357959 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.291568 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:23.358465 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.359516 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.359805 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.360422 16466 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:23.293346 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:23.361119 16470 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.361271 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:23.361943 16466 raft_consensus.cc:3060] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:23.364476 21682 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:08:23.293901 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:23.355507 21659 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.294751 20845 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:23.367532 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 64607.4us
I20260709 13:08:23.367677 21659 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.262991 21055 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.368371 21055 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.368633 20845 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.370436 21055 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:23.370987 21640 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.371824 21625 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.373135 21453 raft_consensus.cc:2764] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:23.373975 21618 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.297039 21156 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:23.374456 21453 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.375188 21156 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:23.375527 21156 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:23.293828 21638 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.309628 21599 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.309479 21481 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.323558 21313 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.326411 21670 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:23.327198 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.340914 21334 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:23.394402 16470 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:23.398204 21334 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.398823 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.273362 17090 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.343047 16468 raft_consensus.cc:1240] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.354173 21401 consensus_queue.cc:237] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:23.313090 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44390.5us
I20260709 13:08:23.395005 16539 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:23.400760 21334 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:23.396631 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 79533.4us
I20260709 13:08:23.419081 16470 raft_consensus.cc:1275] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:23.423051 16466 raft_consensus.cc:2468] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:23.425603 16465 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.519919 16543 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.467056 21443 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:23.412561 21188 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.453208 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:23.525836 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 319258us
I20260709 13:08:23.419685 21618 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.455276 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:23.466405 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.482708 16617 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:23.492857 16610 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:23.437489 21670 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.409996 21481 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.543962 16536 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:23.436332 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:23.481047 21640 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.507548 21434 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.533812 16470 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:23.525301 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.547467 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:23.547703 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:23.548494 16538 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.490559 21650 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.565934 16618 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:08:23.567456 16464 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.567121 21331 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.568167 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.568508 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.569964 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.570199 21670 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.570534 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.571091 21571 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:23.571979 21618 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.574559 21618 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.575390 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.576188 16466 raft_consensus.cc:1240] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:23.577224 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.569900 21188 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.585105 21331 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.585249 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:23.585903 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 172928us
I20260709 13:08:23.587239 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:23.589290 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:23.590008 21630 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.592604 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.594108 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.594743 17119 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.595726 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.584815 21313 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.600976 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.564209 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:23.606732 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 59296.7us
I20260709 13:08:23.612149 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.613507 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.614063 20845 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.614622 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.615176 21324 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.614677 20845 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.616035 21324 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:23.617149 21630 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.617453 21055 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:23.618048 20845 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.617950 21630 consensus_queue.cc:1048] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.619465 21630 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.620471 21630 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:23.617942 21055 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.621496 21650 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.622004 16463 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:23.622970 21203 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.623946 16585 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.624842 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.625262 16462 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:23.625587 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.626822 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.529371 21443 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.629745 17121 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:23.576493 21646 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.627641 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.641705 17120 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:23.646106 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.583120 21434 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:23.655300 16435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.604200 21188 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.664624 16434 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.640275 21055 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:23.673556 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.678193 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.629089 21630 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:23.681157 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.682336 16610 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:23.651304 21599 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.702486 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.608945 21571 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:08:23.669584 21548 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:23.656837 21625 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.663903 21301 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.723642 21447 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:23.711328 16617 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:23.714385 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.715197 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:23.717386 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 107162us
I20260709 13:08:23.683310 21650 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:23.719553 21481 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.720927 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:23.652982 21203 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.733349 17122 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:23.736460 17127 raft_consensus.cc:2410] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:23.724808 21548 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.712917 21599 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:23.749022 17120 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:23.732077 21650 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.757242 21625 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.761612 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.763443 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.764241 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.765908 21443 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.784832 16436 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.783821 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:23.783533 21670 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:23.781296 21650 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.787568 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.734063 21640 consensus_queue.cc:1059] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:23.767450 21548 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:23.780198 21331 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.733430 21571 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:08:23.809922 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.785918 21486 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.795871 21313 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.785878 21183 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:08:23.822347 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:23.827711 16585 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:23.804536 21630 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.836007 21630 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:23.846897 17119 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:23.848905 21486 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.853757 21324 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:23.855270 21486 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:23.851478 21625 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.857599 16434 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.863194 21203 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.811757 21331 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.867031 21331 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:23.869177 21686 log.cc:927] Time spent T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:23.828622 21599 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.871605 21599 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.829659 21670 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:23.885345 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 120462us
I20260709 13:08:23.893766 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.893312 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:23.901535 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 314378us
I20260709 13:08:23.901922 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:23.902927 17119 raft_consensus.cc:2368] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
I20260709 13:08:23.894469 17127 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:23.878695 21188 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.831640 21168 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:23.909852 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:23.892006 21183 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:23.891903 21486 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.921142 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:23.893528 21443 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:23.942225 16469 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:23.888118 21055 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:23.937691 21696 log.cc:927] Time spent T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:23.954313 16583 leader_election.cc:400] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
I20260709 13:08:23.962447 16583 leader_election.cc:403] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:23.938508 21670 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:23.968348 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.938237 21183 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:23.969326 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:23.970713 21403 consensus_queue.cc:1059] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:08:23.983330 21681 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:23.989542 21702 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:08:23.991712 21301 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:23.992244 21301 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:23.919039 21626 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:08:23.994848 21703 log.cc:927] Time spent T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:23.998334 21168 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.006480 16582 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:23.952826 21481 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:23.967955 21339 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.962873 21443 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:23.962414 21486 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.969642 21670 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.954356 21401 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:08:23.989037 21156 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.014498 16618 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:24.016078 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.034416 16538 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.017843 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.029850 21055 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:24.028944 21626 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:24.027856 21447 raft_consensus.cc:3055] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.025946 21583 raft_consensus.cc:3055] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.010053 21707 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:08:24.083875 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 263427us
I20260709 13:08:24.084918 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:24.026603 21156 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.018113 21670 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.086424 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:24.024433 21630 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:24.087121 20845 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.079411 21626 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.013106 21701 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:24.013820 21704 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:24.101058 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.079730 21447 raft_consensus.cc:740] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.008759 21650 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.106709 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.082247 21583 raft_consensus.cc:740] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:24.108724 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.017524 21486 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.113606 21055 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.114111 21447 consensus_queue.cc:260] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:24.116947 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.117971 21583 consensus_queue.cc:260] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.120404 21443 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.112099 21339 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:24.125183 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:24.125645 16617 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:24.126180 16538 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
W20260709 13:08:24.128736 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 306482us
I20260709 13:08:24.102531 21630 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:08:24.126726 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 236363us
I20260709 13:08:24.135380 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:24.136291 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.013489 21183 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.120510 21650 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.026212 21301 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.141237 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.147614 16538 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:24.153998 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 244268us
I20260709 13:08:24.133371 21176 consensus_queue.cc:1059] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:24.156344 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.161767 16436 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.127403 21701 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.166218 21188 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.164351 21055 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:08:24.153437 21447 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.170876 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.171540 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.149396 21548 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.129109 21704 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.187602 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.191151 16539 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:24.173297 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.194744 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.195696 21486 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:24.196246 21548 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.148447 21434 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.197373 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:24.155550 21339 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.201048 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.165215 21583 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:24.258976 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 61678.1us
I20260709 13:08:24.202042 21434 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:24.256647 21717 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.257387 21701 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.172704 21707 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
I20260709 13:08:24.259042 21714 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.196977 21625 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.261016 21548 raft_consensus.cc:2764] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:08:24.174827 21641 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:24.287986 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 103434us
W20260709 13:08:24.292729 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 122373us
W20260709 13:08:24.293377 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 94328.2us
I20260709 13:08:24.308641 16537 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:08:24.309654 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.311216 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.311544 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.292510 21313 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:24.321178 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.322840 21712 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.323159 21434 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:24.317409 21716 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.323387 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:24.329455 21618 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:24.329916 21650 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:24.331398 21670 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.333889 16538 raft_consensus.cc:1275] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:24.347016 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.334553 21339 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.336179 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.335690 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.352072 16538 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:08:24.352602 16538 pending_rounds.cc:85] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 7
I20260709 13:08:24.352949 16538 pending_rounds.cc:107] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:08:24.353241 16538 raft_consensus.cc:2889] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:24.340200 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 181873us
I20260709 13:08:24.342517 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.342864 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.343098 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.342814 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.197134 21626 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.257302 21630 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.345021 21313 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.387348 21712 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:24.388744 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.390065 21313 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.391997 21643 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:24.392388 21643 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:24.390093 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66834.7us
I20260709 13:08:24.393324 21643 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.394780 21643 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.399106 21646 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.399714 21646 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:24.401878 21646 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.403574 16464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57636 (request call id 2421) took 1112 ms. Trace:
I20260709 13:08:24.403980 16464 rpcz_store.cc:276] 0709 13:08:23.291509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.292466 (+   957us) service_pool.cc:224] Handling call
0709 13:08:23.292725 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:23.567911 (+275186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:24.403322 (+835411us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54003af054. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:24.403500 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631114624}
I20260709 13:08:24.406693 21646 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:24.407310 21646 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.343971 21659 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.409546 21646 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.409318 21659 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:24.410095 16511 connection.cc:256] RPC call timeout handler was delayed by -1.4876131089999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:08:24.412106 21659 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.346349 21625 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.345821 21701 raft_consensus.cc:2764] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:08:24.413936 21699 log.cc:927] Time spent T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.446s	user 0.006s	sys 0.006s
I20260709 13:08:24.414853 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:24.416235 21716 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:24.419142 17127 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:24.419689 21403 raft_consensus.cc:3055] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:24.419817 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:24.420351 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:24.430469 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 108392us
I20260709 13:08:24.434929 21625 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:24.435138 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.435989 16464 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:24.435658 21625 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.437392 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.438067 21625 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.443661 21717 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.443770 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:24.445163 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.445988 16469 raft_consensus.cc:2393] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:24.447535 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.448939 21694 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:24.448951 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:24.449272 21691 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:24.452247 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.453655 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:24.454914 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.455766 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.455890 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.441218 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:24.445348 21712 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:24.465411 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.465411 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:24.466655 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44513.8us
I20260709 13:08:24.467782 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.469849 21618 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:24.470017 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.470459 21618 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.472195 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:24.465795 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.422314 21716 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:24.473008 16618 raft_consensus.cc:2393] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:24.473045 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.468092 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.482435 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.481179 16614 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:24.431813 21403 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.485594 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:24.485677 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.473259 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.477228 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:24.474835 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.487057 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.479682 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.487790 16465 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:24.487967 16466 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:24.488658 21301 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:24.488934 21722 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.489447 21704 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.460235 21646 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:24.476907 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.486164 21403 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.493256 21403 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.497346 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:24.498112 17119 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 18: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:24.483368 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.497485 16463 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:24.498942 16540 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:24.489527 21722 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:08:24.507627 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 186539us
W20260709 13:08:24.510128 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.516948 21563 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:24.519076 21443 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:24.519550 21443 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.520599 21443 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.522161 21443 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.463312 21712 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.528039 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:24.524307 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.530200 16464 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:24.472741 21618 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:24.531241 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.531777 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.532650 16613 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:08:24.455298 21176 consensus_queue.cc:1059] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:08:24.533210 16616 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:24.539963 16618 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:24.482124 21401 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:24.548174 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80205.1us
I20260709 13:08:24.554169 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.554262 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:24.549129 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:24.559638 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.563233 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:24.524323 21721 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.569000 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.570693 16540 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:24.578038 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.578881 16616 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:24.579192 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.580241 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:24.582533 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.582448 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70323.7us
I20260709 13:08:24.584219 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:24.584808 17124 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:24.593281 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.593906 16614 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:24.594556 16617 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:24.581724 21707 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:24.596434 21707 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:24.597553 21707 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.598858 21707 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:24.606268 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.608373 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.611660 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:24.613106 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.614538 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.616659 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:24.621886 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.622387 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.623098 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.624543 16611 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:24.624980 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.588353 21630 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:24.622536 16616 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:24.590307 21203 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.631217 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:24.569844 21694 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:08:24.627240 21599 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.645852 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.650892 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:24.565315 21401 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.645295 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.653183 16465 raft_consensus.cc:1240] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.647876 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:24.712265 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 73726.7us
I20260709 13:08:24.588006 21721 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.620596 21646 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:24.655856 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.620385 21548 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.616009 21716 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:24.774024 16463 raft_consensus.cc:1275] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:24.796032 16613 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
W20260709 13:08:24.824224 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.774706 16466 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:24.774840 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:24.715662 17090 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:24.736791 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 88972.6us
I20260709 13:08:24.830041 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:24.830816 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56038.9us
W20260709 13:08:24.774569 21447 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.001s
W20260709 13:08:24.769275 21725 log.cc:927] Time spent T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:08:24.864962 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 149504us
I20260709 13:08:24.865197 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:24.713194 16467 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:24.876856 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.775235 21738 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:08:24.878301 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.874019 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:24.879366 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.874234 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:24.881129 16610 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:24.786216 21401 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:24.746320 21705 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:24.780545 21334 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.769706 21176 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.882200 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:24.878901 16469 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:24.883347 16612 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:24.893704 16463 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:24.894419 16466 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:24.894601 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:24.915517 16461 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:24.782352 21722 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:24.881235 21630 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:24.637416 21681 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:24.746161 21701 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:24.898571 17124 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:24.780819 21714 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:08:24.873576 21726 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:24.898273 21183 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:24.747066 21055 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:24.879277 21188 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:24.900022 21331 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.893113 21625 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.927469 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:24.900892 21694 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:24.919581 21156 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:24.915017 21176 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.655761 21712 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:24.913079 21638 consensus_queue.cc:1048] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:24.920289 21313 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:25.028031 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 100631us
I20260709 13:08:24.976890 16616 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:25.057299 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.899463 21705 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:25.065150 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 438090us
I20260709 13:08:25.099777 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.100664 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.101153 16467 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:08:25.063962 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 432812us
I20260709 13:08:25.102103 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:25.105017 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:25.013873 21403 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:08:24.936626 21728 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.975970 21643 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:24.983477 21721 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:25.027022 21726 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.057106 21176 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.112357 21705 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:24.925755 21334 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:25.116158 21443 consensus_meta.cc:287] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
W20260709 13:08:25.114432 21583 consensus_meta.cc:287] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.820s	user 0.013s	sys 0.000s
I20260709 13:08:25.126588 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:25.176069 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49566.8us
I20260709 13:08:25.177101 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.116704 21203 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:25.115975 21156 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.100926 21339 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.110391 21713 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:24.985606 21630 consensus_queue.cc:1048] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.138s
I20260709 13:08:25.141888 21697 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.143388 21712 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.152132 16461 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.153697 21401 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.130401 21726 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:24.936894 21701 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.155728 21176 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:25.128512 16582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.124092 21643 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:25.128818 21453 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:25.101616 21183 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.129345 21694 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.154829 21681 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:25.206722 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 324948us
I20260709 13:08:25.190749 21203 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.192898 21339 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.222371 16433 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.195770 21713 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:25.226811 21339 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.230844 21331 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.233062 21183 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:25.233726 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.234257 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.234880 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:25.235954 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8e851f11d27b4a83aa395e05c4be6808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:25.221957 21697 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.222126 21741 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.238912 21176 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:25.240139 21583 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.240667 21583 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.242875 21583 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.243299 21753 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:08:25.234665 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.246791 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:25.249593 16618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.035s	sys 0.062s
W20260709 13:08:25.250106 16618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.035s	sys 0.062s
I20260709 13:08:25.193249 21156 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.248955 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.251704 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.227582 21055 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.269135 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.226154 21203 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.258502 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:25.272454 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.272289 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.273424 16538 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
W20260709 13:08:25.274528 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 97516.4us
I20260709 13:08:25.275149 16538 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.276212 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.275565 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.207741 21401 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.275977 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.279294 16539 raft_consensus.cc:2410] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:08:25.281090 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.277434 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:25.277909 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 364213us
I20260709 13:08:25.284176 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:25.279294 21721 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:08:25.288468 17127 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:25.288918 21334 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.279021 21563 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:25.289498 21701 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.275188 21722 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.290624 21055 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.291702 21681 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:25.292873 21055 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:25.295778 17091 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.296238 21401 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:25.292815 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42898 (request call id 779) took 1258 ms. Trace:
I20260709 13:08:25.297107 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.275755 21188 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.296835 16611 rpcz_store.cc:276] 0709 13:08:24.034495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.034641 (+   146us) service_pool.cc:224] Handling call
0709 13:08:24.034997 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:24.637421 (+602424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.292595 (+655174us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54000d61d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:25.292741 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355276032}
I20260709 13:08:25.298914 21643 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.300159 21643 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:25.300223 21646 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.257529 21183 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.287266 16545 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:25.223846 21694 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.303373 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.305197 21331 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.305958 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.306516 21713 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.301146 21741 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.307837 21183 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:25.310268 17119 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:25.311029 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.312613 16543 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:25.315235 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.316413 16466 raft_consensus.cc:1240] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:25.311674 21563 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:25.318885 17122 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.322088 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.320026 21722 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:25.328202 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:25.341019 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.345249 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.323278 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.351280 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.354756 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.353410 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:25.356407 21707 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:08:25.326635 21730 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.545s	user 0.000s	sys 0.002s
I20260709 13:08:25.325537 21694 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.356787 21716 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:25.359267 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.346541 21183 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:25.325229 21618 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:25.333923 21737 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.559s	user 0.000s	sys 0.001s
I20260709 13:08:25.357101 21646 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.323431 21486 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:25.342463 21722 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:25.340830 21742 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:25.360925 21188 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:25.341284 21563 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.382565 21334 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.383018 21401 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.402628 21753 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:08:25.331878 21339 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:25.407300 21156 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.413928 21401 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.388998 21641 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:25.338485 21670 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:25.388617 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.391920 16463 raft_consensus.cc:1240] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:25.370838 21403 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.360205 21724 raft_consensus.cc:3055] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:25.399793 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:25.373737 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50536us
I20260709 13:08:25.429970 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.414386 21339 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:25.377542 16582 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:25.355957 21705 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.417047 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:25.409324 21715 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:08:25.389819 21722 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:25.442358 21759 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:25.442902 21759 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.443308 21759 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.443192 21722 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.422266 21313 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:25.425072 21739 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.449s	user 0.007s	sys 0.000s
I20260709 13:08:25.437393 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.444588 21722 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.438017 16469 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:25.438768 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57304.4us
W20260709 13:08:25.439301 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61839.3us
I20260709 13:08:25.400699 21716 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.473894 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.427520 21724 raft_consensus.cc:740] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:25.478442 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.481376 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:25.480301 16539 raft_consensus.cc:2410] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:08:25.440460 21659 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:25.402832 21701 consensus_queue.cc:1059] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:08:25.440968 21697 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:25.481251 16582 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:25.489974 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.493220 21763 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:25.493747 21763 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.494201 21763 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.454671 21712 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.468621 21331 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.469411 21313 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:25.503176 21748 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:08:25.408975 21183 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.504792 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.518412 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:25.509398 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.527016 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.525365 16469 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:25.529663 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:25.530290 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:25.527726 16618 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:25.545130 16610 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:25.547721 16539 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:25.466172 21176 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:08:25.489521 21697 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.572570 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.553242 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2514) took 1073 ms. Trace:
I20260709 13:08:25.572727 16542 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:25.578101 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.503523 21339 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:25.582845 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:25.575929 16537 rpcz_store.cc:276] 0709 13:08:24.454871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.455538 (+   667us) service_pool.cc:224] Handling call
0709 13:08:25.525054 (+1069516us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54002b5a54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:25.528537 (+  3483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907594624}
W20260709 13:08:25.597687 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 68128.2us
I20260709 13:08:25.599133 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:25.599814 21771 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:25.604688 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:25.573388 21374 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:25.495246 21716 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.573873 21334 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.577806 21697 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:25.639930 21772 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:25.640640 21772 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.641192 21772 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:25.664988 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 134781us
I20260709 13:08:25.613032 21374 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.605603 21443 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:08:25.687927 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 75341.8us
I20260709 13:08:25.619848 21712 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:25.578774 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:25.701269 16613 raft_consensus.cc:606] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:25.701644 16613 raft_consensus.cc:614] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:25.687361 21374 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.716280 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.709393 21771 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:25.697202 21767 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:25.708209 21453 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.729224 21453 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.682441 21334 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.729468 21778 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.733989 16469 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:25.616139 21724 consensus_queue.cc:260] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:25.732741 21726 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.000s
I20260709 13:08:25.728047 21771 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.733875 21767 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.780220 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.783167 21771 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:25.785702 21779 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.786283 21779 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.788455 21779 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.788902 21773 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.791136 21374 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.791540 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:25.797776 21778 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.791606 21681 raft_consensus.cc:3055] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:25.802688 21771 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.733357 21334 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:25.839217 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 261213us
I20260709 13:08:25.840080 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:25.847438 21769 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:25.847951 21374 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:25.848691 21724 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:25.817799 21773 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.854883 21773 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:25.855490 21773 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.810086 21767 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:25.831353 21681 raft_consensus.cc:740] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:25.858479 21681 consensus_queue.cc:260] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.859565 21681 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:25.861215 21771 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:25.861773 21643 consensus_meta.cc:287] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.004s
I20260709 13:08:25.809576 21401 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:25.867944 21765 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:08:25.895100 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:25.895085 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:25.903587 16465 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:25.780686 21726 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.865525 21716 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.868588 21453 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.913234 17093 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:25.914948 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 222449us
I20260709 13:08:25.902107 21704 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:25.908233 21203 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.006s
W20260709 13:08:25.918517 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 77439us
I20260709 13:08:25.919473 16461 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:25.947751 21756 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.957031 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:25.958048 17121 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:25.960078 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:25.957966 17122 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:25.960173 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 376058us
I20260709 13:08:25.963793 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.963825 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.964632 17120 raft_consensus.cc:2393] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 18: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:25.964658 16541 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:08:25.965770 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:25.967456 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:25.957031 21704 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.969038 21783 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.969596 21778 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.969550 21783 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:25.970355 21704 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.971424 21643 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:25.971720 21783 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:25.973760 21758 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.562s	user 0.003s	sys 0.000s
I20260709 13:08:25.977021 21782 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:25.977674 21782 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:25.966306 16541 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:25.981757 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:25.982362 17119 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:25.984169 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:25.988737 16469 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:25.956800 21757 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:25.950736 21716 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:25.993713 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:26.000079 21697 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.004106 16538 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:25.967919 21774 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:26.033615 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.925748 21203 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.016155 21313 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:26.019599 21705 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.022606 21767 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.050343 21767 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.993239 21757 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.052079 21757 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.033514 21716 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.061004 21716 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.024290 17118 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:25.986548 21334 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.062256 21334 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:26.065248 21761 log.cc:927] Time spent T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.570s	user 0.004s	sys 0.000s
I20260709 13:08:26.039054 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:25.986714 21722 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.995930 21643 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.045153 21782 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.045548 17122 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:26.086369 16540 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:26.045704 21726 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:25.966216 21756 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.105500 16467 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.074695 16610 raft_consensus.cc:606] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:26.077423 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:26.084432 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 96495.3us
W20260709 13:08:26.038733 21759 consensus_meta.cc:287] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.007s
I20260709 13:08:26.089300 21788 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:26.064564 21334 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.093532 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.236310 16614 raft_consensus.cc:2393] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:26.238114 21795 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.238574 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.238744 21795 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.239907 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.240885 21724 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.241379 21724 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.243325 21724 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:26.244395 21793 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:26.280272 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.249354 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.251817 21203 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.253209 21697 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.012593 21772 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.247352 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.260030 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.233242 21618 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.274482 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.275487 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.258450 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.255002 21788 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:26.378057 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.257530 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.278738 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.260911 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:26.233752 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 145975us
W20260709 13:08:26.239948 21763 consensus_meta.cc:287] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.745s	user 0.005s	sys 0.005s
I20260709 13:08:26.227391 21767 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:26.343458 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60348.6us
I20260709 13:08:26.287546 16464 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.076486 21738 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260709 13:08:26.086942 21722 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:26.280890 21769 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:26.341759 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:26.323387 21599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.012s	sys 0.011s
I20260709 13:08:26.042737 21774 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.408475 21791 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:26.408737 16461 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:26.409111 21791 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.279085 21721 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.410320 21721 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.322739 21716 consensus_queue.cc:1059] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:08:26.232100 21759 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:26.391701 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.388594 16619 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:26.397214 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.418673 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7735d77d64e14457985553596120e4cc"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:26.422178 16610 raft_consensus.cc:606] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:26.422585 16610 raft_consensus.cc:614] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.398306 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.425370 16470 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.422852 21728 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:26.429639 21728 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.430524 21722 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:26.431957 21728 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:26.432175 21313 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:26.403071 21599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.012s	sys 0.012s
I20260709 13:08:26.434851 16545 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:26.435057 21759 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.400571 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.393241 16616 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:26.398932 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.323812 21717 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:26.396493 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.378773 16543 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
W20260709 13:08:26.415611 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.343168 21715 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.385250 21795 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.412531 21721 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:26.412655 21716 raft_consensus.cc:3055] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:26.323009 21793 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.442909 16466 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:26.450863 16464 raft_consensus.cc:2368] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:26.377977 21788 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:26.452919 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.456583 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.459113 16538 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:26.413775 21781 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.462069 21781 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.462813 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.463591 16614 raft_consensus.cc:2393] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:26.464394 21781 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:26.456597 16615 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:08:26.382261 21618 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.460986 21788 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.465018 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.474107 16613 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:26.456378 16511 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:26.467494 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:26.393083 21763 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.460600 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:26.469058 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:26.471841 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.464543 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:26.470160 17090 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.475932 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.476819 21156 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.481678 21156 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.482095 21156 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.483105 16614 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:26.483282 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.484573 21782 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:26.479010 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:26.484440 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.490173 16610 raft_consensus.cc:2368] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:26.399593 21767 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.497810 21721 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.498394 21738 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:26.499131 21756 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.498991 21738 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.499874 21630 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.500259 21618 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.459753 21334 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.501003 21334 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.501775 21793 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.452258 21716 raft_consensus.cc:740] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:26.503194 21334 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:26.503604 21772 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.466482 21728 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.504602 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.504814 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.505291 16464 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:26.505455 16463 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
W20260709 13:08:26.476943 21786 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.405s	user 0.010s	sys 0.031s
I20260709 13:08:26.506306 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:26.497941 16582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.66:37367 timed out after 2.046s (SENT) [suppressed 1 similar messages]
I20260709 13:08:26.506848 21757 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.501832 21738 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:26.510809 17118 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:26.513904 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:26.514251 16510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.515091 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:26.515471 16468 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:26.455749 21717 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.505095 21728 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.516970 21763 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.517764 21717 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.518083 21788 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.518458 21643 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:26.518778 21331 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.518908 21643 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.519232 21331 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.519323 21643 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:26.519618 21331 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.471994 21183 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.521210 21183 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.523530 21183 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.524142 21779 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.452390 21715 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.498749 21767 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.526944 21715 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:26.530217 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:26.517796 21728 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:26.534399 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.545351 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:26.542541 16617 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:26.541071 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:26.544132 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.534391 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.547616 16469 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:26.545989 16613 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:26.549525 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.549736 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:26.549963 17124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53654 (request call id 855) took 1240 ms. Trace:
I20260709 13:08:26.484928 21781 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.552488 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:26.550345 17124 rpcz_store.cc:276] 0709 13:08:25.309111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.311192 (+  2081us) service_pool.cc:224] Handling call
0709 13:08:25.311440 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.320485 (+  9045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.320520 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.320560 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:25.320592 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.549761 (+1229169us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b540070f654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:26.549804 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:26.549913 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20378496}
I20260709 13:08:26.554747 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.555569 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.557080 21767 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:26.557627 21767 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.559064 21331 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.559893 21767 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.560688 21722 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:26.560933 21779 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:26.561214 21722 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.561672 21722 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:26.561875 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.566519 16511 leader_election.cc:400] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:26.566869 16511 leader_election.cc:403] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.570735 16469 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:26.572714 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:26.512339 21156 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.573915 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.587178 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.587944 16542 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:26.622027 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.545534 21782 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:26.647876 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.644675 21757 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:26.547224 21403 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:08:26.586365 21548 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:26.552845 21712 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:08:26.589200 21728 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:26.566172 21779 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:26.636154 21716 consensus_queue.cc:260] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.567195 21738 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:26.812458 21630 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.812206 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.575574 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:26.819962 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.838557 16469 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.830503 21781 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.812259 16543 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:26.813046 21792 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:26.842106 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 266614us
I20260709 13:08:26.848134 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.849195 16469 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:26.850914 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:26.839769 21630 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.850941 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:26.840025 21781 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.856475 16469 raft_consensus.cc:2393] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.860070 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.859187 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:26.863946 16543 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.840894 21738 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.867561 21793 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.867744 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:26.868155 21793 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.871265 21781 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.872197 21738 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.872216 21793 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.852648 21331 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:26.868566 17123 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:26.831928 21643 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.878271 21782 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.861567 21724 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:26.850996 21772 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:26.854028 21792 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:26.896458 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:26.898105 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.899221 16469 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:26.904698 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:26.907015 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:26.891237 21724 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:26.892678 21772 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:26.863802 21334 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:08:27.041396 17093 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.054270 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 239810us
W20260709 13:08:27.056243 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.056938 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.057554 16461 raft_consensus.cc:3060] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:26.937871 21625 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.065834 21625 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.066200 21625 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.066598 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:27.067227 16613 raft_consensus.cc:606] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:26.913733 21783 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:27.067565 16613 raft_consensus.cc:614] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:27.067868 21783 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.068264 21783 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:27.068914 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:27.075282 21625 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.913606 21772 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.076798 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.077487 21705 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.106539 16469 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.078322 21792 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.078455 21781 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.078354 21788 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.084076 16461 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:27.068430 21643 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.085121 21203 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.124199 16616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41794 (request call id 2521) took 1048 ms. Trace:
I20260709 13:08:27.124576 16616 rpcz_store.cc:276] 0709 13:08:26.076127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.077215 (+  1088us) service_pool.cc:224] Handling call
0709 13:08:27.124010 (+1046795us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54003dac54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:27.124134 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626420480}
I20260709 13:08:27.087157 21630 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.053853 21763 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.112610 21781 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.136057 21763 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.137776 21781 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.138016 21763 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.141088 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.143477 21781 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.144019 21781 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:26.914073 21728 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:27.147794 21722 consensus_meta.cc:287] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.010s
I20260709 13:08:27.104492 16543 raft_consensus.cc:2468] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
W20260709 13:08:27.105201 16582 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.067s	sys 0.098s
W20260709 13:08:27.149181 16582 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.067s	sys 0.098s
W20260709 13:08:27.105247 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 286508us
I20260709 13:08:27.126976 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.125708 21788 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.123986 21203 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.097321 21156 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:27.149461 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 651492us
I20260709 13:08:27.149595 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.158679 16543 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.157550 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.159534 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:27.162249 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.110767 21705 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.148203 21722 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.165413 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.166270 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:27.166594 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.167042 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.167160 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.169088 16613 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:27.170086 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.170744 21659 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.149878 21643 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.171984 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.174393 16613 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:27.173028 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.175961 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.181428 16617 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:27.185516 21788 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.173475 21742 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:27.171239 21659 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.186614 21788 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:27.187129 21788 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:27.163451 21810 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.150004 21728 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.173446 21811 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.197315 21788 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.198071 21203 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.183070 21643 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.205250 16543 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:27.208613 21625 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.209064 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.209656 16543 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:27.210239 21728 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.210417 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.211536 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.211740 21659 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.212078 16543 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:27.195834 21707 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:27.212939 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.213165 21707 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.215878 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.190614 21810 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.213979 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.222887 16543 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:27.225396 16465 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
W20260709 13:08:27.273654 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 114209us
I20260709 13:08:27.274487 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.279721 21818 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.280253 21818 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.220800 21707 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:27.271799 21803 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.775s	user 0.004s	sys 0.015s
I20260709 13:08:27.285660 16509 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.284000 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.222247 21443 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.220484 21810 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.204977 21811 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.291852 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.297214 16543 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.300441 21643 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.291080 21816 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.305243 21816 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.307340 21816 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.307874 21816 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.308213 21816 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.309128 21707 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.309665 21707 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.308554 21816 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.318528 17121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53658 (request call id 855) took 1296 ms. Trace:
I20260709 13:08:27.319797 17125 raft_consensus.cc:1240] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:08:27.318550 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.319267 16543 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:27.321533 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.323014 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.324534 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.289387 21782 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.327011 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.331533 16463 raft_consensus.cc:2393] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.327999 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:27.334236 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.335656 16543 raft_consensus.cc:2393] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.348083 21791 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.333770 21403 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:27.341995 21548 consensus_meta.cc:287] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:08:27.318907 17121 rpcz_store.cc:276] 0709 13:08:26.021714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.038341 (+ 16627us) service_pool.cc:224] Handling call
0709 13:08:26.049090 (+ 10749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.102371 (+ 53281us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.102405 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.232334 (+129929us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.392893 (+160559us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:26.392933 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.393349 (+   416us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.060329 (+666980us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:27.316539 (+256210us) raft_consensus.cc:1685] finished
0709 13:08:27.316560 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.318471 (+  1911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37726,"raft.queue_time_us":43685,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":126226,"spinlock_wait_cycles":109818752,"thread_start_us":45554,"threads_started":1,"wal-append.queue_time_us":173599}
I20260709 13:08:27.337687 21203 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.341725 21783 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.336925 21715 consensus_queue.cc:1059] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.342980 21707 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.312187 21443 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.343333 21818 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.313445 21764 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.348559 21811 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.335052 21820 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.335045 21705 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.334234 21781 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.380496 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.375075 21721 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:27.381626 21548 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:27.382360 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.401367 17125 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:27.402436 21810 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.346472 21738 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.404886 21738 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:27.405453 16545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 2239) took 1885 ms (client timeout 1994 ms). Trace:
W20260709 13:08:27.405879 16545 rpcz_store.cc:269] 0709 13:08:25.520442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.572951 (+ 52509us) service_pool.cc:224] Handling call
0709 13:08:27.405259 (+1832308us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54001df454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:27.405394 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906456320}
I20260709 13:08:27.388688 21820 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.407171 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.407409 21820 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.407869 16545 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:27.404666 21810 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.383749 21403 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.409736 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.410367 16541 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:27.411219 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.411706 16541 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:08:27.413197 16540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50264 (request call id 2225) took 2144 ms (client timeout 2046 ms). Trace:
W20260709 13:08:27.413604 16540 rpcz_store.cc:269] 0709 13:08:25.269250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.269388 (+   138us) service_pool.cc:224] Handling call
0709 13:08:27.412978 (+2143590us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b540031a454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:27.413107 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861304192}
I20260709 13:08:27.414232 21403 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.414649 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.415393 16540 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:27.388104 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 96320.7us
I20260709 13:08:27.390614 21721 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.391695 21783 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.393343 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2538) took 1048 ms. Trace:
I20260709 13:08:27.394100 16544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2242) took 1646 ms. Trace:
I20260709 13:08:27.335503 21782 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.415060 21816 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:27.387204 21701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.750s	user 0.009s	sys 0.059s
I20260709 13:08:27.389672 16543 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:27.423743 16544 rpcz_store.cc:276] 0709 13:08:25.747700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.748366 (+   666us) service_pool.cc:224] Handling call
0709 13:08:25.777018 (+ 28652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.797137 (+ 20119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.797173 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.797225 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:25.797277 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.393869 (+1596592us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54003e9754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:27.393917 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.394038 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45700992}
I20260709 13:08:27.433998 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.434558 16544 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.423687 16539 rpcz_store.cc:276] 0709 13:08:26.344535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.344795 (+   260us) service_pool.cc:224] Handling call
0709 13:08:26.345193 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.518343 (+173150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.518374 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:26.518409 (+    35us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:26.518446 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.393107 (+874661us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002053d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:27.393158 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.393287 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397762304}
I20260709 13:08:27.426292 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.438213 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.439908 16539 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:27.441131 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.441998 16539 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:27.443030 16539 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:27.423884 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.423775 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.428936 21176 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.389942 21772 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.454880 16511 leader_election.cc:400] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11.
I20260709 13:08:27.455818 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.457903 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.448271 16540 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:27.454360 16470 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:27.464269 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 133091us
I20260709 13:08:27.466858 16470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2091) took 1016 ms. Trace:
W20260709 13:08:27.433178 21701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.796s	user 0.009s	sys 0.059s
I20260709 13:08:27.467875 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:27.499503 16545 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:08:27.499976 16545 pending_rounds.cc:85] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 11
I20260709 13:08:27.471876 21724 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.473356 21818 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.473078 21176 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.474361 21443 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.475169 21788 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:27.476603 21772 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.421475 21764 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.477011 21816 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.467228 16470 rpcz_store.cc:276] 0709 13:08:26.449975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.450439 (+   464us) service_pool.cc:224] Handling call
0709 13:08:26.450737 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.454221 (+1003484us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b54001c8ca0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa37474dc0 00007ffa374ff1c0 00007ffa37500231 00007ffa374fcd8f 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c
0709 13:08:27.466630 (+ 12409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.466803 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10913536}
I20260709 13:08:27.478708 21820 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:27.479792 16467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57636 (request call id 2460) took 2063 ms (client timeout 1994 ms). Trace:
I20260709 13:08:27.467624 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.472893 21783 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.522245 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.522989 17125 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:27.488298 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.523969 16618 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.491184 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.492507 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.494727 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.525408 16617 raft_consensus.cc:2410] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:27.495421 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.495929 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.497700 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.500205 16545 pending_rounds.cc:107] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:08:27.501672 21782 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.502839 21563 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:27.537256 21563 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.538225 21176 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.539336 21563 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.540225 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.540858 21772 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.541302 21772 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.503000 21721 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.504690 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.544589 21626 raft_consensus.cc:993] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:27.544956 21783 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:27.545131 21626 raft_consensus.cc:1081] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:27.497421 21811 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:27.545977 21783 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.509696 21824 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:27.517431 21724 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.552306 21625 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.552847 21625 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.554229 21331 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:27.554423 21799 log.cc:927] Time spent T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 1.058s	user 0.005s	sys 0.016s
I20260709 13:08:27.554976 21625 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.555429 21334 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:27.556183 21790 log.cc:927] Time spent T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.181s	user 0.005s	sys 0.012s
I20260709 13:08:27.526499 16614 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 18.
I20260709 13:08:27.557770 16536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2531) took 2085 ms. Trace:
I20260709 13:08:27.558728 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.558117 16536 rpcz_store.cc:276] 0709 13:08:25.472447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.472573 (+   126us) service_pool.cc:224] Handling call
0709 13:08:25.484156 (+ 11583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.497494 (+ 13338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.497540 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.498017 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:08:25.917870 (+419853us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:25.917910 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.917986 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.555661 (+1637675us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:27.557505 (+  1844us) raft_consensus.cc:1685] finished
0709 13:08:27.557524 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.557718 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1808,"raft.queue_time_us":15063,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":18609,"spinlock_wait_cycles":99692928,"thread_start_us":302269,"threads_started":1,"wal-append.queue_time_us":549605}
I20260709 13:08:27.559978 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.560617 21812 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.561440 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.561841 21792 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.562130 16536 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:27.562609 21820 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.564342 21726 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.564848 21726 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.565397 21753 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.565928 21753 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.566898 21726 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.567951 21753 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.568255 20845 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.568743 20845 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.568907 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:27.570104 21713 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.570528 20845 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.571864 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:27.518225 16467 rpcz_store.cc:269] 0709 13:08:25.416621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.416760 (+   139us) service_pool.cc:224] Handling call
0709 13:08:27.479579 (+2062819us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54000b2f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:27.479706 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505134464}
I20260709 13:08:27.573164 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.573899 16468 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.511794 21788 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.570539 21712 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.568915 21742 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.574720 21712 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.575155 21712 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.575093 21742 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.575608 21788 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.536361 17120 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:27.577293 21716 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.579077 17090 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.579638 16544 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
W20260709 13:08:27.519335 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 51792.7us
I20260709 13:08:27.581342 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.581453 16541 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:27.581897 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.582458 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.582756 21722 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.583338 21819 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:27.583940 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.554745 21331 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.562359 21792 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.526448 16545 raft_consensus.cc:2889] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:27.586090 21331 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.555924 21334 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.581990 21823 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.586724 16545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2554) took 1014 ms. Trace:
I20260709 13:08:27.584019 21819 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:27.587280 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.546253 21811 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.587993 17122 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:27.588078 21334 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.587146 16545 rpcz_store.cc:276] 0709 13:08:26.572263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.498871 (+926608us) service_pool.cc:224] Handling call
0709 13:08:27.499208 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.586484 (+ 87276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.586672 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:27.589344 21811 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.589535 16545 raft_consensus.cc:1240] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:27.541687 21772 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.527695 21774 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.575562 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.593195 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.593199 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.594265 16433 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.594718 21774 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.531263 21764 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.595137 21742 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.595498 21764 raft_consensus.cc:2804] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.595594 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.595772 21714 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.596088 21764 raft_consensus.cc:697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:27.596230 21714 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:27.596690 21714 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:27.597082 16611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 2068) took 2080 ms. Trace:
I20260709 13:08:27.597460 16611 rpcz_store.cc:276] 0709 13:08:25.521099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.521299 (+   200us) service_pool.cc:224] Handling call
0709 13:08:25.521716 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:25.542891 (+ 21175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.542925 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:25.998554 (+455629us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b2c000fd7b8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:08:25.999096 (+   542us) log.cc:844] Serialized 52 byte log entry
0709 13:08:26.228041 (+228945us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:26.440141 (+212100us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.440350 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.440419 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.553883 (+1113464us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:27.596891 (+ 43008us) raft_consensus.cc:1685] finished
0709 13:08:27.596913 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.597030 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12123,"prepare.queue_time_us":121160,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":2638,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":34763,"spinlock_wait_cycles":117082112,"thread_start_us":327025,"threads_started":2,"wal-append.queue_time_us":459292}
I20260709 13:08:27.599805 21764 consensus_queue.cc:237] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:27.601481 16366 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 173) took 17626 ms (client timeout 15000 ms). Trace:
I20260709 13:08:27.597460 21812 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:27.603593 21812 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.603914 21812 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:27.601852 16366 rpcz_store.cc:269] 0709 13:08:09.974689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.974886 (+   197us) service_pool.cc:224] Handling call
0709 13:08:27.601265 (+17626379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:21.750308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:21.869170 (+118862us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:21.869205 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:21.869222 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:21.870382 (+  1160us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:21.870447 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:21.870478 (+    31us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:08:21.871582 (+  1104us) tablet.cc:701] Row locks acquired
0709 13:08:21.871600 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:21.871745 (+   145us) write_op.cc:270] Start()
0709 13:08:21.871854 (+   109us) write_op.cc:276] Timestamp: P: 1783602501871695 usec, L: 0
0709 13:08:21.871880 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:21.872528 (+   648us) log.cc:844] Serialized 5516 byte log entry
0709 13:08:23.170885 (+1298357us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b18001f3960. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:23.171358 (+   473us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.748626 (+577268us) write_op.cc:301] APPLY: starting
0709 13:08:23.748752 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.002837 (+254085us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.002877 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:24.405266 (+402389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.405746 (+   480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:08:24.405841 (+    95us) write_op.cc:312] APPLY: finished
0709 13:08:24.415578 (+  9737us) log.cc:844] Serialized 129 byte log entry
0709 13:08:24.647051 (+231473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.806369 (+159318us) write_op.cc:454] Released schema lock
0709 13:08:24.806478 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.807207 (+   729us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.807272 (+    65us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2882432,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":558811,"apply.run_cpu_time_us":47856,"apply.run_wall_time_us":1058490,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62619,"num_ops":14,"prepare.queue_time_us":402970,"prepare.run_cpu_time_us":36634,"prepare.run_wall_time_us":720733,"raft.queue_time_us":395756,"raft.run_cpu_time_us":22329,"raft.run_wall_time_us":262813,"replication_time_us":1299261,"spinlock_wait_cycles":113959296,"thread_start_us":1686495,"threads_started":5,"wal-append.queue_time_us":1117219,"wal-append.run_cpu_time_us":23551,"wal-append.run_wall_time_us":2538394}]]}
I20260709 13:08:27.595114 21774 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.614989 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.615377 21774 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.617045 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.617761 16611 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:27.580394 17090 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.593420 21334 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.619469 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:27.620039 17123 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.621937 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.622738 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.623008 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.624106 16582 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:27.610426 16467 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:27.611223 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.626035 16470 raft_consensus.cc:2410] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:08:27.626073 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.626675 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.627421 16466 raft_consensus.cc:2393] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.627662 16543 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:08:27.627902 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 106671us
I20260709 13:08:27.628134 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.586102 21792 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.535380 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.612577 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.614694 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.633420 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.619585 21811 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.637162 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.628897 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.638715 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.639462 16544 raft_consensus.cc:2393] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:27.639719 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.641026 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.639397 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.643198 16543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2257) took 1104 ms. Trace:
I20260709 13:08:27.614475 16618 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:27.632165 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.644654 16461 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:27.632364 16613 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:27.633832 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.634351 16469 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 17: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.634255 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.631124 17123 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:27.646768 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.647229 21403 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:27.647848 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.648171 21724 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:27.648185 21722 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.648981 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.649145 21722 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.635118 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.650957 16465 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.651350 21722 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.652407 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.636420 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:27.654201 16542 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.610373 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.635798 21718 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.655297 16468 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:27.641155 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 105856us
I20260709 13:08:27.655553 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.656504 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.657707 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.660317 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.624799 21763 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:27.660931 21763 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.661103 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.661332 21763 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:27.662483 16464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:08:27.663033 16464 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.663362 16464 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.625069 21625 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.664983 21787 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:27.665125 21625 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.665555 21787 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:27.666457 21787 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.667302 21625 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:27.666911 16433 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.667881 21819 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.668095 21625 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.668278 21819 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.668499 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.668666 21625 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:27.668748 21819 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.669636 21625 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.635500 21823 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:27.670826 21823 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:27.671286 21811 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.671660 21823 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.673367 21811 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:27.673482 21753 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.673903 21792 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.634979 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:27.679246 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.680404 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.684686 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.678790 16464 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.690625 16467 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:27.692756 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:27.643610 16543 rpcz_store.cc:276] 0709 13:08:26.539159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.484278 (+945119us) service_pool.cc:224] Handling call
0709 13:08:27.484748 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:27.628052 (+143304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.642922 (+ 14870us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400290ed4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:27.643145 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328087936}
I20260709 13:08:27.694363 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.695191 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.696130 16611 raft_consensus.cc:2393] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:27.697165 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.668922 21777 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.728668 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.693055 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:27.730381 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.631980 21334 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:27.703480 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:27.704896 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:27.705948 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 61218.1us
I20260709 13:08:27.737574 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.732689 16434 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.738646 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:27.738850 16434 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:27.726539 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.731637 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.702425 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.740263 16434 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.640589 21626 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:27.638711 21176 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:27.735541 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.737015 16583 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.636850 21563 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.735270 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.737134 16545 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
W20260709 13:08:27.737701 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 58646.2us
I20260709 13:08:27.744354 16434 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:27.744473 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:27.648563 21724 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:27.674916 21630 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.689241 21707 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.745551 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:27.753885 16618 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:27.747223 16464 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:27.741309 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:27.755388 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.750402 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.762954 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.764705 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:27.767258 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:27.769683 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.770471 16611 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 10.
I20260709 13:08:27.731142 21742 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.746840 21626 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.748894 21722 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:27.749423 21183 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:27.745393 21775 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.772527 16465 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:27.745208 21810 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:27.655289 21718 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.800349 21707 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.743322 21712 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.753835 21715 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:27.847512 16465 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:27.829694 16470 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:27.761590 21753 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.758253 21728 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:27.758121 21643 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:27.759157 21788 raft_consensus.cc:2764] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:08:27.831908 21810 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.772984 21777 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.792156 21781 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.793331 21816 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:27.817240 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.849884 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:27.850541 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 89224.7us
I20260709 13:08:27.893253 16618 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:27.808745 21626 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.872480 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
W20260709 13:08:27.838255 21813 log.cc:927] Time spent T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:27.808785 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:27.900305 17123 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:27.900734 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 50988.8us
I20260709 13:08:27.767100 21563 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.767074 21630 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.830699 21792 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:27.877604 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.911726 16613 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
W20260709 13:08:27.895967 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 126321us
I20260709 13:08:27.850927 21715 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.809059 21722 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:27.853513 21728 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.846002 21707 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.815754 21742 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:27.889580 21810 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.875869 21753 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:27.916025 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.929327 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.929934 16617 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:27.925766 17122 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:27.925844 17123 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:27.926537 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:27.922130 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 159522us
I20260709 13:08:27.931912 16582 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:27.933055 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.914656 21701 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:27.914757 21715 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:27.918483 21728 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:27.916446 21722 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:27.986290 21301 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:27.986650 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:27.987257 21563 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.019276 16434 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:27.896639 21777 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.995929 21715 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.902854 21781 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.913931 21717 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:08:27.873406 21724 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:27.853819 21334 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.024564 21403 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:08:27.997207 21828 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:08:28.062052 21626 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.063550 16619 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:28.064101 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 129223us
I20260709 13:08:28.066839 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.068974 21626 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.027012 21188 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.082837 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.026866 21841 consensus_queue.cc:1059] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:28.034590 21301 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.036064 21742 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.032403 21715 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.033090 21777 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.026968 21563 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:28.040134 21753 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.042829 16612 raft_consensus.cc:3055] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:28.047710 21714 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.051486 21712 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.071096 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.100615 16436 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.101564 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:08:28.025862 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 269260us
I20260709 13:08:28.085166 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.085376 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.086411 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.072501 21840 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.083779 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:27.920871 21792 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.134609 21792 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.142587 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.144330 16616 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:28.093770 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.096540 16612 raft_consensus.cc:740] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.105278 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.105986 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.106993 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.108902 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.087973 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.106010 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:28.148325 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47797.5us
I20260709 13:08:28.108929 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.106887 21777 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.110706 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.111804 21718 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.153029 21729 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.113219 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.154403 21630 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.154551 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.155057 21630 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.155818 21630 raft_consensus.cc:2764] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:08:28.114019 21626 consensus_queue.cc:1059] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:28.114888 21716 consensus_meta.cc:287] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.001s
I20260709 13:08:28.117725 21781 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.031699 21812 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:28.183306 21772 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 13:08:28.183758 21772 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.184374 21812 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.121848 21763 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.125206 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.125967 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.149369 16436 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.150769 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.112670 21787 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:28.093480 21188 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:28.156694 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.113070 21301 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.148262 16612 consensus_queue.cc:260] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.158803 16618 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 10: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:28.146595 21774 consensus_meta.cc:287] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.003s
I20260709 13:08:28.174150 21714 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.173645 16363 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.100169 21563 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.157644 21841 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.136548 21722 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.181733 21728 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.179620 21707 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.184715 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2258) took 1645 ms. Trace:
I20260709 13:08:28.200629 16538 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:28.201350 16612 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.221146 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.206000 21630 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.202006 21626 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.205384 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.248045 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:28.207218 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 57922.6us
I20260709 13:08:28.249521 16436 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.195153 16585 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.213644 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:28.251577 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56497.8us
I20260709 13:08:28.251936 17123 raft_consensus.cc:2410] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:08:28.218840 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.226341 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.213541 16540 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:08:28.201396 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 44806.8us
I20260709 13:08:28.211709 16613 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:28.254885 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.132455 21819 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.228972 16539 rpcz_store.cc:276] 0709 13:08:26.539388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.484222 (+944834us) service_pool.cc:224] Handling call
0709 13:08:27.485288 (+  1066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.485565 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:27.754916 (+269351us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.894638 (+139722us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.183520 (+288882us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b1800392da0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:08:28.183987 (+   467us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.184190 (+   203us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.184246 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:28.184310 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.184400 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.184641 (+   241us) inbound_call.cc:177] Queueing success response
0709 13:08:28.206039 (+ 21398us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b1800392da0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
Metrics: {"mutex_wait_us":23865,"prepare.queue_time_us":507358,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5854,"raft.queue_time_us":309966,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":9694,"spinlock_wait_cycles":51492736,"thread_start_us":377074,"threads_started":2,"wal-append.queue_time_us":326900}
I20260709 13:08:28.259228 16611 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 17: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:28.259496 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.253263 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.256645 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.195533 21812 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.192426 21775 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.215380 21714 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:28.277740 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.278239 16583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.278470 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:28.278080 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 776) took 2337 ms. Trace:
I20260709 13:08:28.279946 17119 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.281288 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.285202 16465 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:28.287288 17121 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.287554 21707 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.271127 21715 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:08:28.292165 16538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50270 (request call id 2552) took 1726 ms (client timeout 2097 ms). Trace:
W20260709 13:08:28.292546 16538 rpcz_store.cc:269] 0709 13:08:26.567710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.831285 (+263575us) service_pool.cc:224] Handling call
0709 13:08:28.292020 (+1460735us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400001754. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:28.292114 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102508416}
I20260709 13:08:28.296944 21203 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.299930 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.301575 16615 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:28.261207 16613 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 13.
I20260709 13:08:28.267118 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.199472 21742 raft_consensus.cc:3055] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:28.303346 21742 raft_consensus.cc:740] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.303481 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:28.303757 21810 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.304380 21742 consensus_queue.cc:260] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.305262 21842 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:28.270675 21824 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:28.305706 21842 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.305853 21742 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.306243 21824 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.306638 21842 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.307833 21842 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.225927 21722 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.228181 21820 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.304469 21718 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.198254 21787 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.308892 21718 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.189050 21763 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.309788 21718 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.311477 21772 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.270854 21643 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.271651 21183 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.205166 21774 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.315497 16462 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 16: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:28.275259 21812 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.316469 21774 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.317381 21812 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.308884 21820 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.318639 21712 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.199434 21188 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:28.319264 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 52613.6us
I20260709 13:08:28.319648 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:28.322445 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.322757 16539 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:28.323231 21712 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.323287 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:28.324610 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.325062 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.325421 16545 raft_consensus.cc:2393] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:28.325866 16542 raft_consensus.cc:2368] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16.
I20260709 13:08:28.327112 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.327335 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.309113 21787 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.322790 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.328683 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.329344 16540 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:28.329427 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:28.328593 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.330775 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.331310 21176 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:28.325465 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.327644 16541 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.332382 21712 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.198348 21701 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:28.303293 21724 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:28.333592 21701 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.335618 16585 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.336457 20845 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.269739 21847 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.338716 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.339308 16541 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:28.331710 21176 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:28.341837 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:28.343674 16539 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:28.344046 17125 raft_consensus.cc:2393] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 17: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:28.343917 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 61381.3us
I20260709 13:08:28.344869 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.347419 17090 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.348109 16543 raft_consensus.cc:1240] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:08:28.349520 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.349182 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.350764 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.362977 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.347858 21486 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.347945 21176 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:28.416210 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 53356.7us
I20260709 13:08:28.404126 21301 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.417200 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.225874 16363 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 7 to 8, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 8 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.353338 21742 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.420953 21781 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.348081 21812 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.421914 21812 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.422377 21812 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.369007 16611 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:28.368865 21650 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:28.369719 21763 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.418200 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.416636 21718 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.427613 21718 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.371352 21820 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.428366 16363 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.429090 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:28.372344 21563 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.361657 21716 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.373768 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.376434 21697 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.378175 21447 raft_consensus.cc:993] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:28.432900 21447 raft_consensus.cc:1081] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:28.383289 21810 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.385769 21767 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:28.390820 21728 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.395483 21787 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.397775 17090 leader_election.cc:400] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16.
I20260709 13:08:28.397851 21819 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.399607 21824 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.404011 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.445992 16536 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.400579 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.405629 21822 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:28.408603 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.280285 16537 rpcz_store.cc:276] 0709 13:08:25.929319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.966895 (+ 37576us) service_pool.cc:224] Handling call
0709 13:08:25.967190 (+   295us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:26.037390 (+ 70200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:26.049851 (+ 12461us) log.cc:844] Serialized 14 byte log entry
0709 13:08:26.062744 (+ 12893us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800441d00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa344103f3 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:27.398939 (+1336195us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b1800441d00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d23a 00007ffa37507a2a
0709 13:08:27.718862 (+319923us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:27.719773 (+   911us) log.cc:844] Serialized 52 byte log entry
0709 13:08:27.721771 (+  1998us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:27.839507 (+117736us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.839961 (+   454us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.266079 (+426118us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b1800441d00. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa370b3d70 00007ffa370a7293 00007ffa3709ccea 00007ffa3709d23a 00007ffa37507a2a 00007ffa375170bf 00007ffa37517038
0709 13:08:28.266347 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:28.266423 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:28.266466 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:28.266478 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:28.266617 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657403,"prepare.queue_time_us":446366,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":93965,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":54682,"spinlock_wait_cycles":94032256,"thread_start_us":378926,"threads_started":2,"wal-append.queue_time_us":1667289}
I20260709 13:08:28.414886 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.418198 16582 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.449162 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:28.450181 16582 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.428601 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:28.434844 16539 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.436293 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.437760 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.435384 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:28.438576 17090 leader_election.cc:403] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.457087 16542 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
W20260709 13:08:28.457633 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 71522.5us
I20260709 13:08:28.457129 17125 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.459429 21447 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.460143 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.461784 21822 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.445005 16611 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:28.460805 16538 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.460253 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:28.464629 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.466094 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.341883 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.468165 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.469288 17120 raft_consensus.cc:1240] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:28.470353 16612 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
W20260709 13:08:28.470800 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56006.7us
I20260709 13:08:28.439182 21781 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:08:28.473796 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 131991us
I20260709 13:08:28.498354 16436 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:28.517405 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 79707.1us
I20260709 13:08:28.518584 16511 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.519074 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.520280 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.521226 17125 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:28.487879 16539 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:28.489056 16536 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:28.491896 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.524873 16433 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:28.527491 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.470394 21447 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.534000 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.536420 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.442893 21697 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:08:28.472942 21841 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.473809 21824 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:28.517886 21742 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.548820 16464 raft_consensus.cc:1240] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:28.539234 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.550040 16615 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:28.438295 21486 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.496495 21707 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.500808 21728 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.523624 21819 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.523412 21753 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.537192 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.546744 16433 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:28.548208 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.565763 16616 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.552096 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.566488 16612 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:28.566792 21824 consensus_queue.cc:1059] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.555336 21811 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:28.567468 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.569080 21822 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.545010 21715 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:28.573093 21715 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.574115 21715 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.523571 21701 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.579840 21712 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.580300 21712 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.582383 21712 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.583148 21697 raft_consensus.cc:3055] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:28.583585 21697 raft_consensus.cc:740] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:28.552605 21334 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.584487 21334 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:28.584383 21697 consensus_queue.cc:260] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.585721 21697 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.585485 21334 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.586750 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.587357 16543 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:28.522007 21763 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16.
I20260709 13:08:28.528288 21773 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:08:28.590754 16582 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:28.592000 21722 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:28.545971 21820 raft_consensus.cc:2764] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:28.592429 21722 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.592954 21722 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.594408 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:28.595011 17125 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
W20260709 13:08:28.596342 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49671.9us
I20260709 13:08:28.599040 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:28.564855 16509 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:28.603366 16612 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:28.528376 21749 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:28.569002 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.544468 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.561951 16538 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:28.607963 16543 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:28.609637 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:28.611325 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:28.611706 16540 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:28.613090 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:28.622603 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78241.3us
I20260709 13:08:28.625617 16542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:28.626458 16542 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.626842 16542 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.614391 21822 raft_consensus.cc:2804] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:28.588502 21176 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.643587 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.644819 16465 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:28.645538 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.614602 21643 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:28.621726 21301 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:28.628080 21811 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.648708 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.625468 21773 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:28.645637 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.646522 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:28.646574 16615 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:28.660609 16462 raft_consensus.cc:2368] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:28.633737 21824 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.661336 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.659897 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.629977 21847 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:08:28.636170 21781 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:08:28.678861 16613 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.711226 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.710237 16469 raft_consensus.cc:1240] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:28.717654 16464 raft_consensus.cc:3060] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.684433 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.671231 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.720379 16617 raft_consensus.cc:3060] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.721217 16542 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.718243 16462 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:28.735013 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 50696.5us
I20260709 13:08:28.737074 17120 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:28.740003 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.657297 21787 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.655404 21301 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.754714 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:28.742744 16542 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.755393 16612 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:28.749639 16613 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:28.682500 21773 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:28.705853 21643 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:28.659777 21729 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:08:28.671252 21822 raft_consensus.cc:697] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:28.755766 16612 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:28.772305 16464 raft_consensus.cc:2468] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:28.679806 21203 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:08:28.743191 21824 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.764680 16617 raft_consensus.cc:2468] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 19.
I20260709 13:08:28.775475 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:28.775508 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:28.776239 16467 raft_consensus.cc:1275] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:28.776760 16465 raft_consensus.cc:2368] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16.
I20260709 13:08:28.777000 17093 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:28.777899 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:28.769279 21856 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:08:28.785071 16468 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:28.759799 21301 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:28.742568 21772 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:08:28.789644 16612 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.792438 16614 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:28.794442 16616 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:28.797550 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:28.795349 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:28.800850 16612 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.787909 21763 raft_consensus.cc:2804] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:28.804024 21775 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:28.804931 16615 raft_consensus.cc:1240] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:28.807785 21183 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:28.809234 16617 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:28.815164 16612 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:28.794674 21650 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:08:28.822911 21763 raft_consensus.cc:697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:28.825214 21183 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:28.840189 21183 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.840756 21763 consensus_queue.cc:237] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.847920 16462 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:28.831321 21812 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.857360 21812 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:28.834263 21722 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.859436 21722 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:28.860703 16511 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:28.861519 21697 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:28.862414 21697 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.862469 21822 consensus_queue.cc:237] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.864804 21773 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.862316 16511 leader_election.cc:400] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:28.869434 16511 leader_election.cc:403] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:08:28.870554 16511 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.862360 21643 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.876332 17120 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:28.881995 16462 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:08:28.877355 21701 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:28.877976 21782 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:28.888083 16461 raft_consensus.cc:1240] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:08:28.896225 21453 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:28.896713 21453 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:28.897548 21453 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.898929 21453 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:28.921259 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 111376us
I20260709 13:08:28.927562 17093 leader_election.cc:400] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16.
I20260709 13:08:28.927325 21718 consensus_queue.cc:1048] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:28.928818 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:28.947746 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 150266us
I20260709 13:08:28.940537 21486 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:28.896263 21183 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.948948 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:28.952414 16436 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:28.943428 21782 consensus_queue.cc:1059] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:28.950524 21787 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:28.970649 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:28.973318 21782 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:28.975869 21301 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:28.953894 21643 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:28.981837 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:28.956019 21334 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:28.986325 21782 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:28.996471 21782 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:28.997762 21782 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.001137 21301 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:29.001906 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:29.002424 21183 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:29.002467 16464 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.005255 21869 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:08:29.008014 21176 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:29.012825 21626 consensus_queue.cc:1059] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:29.015789 16464 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:29.023623 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:29.024349 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:29.025041 16536 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:29.027801 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:29.038669 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 52781.9us
I20260709 13:08:29.046643 21774 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:29.048673 21188 consensus_queue.cc:1059] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:29.049007 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:29.049700 16542 raft_consensus.cc:2368] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
W20260709 13:08:29.051728 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56931.7us
I20260709 13:08:29.055644 21822 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.059228 21753 raft_consensus.cc:3055] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:29.059655 21753 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:29.061473 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:29.038228 21626 raft_consensus.cc:3055] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:29.072235 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:29.073230 17120 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:29.083925 21726 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:29.057015 21334 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:29.085958 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:29.086056 21334 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:29.089236 21868 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:29.094420 16618 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:29.097626 16536 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:29.098595 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:29.067591 21626 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:29.105389 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 79048.9us
I20260709 13:08:29.105692 16615 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:29.112838 16463 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:29.060551 21753 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:29.118232 21753 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:29.120905 21822 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:29.121342 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:29.121876 21822 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:29.128429 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 58709.1us
W20260709 13:08:29.143411 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 74698.4us
I20260709 13:08:29.144140 16585 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:29.144675 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:29.145700 16582 leader_election.cc:400] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
I20260709 13:08:29.146091 16582 leader_election.cc:403] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:29.150564 16463 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:29.165652 21183 consensus_queue.cc:1059] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:29.168015 21792 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:29.136902 21818 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:29.178939 21486 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15.
I20260709 13:08:29.179724 21301 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:29.183285 16436 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:29.184603 21643 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.184811 21868 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:29.162726 21841 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:29.186430 21841 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:29.189384 16462 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:29.191367 16540 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:29.208678 16614 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:29.204577 16536 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:29.176342 21626 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:29.208935 21697 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:29.254375 16619 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:29.187494 21841 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:29.204008 21773 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:08:29.273124 17125 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:29.305104 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 108457us
I20260709 13:08:29.248163 21738 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:29.308790 16541 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:29.259927 21697 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:29.346711 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.300509 21788 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:29.311530 21626 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:29.362912 17125 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:29.372994 17120 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:29.347188 21868 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:08:29.349447 21188 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:08:29.421022 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 99251us
I20260709 13:08:29.424853 16465 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:29.439841 16539 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:08:29.440248 16539 pending_rounds.cc:85] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 13
I20260709 13:08:29.440472 16539 pending_rounds.cc:107] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:08:29.440698 16539 raft_consensus.cc:2889] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:29.440256 16544 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:29.468277 21853 log.cc:927] Time spent T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:29.496208 21176 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.513459 21886 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:08:29.525271 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 163755us
I20260709 13:08:29.528093 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:29.470059 21824 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.052s
W20260709 13:08:29.536922 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 175566us
I20260709 13:08:29.533041 21301 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:29.531371 21718 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:08:29.535075 21773 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:29.526129 21176 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:29.604439 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:29.573837 21726 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:29.613973 16610 raft_consensus.cc:1275] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:29.604322 21176 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:29.628651 21824 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.624231 21697 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:29.661460 21894 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:08:29.699791 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 84221.9us
I20260709 13:08:29.628973 21726 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:29.709569 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 105698us
I20260709 13:08:29.722681 17123 raft_consensus.cc:1275] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:29.727119 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:29.727681 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:29.728025 17125 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:29.728911 17123 raft_consensus.cc:2368] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15.
I20260709 13:08:29.751936 16463 raft_consensus.cc:1240] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:08:29.719951 21301 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:29.671135 21824 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:29.746961 21738 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:29.762445 21895 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260709 13:08:29.780745 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 171534us
I20260709 13:08:29.785086 16610 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:29.756798 21901 consensus_queue.cc:1048] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:08:29.736258 21625 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:08:29.779320 21773 consensus_queue.cc:1059] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:08:29.781000 21738 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:29.826455 21738 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:29.817556 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:29.828734 16536 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:29.798833 21729 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:29.757535 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:29.799723 21921 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:29.852911 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:29.852860 16582 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:29.853717 16536 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:29.856122 16618 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:29.860334 21738 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:29.860760 21738 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.861161 21738 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:29.862903 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:29.864030 21919 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:29.864580 21919 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.865047 21919 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:29.877295 21643 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:29.878196 21787 raft_consensus.cc:3055] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:29.878713 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.881323 16610 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:29.878659 21787 raft_consensus.cc:740] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
W20260709 13:08:29.883726 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 8e851f11d27b4a83aa395e05c4be6808 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:29.910391 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:29.910902 21895 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:08:29.921604 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 166305us
I20260709 13:08:29.812999 21301 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:29.934039 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 57927us
W20260709 13:08:29.943495 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 80785.3us
I20260709 13:08:29.851635 21921 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:29.915803 21188 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:08:29.951263 21924 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:29.953701 21726 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:29.946990 21753 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.826s	user 0.011s	sys 0.003s
I20260709 13:08:29.915337 21818 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:29.910759 21334 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:08:29.973255 21824 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:30.009210 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.009873 16462 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:29.972054 21188 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.016503 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:29.967875 21787 consensus_queue.cc:260] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.023470 21937 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:30.056033 21937 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.056444 21937 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.070323 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:30.070987 16614 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:30.082381 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.083128 16464 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:30.084049 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.084692 16463 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:30.087270 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:30.077409 21787 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:30.106768 21738 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.128906 21921 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:30.150827 21188 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:30.152590 21935 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:08:30.095918 21919 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.157058 21919 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:30.093370 21697 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:30.158454 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:30.158582 21697 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.159093 16539 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.165536 21724 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.166217 21724 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.167466 16539 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:30.168726 16582 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:30.169114 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.169804 21941 raft_consensus.cc:2804] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:30.170583 21941 raft_consensus.cc:697] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:30.169843 16541 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:30.171538 21941 consensus_queue.cc:237] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.172086 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:30.172379 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.172883 17125 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:30.171032 21724 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.174311 16583 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:30.145542 21882 log.cc:927] Time spent T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.876s	user 0.000s	sys 0.003s
I20260709 13:08:30.094094 21916 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:30.190280 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:30.197875 16541 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:30.198685 21738 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.192708 21697 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:30.205318 21933 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:08:30.210253 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:30.210966 17125 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.192366 21712 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:30.217490 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 282219us
I20260709 13:08:30.220855 21738 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:30.222316 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2304) took 1199 ms. Trace:
I20260709 13:08:30.222796 16538 rpcz_store.cc:276] 0709 13:08:29.022915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.023029 (+   114us) service_pool.cc:224] Handling call
0709 13:08:29.023285 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.023603 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.023627 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.024070 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.149340 (+125270us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:29.149377 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.149456 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.139986 (+990530us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:30.217531 (+ 77545us) raft_consensus.cc:1685] finished
0709 13:08:30.217553 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.222244 (+  4691us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33886,"raft.queue_time_us":13262,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8885,"spinlock_wait_cycles":209404288,"thread_start_us":124989,"threads_started":1,"wal-append.queue_time_us":215689}
W20260709 13:08:30.227039 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 143280us
I20260709 13:08:30.229187 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:30.229769 16463 raft_consensus.cc:3060] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.231861 17125 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:30.232942 16619 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:30.233920 16467 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:30.243213 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:30.243988 16462 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.225860 21712 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.194036 21916 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.244967 21921 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:08:30.282272 16464 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:30.276737 16462 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
W20260709 13:08:30.268451 21938 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:08:30.284721 16463 raft_consensus.cc:2468] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:30.284263 16585 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:30.268174 21712 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.269758 21942 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:08:30.301363 21697 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:30.301898 21697 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.286785 21948 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:30.303140 21948 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.303992 21697 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:30.297258 21911 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:30.305938 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:30.327806 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.329021 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:30.331023 16543 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:08:30.330927 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.332320 16545 raft_consensus.cc:2368] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16.
I20260709 13:08:30.331661 16543 pending_rounds.cc:85] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 6
I20260709 13:08:30.332796 16543 pending_rounds.cc:107] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:08:30.333103 16543 raft_consensus.cc:2889] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.288097 21898 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:30.285548 21937 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:30.336045 16539 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:30.336092 21937 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:30.338531 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:30.339294 16464 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.341464 21772 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:30.342067 21772 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.344290 21772 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.308842 21948 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.349164 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.351333 21916 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.355818 21712 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.304862 21911 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.357456 16618 raft_consensus.cc:2368] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14.
I20260709 13:08:30.357286 16464 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:30.358847 16511 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:30.359083 21911 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:30.359946 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 75788us
I20260709 13:08:30.361598 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.332460 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.364068 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:30.363030 16463 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:30.359966 21956 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:30.369009 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:30.373463 21697 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:30.373958 21697 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:30.374742 21697 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:30.363236 21937 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:30.376063 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:30.376695 16618 raft_consensus.cc:606] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:30.377363 16618 raft_consensus.cc:614] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:30.380386 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.405539 16585 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:30.422251 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:30.422966 16541 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.425446 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:30.427348 16433 leader_election.cc:400] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16.
I20260709 13:08:30.427248 21729 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:30.427765 16433 leader_election.cc:403] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.428900 21729 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:30.429759 16541 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:30.429355 21869 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16.
I20260709 13:08:30.431277 21869 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.417656 21812 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:30.453502 21812 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:30.454573 21812 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.455989 21812 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.458454 17093 leader_election.cc:400] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14.
I20260709 13:08:30.458937 17093 leader_election.cc:403] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:30.443624 21884 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.146s	user 0.000s	sys 0.005s
I20260709 13:08:30.375859 21937 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:30.477972 21937 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:30.386515 21956 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
W20260709 13:08:30.485810 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80395.6us
W20260709 13:08:30.494261 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 52371.4us
I20260709 13:08:30.481946 21956 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.499522 21792 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.500087 21792 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.502224 21892 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:30.502471 21792 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:30.502982 21775 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.502784 21892 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.504921 21753 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:30.505417 21753 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.507284 21753 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:30.508239 21892 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:30.512625 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 81959.3us
I20260709 13:08:30.493599 21941 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:30.511176 21945 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:30.518613 21945 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.530695 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.537833 16545 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:30.540500 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:30.540673 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.568017 21945 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:30.575500 21888 log.cc:927] Time spent T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 1.279s	user 0.001s	sys 0.002s
I20260709 13:08:30.576948 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:30.577842 16618 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:30.579066 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:30.579813 16617 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:30.581197 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:30.530400 21712 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:30.590606 16461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50946 (request call id 719) took 1499 ms. Trace:
I20260709 13:08:30.544273 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:30.592854 16545 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:30.595187 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:30.600064 16464 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:30.601145 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84121.6us
I20260709 13:08:30.591207 16461 rpcz_store.cc:276] 0709 13:08:29.095574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.095703 (+   129us) service_pool.cc:224] Handling call
0709 13:08:29.095978 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.131583 (+ 35605us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.131633 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.138733 (+  7100us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.285623 (+146890us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:29.285676 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.285774 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.574858 (+1289084us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:30.590259 (+ 15401us) raft_consensus.cc:1685] finished
0709 13:08:30.590283 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.590503 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63607,"raft.queue_time_us":36349,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4539,"spinlock_wait_cycles":140815232,"thread_start_us":120261,"threads_started":1,"wal-append.queue_time_us":139477}
I20260709 13:08:30.609436 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.623677 16617 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:30.633139 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.634119 16541 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:30.640223 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:30.637734 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:30.613559 21781 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:08:30.700999 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51590.6us
I20260709 13:08:30.786904 16539 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:30.658221 21926 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:30.721941 21774 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:30.790601 21792 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:30.794150 21914 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:30.798873 21939 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:30.810215 21775 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 13. Current term is 14.
I20260709 13:08:30.866220 16509 leader_election.cc:400] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15.
I20260709 13:08:30.866736 16509 leader_election.cc:403] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:30.867686 16539 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:30.876250 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:30.863895 21717 consensus_queue.cc:1048] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:08:30.799194 21774 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:30.864316 21961 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.374s	user 0.000s	sys 0.001s
I20260709 13:08:30.856426 21453 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:30.799575 21926 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.876430 21772 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15.
I20260709 13:08:30.861994 21914 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.861665 21792 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.893453 21898 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:30.914208 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 811) took 1224 ms. Trace:
I20260709 13:08:30.865752 21939 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.893357 21453 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:30.916399 16542 rpcz_store.cc:276] 0709 13:08:29.689682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.689859 (+   177us) service_pool.cc:224] Handling call
0709 13:08:29.690323 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.691073 (+   750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.691121 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.691679 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.367020 (+675341us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180049b2e0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:30.430933 (+ 63913us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:30.430969 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.431033 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.909920 (+478887us) raft_consensus.cc:1685] finished
0709 13:08:30.909942 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.914138 (+  4196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19820,"raft.queue_time_us":425,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8713,"spinlock_wait_cycles":3474304,"thread_start_us":63729,"threads_started":1,"wal-append.queue_time_us":739394}
W20260709 13:08:30.943393 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 402965us
W20260709 13:08:30.968936 21697 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:08:30.977459 16545 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
W20260709 13:08:30.980909 21965 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:08:30.982349 21964 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:08:30.985385 21453 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:30.997364 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49770.8us
W20260709 13:08:30.973495 21962 log.cc:927] Time spent T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:08:30.972149 21812 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.006s
I20260709 13:08:30.938357 21898 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:30.969700 21697 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.005540 21792 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.009420 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.014611 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:31.015839 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.013520 21779 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.017256 21779 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.018229 21697 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.019202 21779 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.023903 16509 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:31.025159 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 387533us
I20260709 13:08:31.026376 21847 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:31.026422 21819 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.026950 21847 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.027407 21847 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:31.035187 21847 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.037710 21939 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.039397 21937 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:31.039999 21847 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.041920 21914 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.043633 21957 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.044122 21926 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.046480 21916 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:31.048017 21916 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.049683 21724 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.050272 21909 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.050889 21945 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.051311 21941 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.053090 21942 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.055090 21959 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:31.036404 21968 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:31.056954 21774 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.058561 16582 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:31.058796 21898 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:31.059834 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 46534.9us
I20260709 13:08:31.091650 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:31.062006 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.092813 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:31.063616 17127 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:31.068420 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:31.072075 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:31.080597 16467 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:08:31.083639 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.097227 16461 raft_consensus.cc:2393] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 15: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
W20260709 13:08:31.059496 21969 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.145s	user 0.001s	sys 0.001s
I20260709 13:08:31.062563 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.044196 21957 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.099288 16545 raft_consensus.cc:1275] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:08:31.099114 21847 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:31.114760 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.115495 16614 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:31.114877 21847 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:31.088876 21715 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.081614 21941 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.128674 21941 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.122601 21715 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.124941 21841 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:31.123488 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:31.130744 21715 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.131081 21974 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:31.131564 21974 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:31.131959 21974 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:31.133785 21847 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.085783 21942 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.136727 21918 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.136931 21942 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.137310 21918 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.081400 21945 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.139353 21918 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.139642 16617 raft_consensus.cc:2393] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:31.082218 21909 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.140173 21945 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.080658 21724 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.088171 21959 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.142297 21724 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.082276 21916 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.142899 21959 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.144138 21916 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.146188 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.146965 21916 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:31.147257 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.147333 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.147926 16540 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:31.150801 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.153226 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.148974 17121 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:31.151842 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.152477 16613 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:31.158154 16582 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:31.158839 16541 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:31.159847 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.160989 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.162019 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:31.160984 17120 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:31.163355 16582 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:31.194022 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 110256us
W20260709 13:08:31.197386 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.199059 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.200698 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.201573 16463 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:31.230733 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.232511 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.232820 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.233484 16465 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:31.234788 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.237157 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.238330 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.342489 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.363129 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.366093 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.181447 21724 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:31.180198 21959 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:31.384797 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 94064.8us
I20260709 13:08:31.181789 21918 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:31.161281 21916 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:08:31.391508 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.438818 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.283191 21926 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.282840 21763 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:31.431787 21972 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:08:31.180626 21781 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.257s
I20260709 13:08:31.432087 21869 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.436877 21959 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.433900 21334 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:31.430068 21775 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
W20260709 13:08:31.478598 21968 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:08:31.483291 21777 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.483031 21901 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:31.472033 21918 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.544437 21959 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:31.569555 21777 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.561337 21334 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.582044 21777 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.554418 21909 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.496263 21926 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.517628 21763 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.540016 21869 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.575644 21914 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:31.640947 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 204448us
I20260709 13:08:31.554848 21775 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.608088 21777 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.648751 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.649268 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.650758 16468 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:31.653703 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:31.820039 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.820612 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.822460 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.823153 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.826927 16613 raft_consensus.cc:2393] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:31.645531 21914 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.845319 21914 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.845407 21906 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.846105 21906 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.847787 21334 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.848688 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:31.849443 21982 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
W20260709 13:08:31.850911 21980 log.cc:927] Time spent T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
I20260709 13:08:31.714516 21777 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.856375 21777 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.817319 21714 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.862494 21914 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.863516 21714 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.863912 21914 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.865963 21714 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.867501 21918 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.868090 21993 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:31.869033 21993 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.869925 21993 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:31.870278 21981 log.cc:927] Time spent T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:08:31.871804 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2630) took 1118 ms. Trace:
I20260709 13:08:31.872834 21926 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:31.881676 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 644582us
I20260709 13:08:31.831547 21941 consensus_queue.cc:1048] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:08:31.886225 21847 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:31.886857 21847 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.886942 21941 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.887408 21847 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.890472 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
W20260709 13:08:31.893350 16436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.894651 21915 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.894703 21909 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:31.895406 21909 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.895320 21915 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.895970 21909 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:31.896848 21724 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:31.897739 21724 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.899540 21915 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:31.887415 21941 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.907648 21670 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.919229 21942 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.914486 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.919800 21942 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:31.921276 21983 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
I20260709 13:08:31.921499 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.920444 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.922401 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.908435 21987 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.646916 21822 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:31.917078 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.923709 21987 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.923914 21822 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.924310 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.904844 21919 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.884752 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.925256 21919 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.926399 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.927215 21919 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.928402 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:31.928972 21822 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.872159 16542 rpcz_store.cc:276] 0709 13:08:30.753849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.945042 (+191193us) service_pool.cc:224] Handling call
0709 13:08:30.958465 (+ 13423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.976399 (+ 17934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.976428 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.998887 (+ 22459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.494733 (+495846us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:31.494776 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.494853 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.869456 (+374603us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:31.871486 (+  2030us) raft_consensus.cc:1685] finished
0709 13:08:31.871507 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.871742 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50868,"raft.queue_time_us":20211,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":8977664,"thread_start_us":413649,"threads_started":1,"wal-append.queue_time_us":538578}
I20260709 13:08:31.917757 21979 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.931686 21979 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:31.922600 21978 log.cc:927] Time spent T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 13:08:31.934022 21763 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.935987 16615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2583) took 2367 ms. Trace:
I20260709 13:08:31.937587 21909 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:31.938014 21775 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:31.937897 21670 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.938663 16611 raft_consensus.cc:1240] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 17. Ops: []
I20260709 13:08:31.913545 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:31.936494 16615 rpcz_store.cc:276] 0709 13:08:29.568043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.568510 (+   467us) service_pool.cc:224] Handling call
0709 13:08:29.583149 (+ 14639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.131887 (+548738us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b4800150258. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3c426aa1 00007ffa3c41db37 00007ffa3c41d9ca 00007ffa3c51526f 00007ffa3c514f37 00007ffa3c52955c 00007ffa3c529508 00007ffa3c529488 00007ffa3c529443 00007ffa3c5286ec 00007ffa3b452a96
0709 13:08:30.136367 (+  4480us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b1800190180. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa370a54bc 00007ffa343f348b 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440d455 00007ffa374f5060 00007ffa374f5bfb 00007ffa3750064b
0709 13:08:30.136570 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.136614 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:31.003754 (+867140us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b2c000fd7b8. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa35df6a11 00007ffa35e06372 00007ffa37538a01 00007ffa374fd43a 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2
0709 13:08:31.004126 (+   372us) log.cc:844] Serialized 26 byte log entry
0709 13:08:31.171055 (+166929us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:31.179163 (+  8108us) log.cc:844] Serialized 14 byte log entry
0709 13:08:31.817211 (+638048us) spinlock_profiling.cc:243] Waited 81.2 ms on lock 0x7b1800190180. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa3438ac0a 00007ffa3daca219 00007ffa34412a40 00007ffa3440d4e4 00007ffa3440d455 00007ffa374f5060 00007ffa37507716 00007ffa37518287 00007ffa37518208
0709 13:08:31.821210 (+  3999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.821284 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:31.935414 (+114130us) raft_consensus.cc:1685] finished
0709 13:08:31.935437 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:31.935565 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20456,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":758228,"raft.run_cpu_time_us":4027,"raft.run_wall_time_us":471567,"spinlock_wait_cycles":260496256,"thread_start_us":253817,"threads_started":2,"wal-append.queue_time_us":606059}
I20260709 13:08:31.942195 21979 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.911015 16462 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:08:31.915868 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:31.945654 16465 raft_consensus.cc:2393] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 17: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:31.898030 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.946949 16436 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:31.650063 21905 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:31.954810 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 56824.4us
I20260709 13:08:31.955988 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.939803 21957 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.960017 16436 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:31.966907 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:31.878819 21946 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.848510 21906 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:32.033581 21974 consensus_meta.cc:287] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.003s
I20260709 13:08:31.980062 21987 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.043212 21847 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:31.973845 21812 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:31.980258 21819 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.043994 21812 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.043728 21974 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:31.965019 21979 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:32.033089 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 67679.6us
I20260709 13:08:31.968371 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:32.046782 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 86835.9us
I20260709 13:08:32.062175 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:31.952096 21718 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:32.067159 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 98882.1us
I20260709 13:08:32.067951 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:32.038518 21975 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 1.052s	user 0.007s	sys 0.007s
I20260709 13:08:32.093900 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:31.986249 21918 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:32.044533 21819 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.082846 21995 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.034741 21977 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:31.973459 21905 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:32.104947 21959 consensus_meta.cc:287] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.000s
I20260709 13:08:32.058840 21618 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:32.041473 21909 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.014958 21625 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:32.014773 21957 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:32.083170 21847 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:32.181691 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 359005us
I20260709 13:08:32.103487 21714 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.212026 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.214172 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.212713 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.170152 21979 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:32.042562 21946 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.226292 17120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde"
dest_uuid: "98881185daee4f13b69385e36026216c"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:47098
I20260709 13:08:32.230193 17120 raft_consensus.cc:606] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:32.228071 16537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50270 (request call id 2614) took 1920 ms. Trace:
I20260709 13:08:32.235430 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.231355 16537 rpcz_store.cc:276] 0709 13:08:30.307292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.307729 (+   437us) service_pool.cc:224] Handling call
0709 13:08:30.307982 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:30.308350 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.308377 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:30.308700 (+   323us) log.cc:844] Serialized 26 byte log entry
0709 13:08:30.529482 (+220782us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800409780. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:30.951468 (+421986us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:30.951526 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.951614 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.037690 (+1086076us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa34336c85 00007ffa343376a2 00007ffa370a91db 00007ffa370a4aaf 00007ffa3709886e 00007ffa37097bb6 00007ffa370977d8 00007ffa370a1221 00007ffa370a11d9 00007ffa370a1169
0709 13:08:32.227791 (+190101us) raft_consensus.cc:1685] finished
0709 13:08:32.227823 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.227998 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10,"raft.queue_time_us":90,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16763,"spinlock_wait_cycles":72887808,"thread_start_us":421752,"threads_started":1,"wal-append.queue_time_us":645268}
I20260709 13:08:32.236064 16615 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:32.201282 21701 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.241220 21701 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.243261 21701 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.226540 21812 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.144042 21916 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:08:32.236682 21915 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:32.234915 21979 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.271540 21819 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.272852 21992 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.273633 21992 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.170384 21898 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.209836 21987 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:32.269541 21979 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.222815 21974 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.143587 21995 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.210757 21959 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.171839 21977 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:32.294042 16435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.041s	sys 0.033s
W20260709 13:08:32.318878 16435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.045s	sys 0.035s
I20260709 13:08:32.281873 21914 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:32.345914 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 250628us
I20260709 13:08:32.282707 21941 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.352902 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.353073 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.356880 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:32.357743 16615 raft_consensus.cc:606] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:32.365232 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.366209 16465 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:32.368213 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:32.364382 21792 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.010s	sys 0.058s
W20260709 13:08:32.378125 21792 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.010s	sys 0.058s
I20260709 13:08:32.378595 21992 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:32.383438 16582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.015s	sys 0.060s
W20260709 13:08:32.383862 16582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.015s	sys 0.060s
I20260709 13:08:32.286916 21898 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.389844 16468 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:32.396811 16462 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:32.234362 21957 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.372723 21942 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.408406 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.383365 21992 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:32.410135 16462 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
W20260709 13:08:32.416715 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 347766us
I20260709 13:08:32.447059 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.458204 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:32.459340 16462 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 11: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:32.464376 21898 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.465857 21959 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.466620 21946 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.466734 21977 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.491526 21988 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.500033 21869 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.500514 21937 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.501127 21937 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.501874 21670 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.445250 21992 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.467334 21905 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.507006 21995 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:32.514945 16509 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.012s	sys 0.029s
W20260709 13:08:32.515997 16509 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.012s	sys 0.029s
I20260709 13:08:32.492305 21988 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.506697 21841 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:32.522447 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 156792us
I20260709 13:08:32.507217 21937 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.532339 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:32.533185 16615 raft_consensus.cc:606] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:32.535441 16615 raft_consensus.cc:614] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:32.536942 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.538175 17120 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:32.544837 21937 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.549737 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.549681 21937 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.550625 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:32.550901 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.551226 16469 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:32.551820 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.551977 21937 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.553232 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.553604 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.555290 21977 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.555787 21977 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.557741 21977 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.545861 21772 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:32.558786 16469 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:32.558732 21772 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.560542 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:32.553283 16463 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:32.545123 22009 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.544324 21987 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:32.547645 21995 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.570641 21995 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.571887 21957 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.575181 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.553277 21992 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:32.580524 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.564929 21977 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.578857 21772 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.576793 21995 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.588014 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:32.589026 16610 raft_consensus.cc:606] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:32.590169 21860 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.590705 21860 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.592659 21860 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.595892 16610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:32.596437 16610 raft_consensus.cc:606] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:32.596748 16610 raft_consensus.cc:614] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:32.599527 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:08:32.601608 21993 consensus_meta.cc:287] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.002s
I20260709 13:08:32.584964 21977 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.579041 21987 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.586673 21988 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.610271 22001 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.577543 22009 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.611043 21977 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.621243 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.622013 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.622700 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.606966 21824 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.622037 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.623340 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.624737 16467 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
W20260709 13:08:32.630093 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 64440.3us
I20260709 13:08:32.623993 21788 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.631188 21974 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.631250 21788 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.631876 21974 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.633464 21788 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.633858 21974 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.623919 21753 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.634977 21824 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.625409 22001 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.645789 16539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 820) took 1998 ms. Trace:
I20260709 13:08:32.641252 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.674290 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.674654 17125 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:32.639627 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.647378 22015 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.652347 22009 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.706812 22015 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.710079 21977 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.712321 21977 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.713641 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:32.715559 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.716180 16615 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:32.679961 21753 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.722079 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.722810 16543 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:32.722858 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.724109 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.724803 16543 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:32.665624 16542 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:32.663565 21898 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.654369 21990 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.667505 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.663866 21203 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:32.672204 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:32.754791 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 75374.2us
I20260709 13:08:32.673724 16539 rpcz_store.cc:276] 0709 13:08:30.649712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.877359 (+227647us) service_pool.cc:224] Handling call
0709 13:08:30.894047 (+ 16688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.950653 (+ 56606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.950683 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.950720 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:30.950754 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.645580 (+1694826us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54001df954. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:32.645623 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.645735 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129703808}
I20260709 13:08:32.678613 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.755510 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:32.678843 17120 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:32.681612 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.756870 16612 raft_consensus.cc:2410] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:08:32.685098 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.706710 21915 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:32.775921 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.775786 21915 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.776726 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.777307 21188 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:32.777741 21188 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.778177 21188 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.779336 21915 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.722023 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.780150 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:32.781010 21898 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.781982 16540 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:32.783033 21898 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.783818 21203 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.785920 21203 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.681648 21773 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:32.786893 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:32.786749 21773 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.790220 22001 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.790781 17127 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:32.791512 21990 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.793819 21990 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.606673 21993 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.798624 21993 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.798923 21892 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.799449 21892 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.666302 21824 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.803289 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.758178 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:32.760072 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.761713 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.804812 16461 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:32.805187 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.764987 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.766549 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.805785 16545 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:32.767970 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.768827 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.771116 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:32.809482 21911 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.745s	user 0.069s	sys 0.141s
I20260709 13:08:32.809479 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:32.810971 21911 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.069s	sys 0.141s
I20260709 13:08:32.813002 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.813476 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.814199 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:32.816812 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.821301 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.822752 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.823523 16463 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 9.
I20260709 13:08:32.825892 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.828099 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.830415 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.830822 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:32.832105 16545 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:32.834231 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.835814 16545 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:08:32.838712 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:32.839334 16545 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:32.847555 16537 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:32.847791 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.848343 16539 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:32.858400 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:32.838080 21773 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.868517 16545 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:32.871326 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.871934 16539 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:32.868003 21824 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.877991 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:32.859449 21977 raft_consensus.cc:493] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:32.873989 21203 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:32.891168 21203 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.906370 21987 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:32.893438 22021 log.cc:927] Time spent T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:32.918100 22015 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.882462 21824 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:32.924347 21824 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.894611 21977 raft_consensus.cc:515] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:32.926544 21753 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:32.930104 21977 leader_election.cc:290] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.931804 21892 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:32.986737 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:32.992795 16436 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:32.992578 16366 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.996407 16366 catalog_manager.cc:5697] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.011778 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.015568 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.018716 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.020500 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:32.999689 16366 catalog_manager.cc:5697] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 16 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.022265 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.024155 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.024242 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.025156 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.028059 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.029217 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.029619 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.032224 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.033562 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.034626 21176 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:33.042092 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.056628 21729 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.057715 21729 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.061893 22016 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.061373 21176 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.062444 22016 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.062935 22016 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.065181 21176 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.065514 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.066773 17127 raft_consensus.cc:2410] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:33.067144 21729 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.069916 16585 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:33.075127 16610 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:33.076275 22016 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.077674 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.081699 17125 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:33.078588 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.078996 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:33.083527 17122 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.080470 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.068821 16366 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 10, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 10 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.088828 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.086469 21203 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.054931 21788 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.100572 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.104544 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:33.105713 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 52236.5us
I20260709 13:08:33.105816 21990 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.106611 21753 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.106768 21977 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:33.113947 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44348.3us
I20260709 13:08:33.124210 21788 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.125927 21188 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.127238 21788 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.131027 21847 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:33.131834 21847 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:33.131919 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.129959 21788 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.133652 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.133507 21847 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.134066 21788 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.120632 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.116876 21977 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:33.147565 16539 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:33.137745 16366 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.155267 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.156441 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.156913 16461 raft_consensus.cc:1240] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.157284 16469 raft_consensus.cc:3060] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.152541 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.151093 21977 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.188814 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.190510 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.193244 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:33.197976 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 186756us
I20260709 13:08:33.198985 16511 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.200004 21203 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:33.201200 17120 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:33.202644 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.203321 16545 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:33.206166 21841 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:33.185741 16366 catalog_manager.cc:5697] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.219383 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.222791 21188 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.227391 16537 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:33.231129 16469 raft_consensus.cc:2468] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:33.238418 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.237267 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.236948 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.241992 16545 raft_consensus.cc:2410] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:08:33.237874 21788 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.255739 16462 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:33.251925 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.258685 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:33.269227 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.270195 16537 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:33.281399 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.273152 22016 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.283046 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.282465 17122 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:33.291006 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.291311 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.292721 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.295341 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.283681 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:33.272032 16363 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 278) took 62797 ms (client timeout 15000 ms). Trace:
I20260709 13:08:33.314489 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:33.315943 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 63520.4us
I20260709 13:08:33.317538 22001 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.318392 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:33.346415 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 60819.3us
I20260709 13:08:33.347236 16540 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:33.332235 16366 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 15, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 15 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.353142 22037 raft_consensus.cc:993] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:33.354740 21977 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.355057 16366 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 12, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.357985 21847 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.359328 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:33.359268 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.360126 16539 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:33.356735 16366 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.360008 16542 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.365996 21847 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.364804 16366 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 16, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.374161 22036 raft_consensus.cc:1081] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:33.374374 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.374402 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.384357 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:33.381193 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.379582 21977 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.400707 16366 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 13, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.402616 16366 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:33.398366 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 157894us
I20260709 13:08:33.410578 16542 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:33.413427 16436 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.425123 22013 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.427529 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:33.428421 16610 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.435503 21718 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.437803 21670 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:33.439595 22035 log.cc:927] Time spent T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:08:33.441115 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 60184.4us
W20260709 13:08:33.441722 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 67498.8us
I20260709 13:08:33.442359 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.443606 21670 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.445469 16366 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:33.307678 16363 rpcz_store.cc:269] 0709 13:07:30.482412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.482847 (+   435us) service_pool.cc:224] Handling call
0709 13:08:33.271666 (+62788819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:28.802721 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:28.822514 (+ 19793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:28.822580 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:08:28.822595 (+    15us) tablet.cc:662] Decoding operations
0709 13:08:28.823331 (+   736us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:28.823429 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:28.823460 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:28.823972 (+   512us) tablet.cc:701] Row locks acquired
0709 13:08:28.824023 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:08:28.874614 (+ 50591us) write_op.cc:270] Start()
0709 13:08:28.874777 (+   163us) write_op.cc:276] Timestamp: P: 1783602508824133 usec, L: 0
0709 13:08:28.874806 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:08:28.893633 (+ 18827us) log.cc:844] Serialized 1317 byte log entry
0709 13:08:29.013354 (+119721us) op_driver.cc:464] REPLICATION: finished
0709 13:08:29.080610 (+ 67256us) write_op.cc:301] APPLY: starting
0709 13:08:29.080689 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:29.083058 (+  2369us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:29.083182 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:29.110096 (+ 26914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:29.110296 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:29.110344 (+    48us) write_op.cc:312] APPLY: finished
0709 13:08:29.110547 (+   203us) log.cc:844] Serialized 41 byte log entry
0709 13:08:29.110721 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.110810 (+    89us) write_op.cc:454] Released schema lock
0709 13:08:29.110851 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:29.114086 (+  3235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:29.114118 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":67024,"apply.run_cpu_time_us":6146,"apply.run_wall_time_us":30629,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":178449,"prepare.run_cpu_time_us":24236,"prepare.run_wall_time_us":149201,"raft.queue_time_us":79500,"raft.run_cpu_time_us":8607,"raft.run_wall_time_us":54763,"replication_time_us":138383,"spinlock_wait_cycles":24320,"thread_start_us":141417,"threads_started":4,"wal-append.queue_time_us":37499,"wal-append.run_cpu_time_us":13711,"wal-append.run_wall_time_us":1182965}]]}
I20260709 13:08:33.447984 16366 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 4 to 13. New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.454039 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.460340 16610 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:33.436569 21718 raft_consensus.cc:993] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:33.470062 21742 raft_consensus.cc:993] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:33.463435 21847 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.473203 21742 raft_consensus.cc:1081] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
W20260709 13:08:33.477741 16583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.246.68:34961 timed out after 1.556s (SENT) [suppressed 2 similar messages]
I20260709 13:08:33.489306 22040 raft_consensus.cc:1081] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:33.472630 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:33.496349 21188 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.496814 21188 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.497182 21188 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.499182 16366 catalog_manager.cc:5697] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.504561 16436 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:33.505221 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 148311us
I20260709 13:08:33.507534 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.509563 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.510532 21742 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.510950 21742 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.511363 21742 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.511586 22037 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.511721 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.512140 22037 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.512624 22037 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.515143 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.515594 21990 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:33.516847 21203 raft_consensus.cc:2764] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:33.518772 21905 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:33.519331 21905 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:33.521140 22037 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.523501 22037 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:33.524240 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 80346.4us
I20260709 13:08:33.488489 22041 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:33.527463 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:33.520313 21905 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.528738 22041 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.504858 21670 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:08:33.533037 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:33.536108 22039 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:33.537855 21847 consensus_queue.cc:1059] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:33.539067 22039 raft_consensus.cc:3055] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.539535 22039 raft_consensus.cc:740] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:33.542601 16585 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:33.542021 22039 consensus_queue.cc:260] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.543354 16582 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.544342 22038 raft_consensus.cc:2804] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:33.544412 22036 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:33.545008 22038 raft_consensus.cc:697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:33.545053 22036 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.545745 22036 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.546294 22038 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.550987 21841 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:33.552891 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 75364.7us
I20260709 13:08:33.553773 22037 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.554265 22037 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.554703 22037 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.554929 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.557561 21670 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:33.558145 21670 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:33.559538 21670 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.561444 21670 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.569002 22039 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.571626 21742 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.572849 16366 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 15, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.579130 16433 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:33.577387 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60747.7us
I20260709 13:08:33.534647 22041 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.580428 21176 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.580843 22041 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:33.578811 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 50099.2us
I20260709 13:08:33.590304 21188 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.599949 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.602758 21847 raft_consensus.cc:493] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.613399 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.614094 21847 raft_consensus.cc:515] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.614547 16542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:33.615278 16542 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.615646 16542 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.617444 21812 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.618306 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:33.613306 21990 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.623428 21990 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:33.623849 21990 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.629850 21188 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.615595 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.600700 21718 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.628988 21841 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:33.616575 21847 leader_election.cc:290] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.642050 21847 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:33.642496 21847 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.642931 21847 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:33.647502 21742 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:33.657529 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 121786us
I20260709 13:08:33.659190 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.660588 22016 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.661314 16542 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.662022 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:33.664135 21203 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.664559 21203 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:33.664717 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:33.665000 21203 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.665391 17123 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.665726 17123 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:33.666473 17123 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.667387 17123 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:33.669011 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 215299us
I20260709 13:08:33.670497 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.673377 16469 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:33.631592 16366 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 16 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.676199 16542 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.679308 16462 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:33.681082 16434 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.681864 17123 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:33.683202 16509 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:33.683300 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:33.684099 17121 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:33.684137 21977 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:33.684854 21977 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:33.685822 21977 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.684132 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:33.692636 21188 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.676977 22040 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.610460 22036 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.701363 16366 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 13, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.710397 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.717545 21670 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.717765 21176 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:33.719575 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.722468 16366 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 5 to 9, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.721431 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:33.725263 21176 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:33.711679 22001 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:33.725747 21176 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.730618 21176 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.729532 16616 raft_consensus.cc:1240] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.735224 22041 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:33.744926 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 62572.5us
I20260709 13:08:33.747121 16366 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 14, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.687851 21718 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.741057 22001 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.757020 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.762938 17118 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.763024 22041 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:33.765177 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:33.795534 21176 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.755975 22001 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:33.746306 21203 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:33.799705 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 44338.3us
I20260709 13:08:33.798642 21188 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:08:33.807463 16616 raft_consensus.cc:1240] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.801146 21812 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:33.813596 17092 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.812932 22016 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.817004 22016 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:33.817852 21203 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.817994 22016 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.819551 22016 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.805609 21670 consensus_queue.cc:1059] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:08:33.821427 22036 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:33.822273 21670 raft_consensus.cc:3055] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.822665 21670 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:33.822785 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 97391us
I20260709 13:08:33.823809 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:33.811080 21176 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.823544 21670 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.825484 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:33.826597 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 211302us
I20260709 13:08:33.828840 16366 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 8 to 11, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 11 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:33.831525 21670 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.832261 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.832881 16464 raft_consensus.cc:1240] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:33.837074 22013 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.838395 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.840154 21868 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.842111 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:33.847656 16434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.850361 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.850994 16467 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:33.849161 21183 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:33.849267 21203 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:33.853230 21203 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:33.853609 21203 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:33.854879 21718 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.855551 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.856271 16542 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:33.857491 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:33.858304 21718 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.858748 21718 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.859133 21718 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.869151 21788 raft_consensus.cc:493] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.869804 21788 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.872375 21788 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.872972 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.874341 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.875432 21841 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.876164 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.878777 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
W20260709 13:08:33.879951 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51265us
I20260709 13:08:33.879976 21788 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:33.881920 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.889240 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.890486 16366 catalog_manager.cc:5697] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 9 to 13, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 13 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:33.881148 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:33.883932 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:33.884639 21847 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.898536 21176 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:08:33.900493 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70759.8us
I20260709 13:08:33.904525 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:33.905599 16467 raft_consensus.cc:2468] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:33.906569 16614 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.906805 21183 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:33.906582 21905 consensus_queue.cc:1059] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:33.907486 21183 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.909039 22013 raft_consensus.cc:3055] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:33.909415 22013 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:33.909899 21183 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.910193 22013 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.912402 22013 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:33.902356 22051 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:33.921190 16582 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.922947 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.889231 21977 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.935565 16585 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:33.935950 16464 raft_consensus.cc:1240] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:33.937005 22036 raft_consensus.cc:2804] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:33.937080 22039 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:33.931417 22040 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:33.937661 22036 raft_consensus.cc:697] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:33.937680 22039 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.938329 22039 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.938740 22036 consensus_queue.cc:237] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.941653 21742 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:33.942243 21742 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:33.942595 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 100652us
I20260709 13:08:33.943329 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:33.944314 21742 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.945027 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:33.946326 21868 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:33.949806 21990 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.951382 21868 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:33.903090 22037 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.952018 21990 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.953299 21847 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:33.953466 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:33.955361 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.956118 21203 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.962423 21203 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.952041 21868 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.968031 21868 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:33.963980 22039 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:33.957278 22037 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:33.964983 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 43890.2us
I20260709 13:08:33.969170 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:33.965160 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:33.959013 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:33.971174 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:33.868398 22001 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.972055 22037 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:33.972537 22037 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:33.972972 22037 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:33.973446 22001 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:33.974551 16467 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:33.977025 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:33.977895 21718 raft_consensus.cc:515] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:33.979084 17118 raft_consensus.cc:2393] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 15: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
I20260709 13:08:33.979924 16582 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:33.980875 21176 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:33.981436 21176 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:33.981832 21176 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:33.985963 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:33.986515 16539 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.988644 21176 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:33.996024 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 65579.9us
I20260709 13:08:34.004052 21176 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:34.006023 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:34.006856 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 102396us
I20260709 13:08:34.007465 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.010466 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.015076 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.013082 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:34.003208 21742 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.028913 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.025813 16618 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 12.
I20260709 13:08:34.003651 22013 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.019023 22040 raft_consensus.cc:2749] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.043242 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:34.046062 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.047891 21176 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.033473 21718 leader_election.cc:290] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:34.030952 21742 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:34.053839 16614 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 9.
I20260709 13:08:34.066514 22039 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.068745 16539 raft_consensus.cc:2468] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:34.085688 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.083567 17090 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:34.068871 21334 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.060722 22001 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.075258 21742 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.103207 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.106277 21188 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:34.108646 21188 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.109164 21188 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.117637 16539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad356f899692471d8abda66b7fe01205"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:34.062016 22013 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:34.119658 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 73726us
I20260709 13:08:34.117913 16540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:34.118216 16539 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:34.124039 16539 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.121855 16610 raft_consensus.cc:1240] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:34.099601 22040 raft_consensus.cc:2804] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:34.078967 22037 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.127933 16618 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.130867 16540 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:34.131291 16540 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.129784 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.135393 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.136664 16543 raft_consensus.cc:1240] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.138525 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:34.139246 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.145440 16617 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:34.151659 16545 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:08:34.154980 16469 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:34.161630 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.165848 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:08:34.180568 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 50027.6us
W20260709 13:08:34.198879 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 147134us
I20260709 13:08:34.163604 22054 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.143726 22040 raft_consensus.cc:697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:34.202452 16433 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:34.200687 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 89707us
I20260709 13:08:34.209249 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:34.210078 22013 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:34.210471 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.211588 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.211400 22040 consensus_queue.cc:237] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.213470 16543 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.216611 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.219172 16541 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.232523 16511 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.238350 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.242182 16582 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.244907 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:34.229518 22060 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:34.246337 22067 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.253134 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.253760 21977 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.253763 22045 consensus_queue.cc:1059] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.254855 22036 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:34.254881 22045 raft_consensus.cc:3055] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.256014 22045 raft_consensus.cc:740] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.256071 16582 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.252223 16539 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.258005 21188 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.268191 16582 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.269809 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:34.273080 16539 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:34.280975 22051 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.288645 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.288585 22045 consensus_queue.cc:260] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.290059 22045 raft_consensus.cc:3060] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.290414 16545 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:34.301892 16461 raft_consensus.cc:2468] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:34.283520 21188 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:34.304344 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:08:34.305702 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78920us
I20260709 13:08:34.306190 17118 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:34.309778 22037 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.251935 22038 consensus_queue.cc:1059] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:08:34.313458 22038 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.313812 22038 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.314659 22038 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.315989 22038 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.282451 22067 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.321501 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.297389 21742 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:08:34.278411 21990 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:34.343127 16511 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.345431 16545 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:34.297228 22036 consensus_queue.cc:1059] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:34.364723 22041 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:34.366266 21188 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 13:08:34.373968 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60952.3us
I20260709 13:08:34.377189 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:34.387501 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78970.6us
I20260709 13:08:34.308974 21718 consensus_queue.cc:1059] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:08:34.367872 21742 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:34.385635 16585 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.393729 16469 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:34.399305 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.404845 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:34.405483 16615 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:34.409335 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.412477 17119 raft_consensus.cc:1240] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:34.413981 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.417832 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:34.418278 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.418561 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.417979 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.419507 16610 raft_consensus.cc:1240] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.385886 22060 consensus_queue.cc:1059] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:34.397662 22041 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.400303 21742 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.428643 17124 raft_consensus.cc:2368] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 17. Current term is 18.
I20260709 13:08:34.429211 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.434130 17122 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:34.408232 21788 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.437613 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
W20260709 13:08:34.437693 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 94662us
I20260709 13:08:34.391671 21183 consensus_queue.cc:1059] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:34.452399 16539 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:34.436370 22041 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.457459 22084 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:34.458210 22077 log.cc:927] Time spent T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:34.458598 22070 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:08:34.462584 22069 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:34.468883 22068 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:08:34.470548 22075 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:34.439517 22051 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.519826 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.523725 16583 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.455986 22076 raft_consensus.cc:3055] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.529430 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.532555 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.534291 16615 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 13.
I20260709 13:08:34.445430 21990 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.538508 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:34.539849 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 112055us
W20260709 13:08:34.539099 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 96348.5us
I20260709 13:08:34.548187 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.548292 16462 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.515758 22013 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:08:34.554205 16584 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:34.554234 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 173121us
I20260709 13:08:34.533465 22076 raft_consensus.cc:740] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:34.541247 22069 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.556571 22061 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:08:34.557081 21911 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.549154 21742 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.579111 16616 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:34.544184 22068 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.559542 22080 raft_consensus.cc:3055] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.560635 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:34.560945 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:34.561610 16618 raft_consensus.cc:1240] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.562873 21990 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:34.547181 22051 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:34.563987 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.565632 21812 consensus_queue.cc:1059] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:34.567080 22013 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:34.568406 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.573318 16540 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.574332 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:34.576297 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 86835.2us
I20260709 13:08:34.589903 16613 raft_consensus.cc:1240] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.596287 21176 raft_consensus.cc:3055] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.554862 22083 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.599653 16610 raft_consensus.cc:3060] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.603775 21176 raft_consensus.cc:740] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.601838 22013 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:34.608336 22073 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.608880 22067 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:08:34.610695 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 62586.4us
I20260709 13:08:34.673800 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.613466 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.674616 22039 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:34.675297 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 61897.6us
I20260709 13:08:34.676723 22087 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:34.676863 22041 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.678490 17123 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.679216 16583 leader_election.cc:400] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 17. Current term is 18.
I20260709 13:08:34.678982 22039 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.679543 16583 leader_election.cc:403] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.680716 16583 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.681408 22039 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.681583 22070 consensus_queue.cc:1059] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:34.682701 22070 raft_consensus.cc:3055] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.681095 22041 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.614805 21812 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.615147 22069 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:34.620249 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.625044 22076 consensus_queue.cc:260] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.683737 21812 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:34.629158 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 65261.4us
I20260709 13:08:34.684695 21812 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.629654 21670 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.687808 21670 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:34.688694 21670 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.690762 22063 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:34.690840 22095 consensus_queue.cc:1059] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:34.614517 16610 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 18.
I20260709 13:08:34.633000 22036 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:34.634452 16434 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.635983 22016 raft_consensus.cc:3055] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:34.640362 22068 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:34.692008 21812 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.694994 22054 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 17. Current term is 18.
I20260709 13:08:34.591096 22080 raft_consensus.cc:740] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:34.646844 16617 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:34.652115 16540 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:34.705116 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 166720us
I20260709 13:08:34.654639 16461 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:34.660005 21742 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:34.706192 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.707405 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.708632 22040 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.709391 22040 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:34.660502 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53931.9us
I20260709 13:08:34.708657 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.683137 22070 raft_consensus.cc:740] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:34.682704 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.631966 16462 raft_consensus.cc:2468] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 18.
I20260709 13:08:34.694960 16537 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.695482 16538 raft_consensus.cc:1240] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:34.712360 21176 consensus_queue.cc:260] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.696898 22016 raft_consensus.cc:740] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:34.719336 22016 consensus_queue.cc:260] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.720672 22016 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:34.723616 22013 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.699352 16544 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:34.725005 22013 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:34.605938 22061 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:34.725548 22061 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.725943 22061 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:34.729046 22090 consensus_queue.cc:1175] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:08:34.702924 22095 raft_consensus.cc:3055] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.729972 22095 raft_consensus.cc:740] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:34.730877 22095 consensus_queue.cc:260] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.732190 22095 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:34.703598 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 69215.1us
I20260709 13:08:34.704156 22081 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:34.701197 22076 raft_consensus.cc:3060] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.695420 22036 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.737382 22036 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.738533 22036 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:34.701145 22080 consensus_queue.cc:260] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.741166 22080 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.711290 16585 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.715252 16613 raft_consensus.cc:1240] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.697602 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:34.741426 22070 consensus_queue.cc:260] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.718114 21176 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.742851 22070 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.742928 22051 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.745185 16585 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.746239 22083 raft_consensus.cc:2804] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:34.746711 22083 raft_consensus.cc:697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.747613 22083 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.748267 22089 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.748787 22089 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:34.741302 21334 consensus_queue.cc:1175] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 15 status { last_received { term: 15 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 15 index: 7 } }
I20260709 13:08:34.750777 22089 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.755401 16463 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:34.755842 22061 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:08:34.757221 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48647.5us
I20260709 13:08:34.758220 22093 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.759578 17093 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:34.759781 22093 consensus_queue.cc:1059] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.760440 22074 raft_consensus.cc:2804] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:34.760742 22093 raft_consensus.cc:3055] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:34.761499 22093 raft_consensus.cc:740] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:34.766273 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:34.768014 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.760967 22074 raft_consensus.cc:697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:34.762234 22093 consensus_queue.cc:260] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.767974 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:34.773941 16463 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:34.776216 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.776827 16462 raft_consensus.cc:3060] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.783164 22061 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:34.783890 22001 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:34.784471 22001 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:34.785573 22093 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:34.769995 22074 consensus_queue.cc:237] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.785400 22001 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:34.801620 22068 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:34.804454 16462 raft_consensus.cc:2468] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:34.804898 22068 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.809053 22068 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:34.831391 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:34.832872 21176 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:34.837006 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:34.837970 16462 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:34.838869 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 162631us
I20260709 13:08:34.841362 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:34.847692 22067 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:34.848660 22067 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.849030 22067 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:34.849886 22067 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.851181 16511 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.852180 21974 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.852475 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.853716 16511 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:34.854586 21974 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:34.855300 21974 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:34.858316 16462 raft_consensus.cc:2468] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:34.868623 16511 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:34.837172 21203 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:34.873353 17123 raft_consensus.cc:1275] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:34.839790 21742 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:34.870397 16585 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:34.851236 22067 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.888366 21977 raft_consensus.cc:2749] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:34.884689 22076 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:34.893553 22076 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:34.899904 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.877432 22089 raft_consensus.cc:2804] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:34.875643 21742 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:34.908836 16537 raft_consensus.cc:1240] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:34.932336 16613 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:34.933012 16613 pending_rounds.cc:85] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 11
I20260709 13:08:34.933338 16613 pending_rounds.cc:107] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:34.942008 16613 raft_consensus.cc:2889] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:34.943889 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:34.879891 21203 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:34.910167 21742 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:34.959318 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 90869.5us
I20260709 13:08:34.951645 16464 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:34.942960 22089 raft_consensus.cc:697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:35.004195 16511 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:34.941536 22083 consensus_queue.cc:1048] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:08:35.003471 22076 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:35.010888 21974 raft_consensus.cc:2764] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:08:35.024322 22089 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
W20260709 13:08:35.028383 22096 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:08:35.028901 22106 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:08:35.034245 22107 log.cc:927] Time spent T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:35.039237 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "400e1c04ef6646108d16357968e6e8d1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.039321 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.040652 16610 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:35.012800 21847 consensus_queue.cc:1059] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:08:35.075336 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.076803 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.077181 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.078867 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.080418 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.084650 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.090317 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.113152 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343fbc074bb94714900a4da026ab998a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.114356 16615 raft_consensus.cc:2410] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:08:35.115820 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.116719 16462 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:08:35.120627 22101 log.cc:927] Time spent T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:08:35.121292 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.125938 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.128324 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.129541 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.130434 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:35.131834 22104 log.cc:927] Time spent T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:35.135548 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.136359 16615 raft_consensus.cc:2393] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:35.138237 16617 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:35.139016 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.139293 16614 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:35.144078 16616 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 10.
I20260709 13:08:35.144837 16511 leader_election.cc:304] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.148429 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.151355 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.150136 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.152878 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.153831 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:08:35.156878 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 227048us
I20260709 13:08:35.157647 17093 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:35.160959 16613 raft_consensus.cc:2468] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:08:35.165998 21718 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.162066 22100 raft_consensus.cc:2749] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:35.177145 22074 raft_consensus.cc:2804] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.177773 22074 raft_consensus.cc:697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:35.178377 21742 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.178745 22074 consensus_queue.cc:237] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.179898 16610 raft_consensus.cc:1240] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:35.182181 21742 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:35.186501 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.187206 16469 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:35.187704 22076 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:35.189347 16464 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:35.190069 16461 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:35.190718 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.193408 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.195400 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.195909 16469 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.198205 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:35.198660 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.199424 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:35.200237 16541 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:35.208528 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.209281 16461 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:35.216405 16469 raft_consensus.cc:2468] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:35.222561 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.223157 16465 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.223421 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.226786 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.227430 16468 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:35.231166 16611 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:35.231518 16461 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:08:35.234840 16462 raft_consensus.cc:1240] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.237298 16585 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:35.243217 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.249864 16470 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:35.255728 16541 raft_consensus.cc:1275] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:35.258481 21203 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:35.265573 22111 log.cc:927] Time spent T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:08:35.273018 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:35.279488 16618 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:08:35.275334 16465 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:35.283025 22093 consensus_queue.cc:1048] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.283346 16537 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:35.283913 16537 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.286057 22091 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.286682 22091 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:35.279336 22038 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.288072 22038 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:35.288981 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 51916.5us
I20260709 13:08:35.290201 22038 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:35.290868 21841 raft_consensus.cc:2804] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.291473 21841 raft_consensus.cc:697] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:35.292480 21841 consensus_queue.cc:237] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:35.295490 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 164005us
I20260709 13:08:35.307108 16511 leader_election.cc:304] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.308923 16511 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.310622 22087 raft_consensus.cc:2749] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:35.311352 22087 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.297751 22091 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.313467 16611 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:35.319079 16511 leader_election.cc:304] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.327081 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:35.320623 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.321015 16537 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.330844 16537 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.322113 22105 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:35.333653 22105 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.339403 22087 raft_consensus.cc:2749] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.339607 16470 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:35.341898 22105 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:35.342489 17123 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:35.325882 22066 raft_consensus.cc:3055] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:35.332157 22091 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.343546 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.345965 16462 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:35.346604 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.350021 16617 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:35.348701 16545 raft_consensus.cc:3060] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:35.347627 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.351370 16469 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:35.352563 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.351739 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:35.357131 16537 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:35.360852 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.367108 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.369576 16511 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.347340 22066 raft_consensus.cc:740] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:35.361593 21718 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.347167 21742 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:35.417186 22066 consensus_queue.cc:260] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.418788 22066 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:35.419660 22089 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:35.420269 22089 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.422837 22089 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:35.372514 22070 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:35.365408 22067 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:35.425915 22067 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.426376 22067 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.371891 21990 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:35.399760 16545 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:35.368976 21974 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.415755 22091 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:35.387763 21977 raft_consensus.cc:2804] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:35.436590 21974 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.437081 21977 raft_consensus.cc:697] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.437876 21974 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.438099 21977 consensus_queue.cc:237] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.434473 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.429718 21718 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:35.428903 22087 consensus_queue.cc:1059] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:35.436141 21990 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.445998 21718 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:35.495685 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 109893us
I20260709 13:08:35.490615 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:35.499984 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.506170 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:35.506569 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.507018 16545 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:35.513733 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.525779 16462 raft_consensus.cc:2393] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 14: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:35.491590 22095 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:35.527222 21203 raft_consensus.cc:3055] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:35.529980 21203 raft_consensus.cc:740] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.531178 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.539382 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.530982 21203 consensus_queue.cc:260] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.540412 16610 raft_consensus.cc:1275] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:35.542840 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:35.519115 22063 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:35.527691 22087 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.508083 22016 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:35.553850 16583 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.513913 22068 consensus_queue.cc:1059] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:08:35.553278 16366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 174) took 6605 ms. Trace:
I20260709 13:08:35.526621 22076 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:35.533593 22066 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:35.558985 21990 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.586194 16470 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:35.591037 22074 consensus_queue.cc:1048] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:35.594612 21868 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:08:35.595422 22068 consensus_queue.cc:1243] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer 8e851f11d27b4a83aa395e05c4be6808 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:35.564337 22063 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.562485 16366 rpcz_store.cc:276] 0709 13:08:28.939964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.942424 (+  2460us) service_pool.cc:224] Handling call
0709 13:08:35.545011 (+6602587us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:34.244646 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:34.255316 (+ 10670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:34.255379 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:08:34.255400 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:34.345320 (+ 89920us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:34.345426 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:34.345458 (+    32us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:08:34.347395 (+  1937us) tablet.cc:701] Row locks acquired
0709 13:08:34.347452 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:08:34.347672 (+   220us) write_op.cc:270] Start()
0709 13:08:34.347853 (+   181us) write_op.cc:276] Timestamp: P: 1783602514347594 usec, L: 0
0709 13:08:34.347891 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:08:34.348698 (+   807us) log.cc:844] Serialized 8639 byte log entry
0709 13:08:34.855416 (+506718us) op_driver.cc:464] REPLICATION: finished
0709 13:08:35.045343 (+189927us) write_op.cc:301] APPLY: starting
0709 13:08:35.054877 (+  9534us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:35.226054 (+171177us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540013d3d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fa32a 00007ffa3747ff14 00007ffa3747fec3 00007ffa3747fe38 00007ffa3747fdf3 00007ffa3747f0dc 00007ffa374a8e16 00007ffa37490cbb 00007ffa3747b39d 00007ffa3747ed75
0709 13:08:35.250343 (+ 24289us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b18003293e0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa34410522 00007ffa344127c1 00007ffa34412779 00007ffa34412709 00007ffa344126d1 00007ffa344119cd 000000000038f354 000000000038f199 00007ffa343f383a
0709 13:08:35.312349 (+ 62006us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:35.312396 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:35.472348 (+159952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:35.472856 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:08:35.472933 (+    77us) write_op.cc:312] APPLY: finished
0709 13:08:35.473555 (+   622us) log.cc:844] Serialized 196 byte log entry
0709 13:08:35.474501 (+   946us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:35.474735 (+   234us) write_op.cc:454] Released schema lock
0709 13:08:35.474824 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:35.478896 (+  4072us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:35.483983 (+  5087us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7808,"reported_tablets":30,"spinlock_wait_cycles":50816,"child_traces":[["op",{"apply.queue_time_us":160949,"apply.run_cpu_time_us":33334,"apply.run_wall_time_us":455541,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96043,"num_ops":22,"prepare.queue_time_us":135242,"prepare.run_cpu_time_us":57594,"prepare.run_wall_time_us":315888,"raft.queue_time_us":197260,"raft.run_cpu_time_us":23359,"raft.run_wall_time_us":422897,"replication_time_us":488825,"spinlock_wait_cycles":34176384,"thread_start_us":380196,"threads_started":4,"wal-append.queue_time_us":169671}]]}
I20260709 13:08:35.564515 22087 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.609447 22067 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.610497 22087 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.611945 22067 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:35.612668 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
W20260709 13:08:35.613250 22116 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:08:35.613412 16470 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.614598 21203 raft_consensus.cc:3060] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.553593 22124 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:35.628880 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 47699.9us
I20260709 13:08:35.577616 22036 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.631637 16470 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:35.645679 21718 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.657836 21718 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:35.660501 16368 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 5 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
W20260709 13:08:35.646412 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 92645.9us
I20260709 13:08:35.661890 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:35.665331 16618 raft_consensus.cc:2368] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15.
W20260709 13:08:35.649991 16508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.667523 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 45293.2us
I20260709 13:08:35.669765 17093 leader_election.cc:400] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15.
I20260709 13:08:35.670089 17093 leader_election.cc:403] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:35.671363 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:35.671896 17126 raft_consensus.cc:3060] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.677285 16585 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.664124 16368 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 9 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 10 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.679575 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:35.679929 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:35.562013 22095 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.681332 16462 raft_consensus.cc:2368] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15.
I20260709 13:08:35.686451 17093 leader_election.cc:400] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15.
I20260709 13:08:35.687652 17126 raft_consensus.cc:2468] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:35.677636 22060 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.689538 22036 raft_consensus.cc:2804] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:35.693270 16470 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:08:35.699524 16542 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.689283 22091 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:35.703564 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:35.723603 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:35.688431 21718 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15.
I20260709 13:08:35.735368 21203 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.735827 21203 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:35.736227 21203 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.699397 22036 raft_consensus.cc:697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:35.742919 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:35.705988 22095 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:35.696229 22060 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.731559 22091 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:35.759091 16542 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:08:35.766592 22066 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.768965 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:35.777546 16509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.781823 16368 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 11, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:35.802335 21203 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.820991 21203 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:35.821983 21203 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.823292 21203 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:35.824520 21203 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.825641 21203 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.781616 22066 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:35.837944 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 160737us
I20260709 13:08:35.841595 22141 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:35.842129 22141 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.844035 22141 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:35.847182 22066 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:35.832271 22036 consensus_queue.cc:237] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.857641 22091 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:35.890256 21203 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:35.893579 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 124691us
I20260709 13:08:35.893967 16542 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:35.894471 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:35.899003 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:35.899451 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:35.900095 16542 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:35.902465 16582 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:35.903399 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:35.907763 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.908442 16462 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:35.910225 16537 raft_consensus.cc:3055] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:35.910600 16537 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.911325 16537 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } }
I20260709 13:08:35.911952 16537 raft_consensus.cc:3060] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:35.914943 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:35.915556 16462 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:35.931041 22060 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:35.910041 22141 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:35.933640 22141 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.934029 22141 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:35.895941 21670 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:35.953516 21670 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:35.955773 21670 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:35.959969 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 44339.4us
I20260709 13:08:35.961162 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:35.965706 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:35.956753 21977 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.916849 22041 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 13:08:35.981014 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 77691.5us
I20260709 13:08:35.983448 16511 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.966171 22124 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:35.974423 22066 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:35.992174 21203 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:35.994815 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:35.995568 16511 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:35.979663 16537 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:35.966426 22147 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.006321 16511 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:35.966320 22146 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.110s
I20260709 13:08:35.991031 22066 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:36.042279 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 43705.8us
I20260709 13:08:36.012444 22090 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.015170 22100 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
W20260709 13:08:36.074281 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 68057.2us
I20260709 13:08:36.072140 21670 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:36.045994 22066 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.078076 22068 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.105072 22068 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.105518 22068 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.075812 22134 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:36.142005 16469 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:36.074151 22090 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.081663 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.142976 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.151998 16613 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 10: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:08:36.151353 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 177473us
I20260709 13:08:36.139768 22083 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.143316 22154 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.083704 21670 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:36.180752 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 99147.7us
I20260709 13:08:36.183437 22105 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:36.184116 22090 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.150251 22141 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.082619 22124 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.180601 22091 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.187775 22134 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.203917 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.189698 22160 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:08:36.200261 22158 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.228359 22158 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.230620 22158 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.200084 22157 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.232622 22157 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.182096 22083 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.235237 16613 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:36.219334 21868 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.310832 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.312405 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.187144 22154 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.206413 22091 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.312569 16463 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:36.323387 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.324833 16544 raft_consensus.cc:1275] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:36.324116 16543 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:36.313124 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123994us
W20260709 13:08:36.328495 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 140789us
I20260709 13:08:36.310101 21812 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:36.329017 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:36.309865 22134 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.328542 22136 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:36.331037 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.334088 16462 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:36.331759 16618 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:36.332880 21812 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.336633 16470 raft_consensus.cc:3060] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.337895 21812 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.341049 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.341766 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.342900 16618 raft_consensus.cc:2393] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 17: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:36.330065 16511 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.348115 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.348760 16464 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:36.351444 22149 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 13:08:36.354704 22154 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:36.362074 22157 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.339998 22134 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.365384 22134 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.366662 22091 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.312708 21868 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.372282 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.376556 16465 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:36.373922 16610 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:36.379580 16610 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:36.382046 16436 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.330786 22070 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.383868 16618 raft_consensus.cc:1217] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Deduplicated request from leader. Original: 13.8->[16.9-16.9]   Dedup: 16.9->[]
W20260709 13:08:36.348886 22152 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
W20260709 13:08:36.383008 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 53032.4us
I20260709 13:08:36.389730 16610 raft_consensus.cc:1275] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:36.390861 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.393519 16469 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:36.395998 16618 raft_consensus.cc:1240] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:08:36.383203 22087 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:36.370306 21868 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.414589 16541 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:36.418478 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.427927 22087 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:36.428941 22168 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:36.432960 22168 consensus_queue.cc:1048] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:36.368755 22066 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.439975 16543 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:36.397739 22157 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:36.442158 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:08:36.441649 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 112325us
I20260709 13:08:36.449496 16468 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:36.449930 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.450645 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.451092 16465 raft_consensus.cc:1275] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:36.451359 16466 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:36.450538 22105 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:36.459558 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.419139 22060 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.462944 16610 raft_consensus.cc:2393] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 15: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:36.469954 22087 consensus_queue.cc:1048] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:36.372442 22136 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.479743 16611 raft_consensus.cc:1240] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:36.446149 22157 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.481568 22157 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.482604 22136 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:36.445850 22141 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.401224 22070 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.496277 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.445883 17090 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:36.495297 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:08:36.501852 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56044.2us
I20260709 13:08:36.506223 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.506876 16464 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.507787 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 98881185daee4f13b69385e36026216c
I20260709 13:08:36.478602 22060 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.517349 22136 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.518944 22165 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:36.527446 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.527518 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.533145 21203 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:36.533593 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:36.534307 21203 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:36.529667 16463 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:36.529726 16544 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:36.515627 22170 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.529421 22060 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.540796 22170 raft_consensus.cc:493] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.541273 22170 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.541667 22070 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.544018 22066 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.529134 21670 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.544941 22167 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:08:36.535106 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:36.533124 16618 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:36.549571 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.549329 21203 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.552145 16462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.550223 16466 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:36.554381 16583 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:36.555856 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:36.532258 22136 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.570729 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.572921 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.577250 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.585180 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.535745 22105 consensus_queue.cc:1048] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:08:36.578135 22136 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.591449 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.576081 22066 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.595148 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.595264 16433 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:36.596446 16545 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:36.559549 22068 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.598140 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:36.598369 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:36.592073 22039 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:36.600878 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.601708 22039 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.604040 22039 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.604909 16536 raft_consensus.cc:3060] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:36.601504 21868 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.609995 22157 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.611093 22129 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:36.612311 22157 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.632812 16464 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:36.618149 16536 raft_consensus.cc:2468] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:36.638331 16585 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.602412 22063 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.645057 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.645758 16466 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.647639 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.602636 22036 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:36.649353 22036 raft_consensus.cc:2804] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:36.649899 22036 raft_consensus.cc:697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:36.650853 22036 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.654464 22157 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.655068 22157 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.656728 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:36.657234 22157 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.657344 16541 raft_consensus.cc:3060] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:08:36.659808 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.640292 16433 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.661844 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.662467 16461 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:08:36.664462 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.666025 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.669525 22160 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.670022 22160 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.672039 22160 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:36.672531 22090 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:36.689759 22095 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:36.690529 22095 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.694691 22060 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.695865 16463 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:36.668092 22063 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:36.708348 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:36.709247 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.709748 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.712678 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:36.738746 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 205196us
I20260709 13:08:36.738801 16468 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:36.604913 22068 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.748955 16467 raft_consensus.cc:2368] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:36.762984 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.743666 22165 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:36.690184 22170 raft_consensus.cc:515] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.786670 22170 leader_election.cc:290] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.787407 22132 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.788008 22132 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.792493 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.794723 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:36.795332 16613 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.799578 22136 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.801187 22095 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:36.802912 22060 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.807909 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.746693 21868 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:36.817152 21868 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.819351 21868 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.820750 21203 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:36.808705 16461 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.821359 21203 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:36.821614 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 81793.8us
I20260709 13:08:36.823166 21203 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.827574 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:36.828258 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de1d4f10dad40289b4f0b93992ff9b6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:36.828837 16543 raft_consensus.cc:3060] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:36.828274 16469 raft_consensus.cc:2368] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:36.830576 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.812463 16541 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:36.831633 16466 raft_consensus.cc:2468] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:08:36.834547 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.836280 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:36.836951 16545 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.840278 16461 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:36.840965 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.840888 16613 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:36.838730 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:36.844347 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.835494 21788 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:08:36.848227 16463 raft_consensus.cc:2368] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:36.848238 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.828847 22165 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.850627 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.851368 16436 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:36.851905 22076 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:36.858331 22076 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.859920 22143 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.860471 22143 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.860865 22093 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:36.861428 22093 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:36.862524 22143 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.863371 22093 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.863762 22188 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.864297 22188 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.867018 22188 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.867264 22130 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:36.868722 22090 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:36.871767 16511 leader_election.cc:400] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:36.872112 16511 leader_election.cc:403] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.876926 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.879230 16464 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:36.859643 22039 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:36.884303 21203 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 13. Current term is 14.
I20260709 13:08:36.890429 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.892472 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.892472 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.899290 16545 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:36.902778 16537 raft_consensus.cc:2393] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 16: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:36.907311 16511 leader_election.cc:400] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:36.907702 16511 leader_election.cc:403] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:36.843925 22036 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:36.913249 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:36.913574 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:36.854293 22165 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:36.914085 16613 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.916944 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.935612 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:36.960786 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebc26e5c94524ffe84fdc3e560019f4f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.947501 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a96ace5bf484a4eb2288cc869f95f80" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:36.972739 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:36.914958 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.901475 22095 raft_consensus.cc:2764] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:08:36.977938 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 57259.2us
I20260709 13:08:36.976361 16466 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
W20260709 13:08:36.940104 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 54366.4us
W20260709 13:08:36.961613 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 70592.4us
I20260709 13:08:36.981768 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:36.969580 17093 leader_election.cc:304] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:36.984274 16617 raft_consensus.cc:2368] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:36.987264 16613 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:36.988363 16612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.914534 22188 raft_consensus.cc:3060] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:36.915494 16585 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.992533 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.992866 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.909185 22076 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:36.966573 22087 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:36.948205 22061 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.012517 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:08:37.043051 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 127629us
I20260709 13:08:37.111300 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:36.938870 22070 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:08:37.121479 16610 raft_consensus.cc:2368] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17.
I20260709 13:08:37.116971 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:36.993750 22100 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:36.993364 22074 raft_consensus.cc:2804] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:37.114482 16543 raft_consensus.cc:2468] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:37.147688 16585 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:36.977077 22036 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.159696 22172 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.121562 22067 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:37.166452 22074 raft_consensus.cc:697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:37.171622 22087 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:37.146466 22076 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:37.174691 16585 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:37.144495 22039 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.147100 22051 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:37.173674 22083 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.146082 22157 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:08:37.159861 22193 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:08:37.184933 22087 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.178788 21974 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.130996 22061 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.183446 22038 raft_consensus.cc:2804] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:37.189333 22051 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.215065 16616 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:37.220048 22151 raft_consensus.cc:2804] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:37.194617 22157 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.185271 22067 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.222797 22157 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.223973 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:37.207954 21974 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.229638 22157 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.230338 22157 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.232136 21974 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.234483 22165 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.235833 16614 raft_consensus.cc:1240] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:37.236579 16538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50264 (request call id 2437) took 1059 ms. Trace:
I20260709 13:08:37.241196 16538 rpcz_store.cc:276] 0709 13:08:36.153694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.153841 (+   147us) service_pool.cc:224] Handling call
0709 13:08:36.154099 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.873957 (+719858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.873990 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:36.874033 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:36.874067 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.213016 (+338949us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b5400319f54. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:37.213062 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.213207 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654814080}
I20260709 13:08:37.196143 22172 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:37.211535 22038 raft_consensus.cc:697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:37.213541 22051 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.220666 22151 raft_consensus.cc:697] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:37.241163 22188 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:37.264997 22038 consensus_queue.cc:237] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.267988 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:37.268652 17127 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:37.271507 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:08:37.271762 22192 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 13:08:37.273741 22150 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.274192 22150 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.274274 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 295380us
I20260709 13:08:37.274613 22150 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.279601 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:37.280414 16464 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.258435 22036 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.291826 22151 consensus_queue.cc:237] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.296456 22136 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.255884 22074 consensus_queue.cc:237] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.297170 22061 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.299305 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:37.337545 17125 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
W20260709 13:08:37.335240 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 54603.7us
I20260709 13:08:37.339105 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:37.346184 17093 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:37.347272 16464 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:37.352685 16545 raft_consensus.cc:2468] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:37.357183 22061 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:37.358772 22166 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.390192 22166 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:37.390614 22166 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.397792 22165 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.333984 22087 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.369513 22061 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:37.421928 22194 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:08:37.359095 22172 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.416258 22061 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.431142 16542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37072 (request call id 873) took 1286 ms. Trace:
I20260709 13:08:37.433276 16542 rpcz_store.cc:276] 0709 13:08:36.145091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.145223 (+   132us) service_pool.cc:224] Handling call
0709 13:08:36.145539 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.145886 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.145916 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.148940 (+  3024us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.821270 (+672330us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800347ce0. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa3d2d8de1 00007ffa3d2e55b1 00007ffa343f2e07 00007ffa3d24dab9 00007ffa3440f69b 00007ffa3440d93f 00007ffa3440fc02 00007ffa3709720b 00007ffa3709cd23 00007ffa3709d0d1 00007ffa374b8a0f
0709 13:08:36.957948 (+136678us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:36.958012 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.958118 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.428823 (+470705us) raft_consensus.cc:1685] finished
0709 13:08:37.428842 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.431071 (+  2229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1235,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":15025,"spinlock_wait_cycles":4411648,"thread_start_us":136442,"threads_started":1,"wal-append.queue_time_us":967152}
W20260709 13:08:37.436940 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 67547.5us
I20260709 13:08:37.438795 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:37.441370 21334 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:37.441941 21334 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.444085 21334 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:37.446249 22197 log.cc:927] Time spent T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:08:37.447686 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:37.455425 16469 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:08:37.436910 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 75358.2us
I20260709 13:08:37.457672 21183 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.467406 21183 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.468987 22051 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.469672 21183 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:37.471128 22051 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.472301 16585 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:37.475216 21742 raft_consensus.cc:2804] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:37.475728 21742 raft_consensus.cc:697] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:37.440608 22036 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.473573 22087 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.474066 22212 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:37.477854 22039 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.480608 21742 consensus_queue.cc:237] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:37.491626 22206 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:37.493001 22166 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.501199 16616 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:37.502398 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:37.484095 22039 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.508255 22039 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.481653 22212 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.498384 22166 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:37.516207 22212 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.517472 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:37.503293 22150 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.548493 16467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2215) took 1099 ms. Trace:
I20260709 13:08:37.548995 16467 rpcz_store.cc:276] 0709 13:08:36.449567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.449710 (+   143us) service_pool.cc:224] Handling call
0709 13:08:37.548227 (+1098517us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003c7654. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa375012fa 00007ffa3c4c2b17 00007ffa35a3d6d4 00007ffa35a3d662 00007ffa35a3d591 00007ffa35a3d50c 00007ffa35a3c7c2 00007ffa3583848c 00007ffa358378c6 00007ffa3583726f
0709 13:08:37.548398 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685910784}
I20260709 13:08:37.539003 22067 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.558398 22150 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:37.561813 16617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:37.563889 16610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:37.564692 16610 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:37.563709 22172 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.575338 16436 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:37.574079 22172 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.582849 22172 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:37.587973 16436 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:08:37.579879 22190 log.cc:927] Time spent T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.587s	user 0.000s	sys 0.002s
I20260709 13:08:37.589092 21868 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.587837 22172 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.590461 16436 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:37.592525 22212 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:37.599081 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.601430 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.603044 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:37.603147 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:37.603416 17123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:37.603896 16541 raft_consensus.cc:3060] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.604274 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.603948 17123 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:37.596714 16436 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:37.610702 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:37.615140 16610 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.616040 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:37.617313 16617 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:37.613029 16436 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:08:37.608561 16511 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:37.624658 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:37.633997 22013 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.595608 22061 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.641050 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:37.641386 16619 raft_consensus.cc:2368] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17.
I20260709 13:08:37.643435 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:37.648434 17123 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:08:37.650041 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.652933 21203 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:37.654211 16509 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:37.654975 21203 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:37.655534 21203 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:37.656394 21203 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.640784 22061 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:37.661576 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 53051.7us
I20260709 13:08:37.662437 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:37.663177 22124 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.663676 16511 leader_election.cc:400] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:37.668578 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.669607 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.673249 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.668329 22167 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:37.685964 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:37.686683 16615 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 18.
I20260709 13:08:37.687739 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:37.664601 16511 leader_election.cc:400] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17.
I20260709 13:08:37.690738 16511 leader_election.cc:403] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.691900 16541 raft_consensus.cc:2468] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:37.699991 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:37.702198 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:37.704622 22124 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 16. Current term is 17.
I20260709 13:08:37.718575 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.720553 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.727408 16540 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:37.715550 21812 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:37.716759 22172 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:37.745231 21812 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:37.704020 22167 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.751701 21812 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:37.729185 22087 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:37.714083 22143 consensus_queue.cc:1059] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:37.789847 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:37.790407 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:37.790975 16461 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:37.750105 22188 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:08:37.793134 16465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:37.754295 22149 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:37.794505 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:37.807336 16466 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.794168 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:37.810251 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:37.813215 22154 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:37.819859 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:37.820703 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:37.823529 16538 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:37.832659 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:37.834662 22149 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.835184 22149 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:37.817049 22157 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.843979 16511 leader_election.cc:400] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:37.844409 16511 leader_election.cc:403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:37.843936 16466 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:37.845273 16540 raft_consensus.cc:1240] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:37.845008 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:37.836068 22149 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:37.852057 16582 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:37.855140 16511 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:37.872061 22170 consensus_queue.cc:1059] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:37.873214 22076 raft_consensus.cc:3055] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:37.873778 22076 raft_consensus.cc:740] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:37.875015 22076 consensus_queue.cc:260] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:37.864928 22168 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:37.849256 22130 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:37.888037 16467 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:37.849682 21974 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16.
I20260709 13:08:37.866158 22087 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:37.960386 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 56976.1us
I20260709 13:08:37.881528 22149 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.968639 16467 raft_consensus.cc:1275] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:08:37.952677 22192 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:37.928017 22076 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:37.993201 22132 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:37.956750 22089 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:37.949385 22153 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:08:38.082388 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 85953us
I20260709 13:08:38.084050 16582 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:38.082527 22167 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:08:38.080410 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53990.2us
I20260709 13:08:38.118527 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.126679 16585 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.121610 22038 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:08:38.145361 22224 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:38.128502 22132 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.077142 22089 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:38.158802 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 74811.9us
I20260709 13:08:38.130069 21742 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:38.118474 22160 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:08:38.157920 22220 log.cc:927] Time spent T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
W20260709 13:08:38.173018 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 217327us
W20260709 13:08:38.179024 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.190114 16618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41794 (request call id 2717) took 1337 ms. Trace:
I20260709 13:08:38.190608 16618 rpcz_store.cc:276] 0709 13:08:36.849097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.849564 (+   467us) service_pool.cc:224] Handling call
0709 13:08:36.849866 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.189030 (+339164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.189076 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.189135 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:37.189185 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.186483 (+997298us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540025c454. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:38.186533 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.186702 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779574912}
I20260709 13:08:38.203999 22124 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:38.204495 22124 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:38.205405 22124 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.206604 22124 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.207422 22089 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:38.166774 22067 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:38.238162 16614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41796 (request call id 2210) took 1319 ms. Trace:
I20260709 13:08:38.238785 16614 rpcz_store.cc:276] 0709 13:08:36.918758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.918868 (+   110us) service_pool.cc:224] Handling call
0709 13:08:36.947803 (+ 28935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.236351 (+288548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.237871 (+1001520us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003db154. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37466571 00007ffa374fde01 00007ffa374fc83e 00007ffa3c4c1419 00007ffa35a38bd4 00007ffa35a38b62 00007ffa35a38a91 00007ffa35a38a0c 00007ffa35a37cc2 00007ffa3583848c 00007ffa358378c6
0709 13:08:38.238086 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661802368}
I20260709 13:08:38.183709 21812 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.241653 16463 raft_consensus.cc:2393] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 19: Already voted for candidate 6f34f184d0dd4382bee8790b4c077d05 in this term.
I20260709 13:08:38.246384 22100 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:38.246894 22172 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:38.247150 22100 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.247639 22172 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.241920 22016 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:38.250111 22016 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.277791 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:38.288872 21812 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:38.289258 16467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:38.292650 17093 leader_election.cc:400] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17.
W20260709 13:08:38.292791 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70666.8us
W20260709 13:08:38.294879 16511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.301100 16618 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:38.292865 16467 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:08:38.289884 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:38.309935 16466 raft_consensus.cc:1240] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:38.310298 17125 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:38.293018 17093 leader_election.cc:403] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:38.323609 22070 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:38.327092 22166 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c for earlier term 16. Current term is 17.
I20260709 13:08:38.337713 22016 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:38.339108 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 102338us
W20260709 13:08:38.338999 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 212421us
I20260709 13:08:38.341588 16585 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.360443 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:38.374193 22100 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.375537 22070 consensus_queue.cc:1059] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:38.377400 22124 raft_consensus.cc:3055] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:38.377827 22124 raft_consensus.cc:740] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:38.379386 16617 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:38.384182 16538 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:38.385926 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:38.378648 22124 consensus_queue.cc:260] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.386756 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:38.387441 22124 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:38.387547 22157 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:08:38.388135 22157 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.389189 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:38.390202 22157 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:38.390955 22100 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:38.391999 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:38.378778 22051 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:38.343672 22147 consensus_queue.cc:1059] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:38.396908 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:38.397861 16618 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:38.392514 16585 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.402181 16543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:38.403697 16542 raft_consensus.cc:1275] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:38.404016 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:38.359688 22040 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:38.409803 16585 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:38.405550 16541 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:38.406406 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:38.406618 16538 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Rejecting Update request from peer 98881185daee4f13b69385e36026216c for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:38.406771 16582 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:38.384943 22209 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:38.415556 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:38.416025 22209 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.418094 22149 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:38.418483 22209 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:38.420871 16511 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:38.421826 22227 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.422947 22051 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:38.423475 22051 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:38.393141 22172 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.424294 22051 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.425747 17090 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:38.426175 22172 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:38.427196 22166 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.427521 22167 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:38.427892 22083 raft_consensus.cc:2749] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:38.428462 22167 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:38.428844 22167 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:38.429598 22167 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.431017 22167 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:38.432097 16433 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:38.433337 22016 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:38.413733 22160 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:08:38.436621 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:38.436951 16436 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:38.452936 21812 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:38.454360 22083 consensus_queue.cc:1048] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:38.455488 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:38.456383 22131 raft_consensus.cc:3055] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:38.466256 16585 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.471742 16536 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:38.433568 22060 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:38.474375 16470 raft_consensus.cc:1275] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:38.479024 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:38.459502 22061 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.480628 16466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:38.458938 22131 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:38.486440 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:38.448805 22074 consensus_queue.cc:1048] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:08:38.494510 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:38.494735 16582 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
W20260709 13:08:38.504995 16368 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 273) took 42830 ms (client timeout 15000 ms). Trace:
W20260709 13:08:38.505467 16368 rpcz_store.cc:269] 0709 13:07:55.710887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.723672 (+ 12785us) service_pool.cc:224] Handling call
0709 13:08:38.504924 (+42781252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.151748 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.311423 (+159675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.312589 (+  1166us) write_op.cc:435] Acquired schema lock
0709 13:08:36.318448 (+  5859us) tablet.cc:662] Decoding operations
0709 13:08:36.419036 (+100588us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.441698 (+ 22662us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.445670 (+  3972us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:36.469333 (+ 23663us) tablet.cc:701] Row locks acquired
0709 13:08:36.469361 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:36.469538 (+   177us) write_op.cc:270] Start()
0709 13:08:36.469689 (+   151us) write_op.cc:276] Timestamp: P: 1783602516469480 usec, L: 0
0709 13:08:36.469720 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.470480 (+   760us) log.cc:844] Serialized 1312 byte log entry
0709 13:08:36.558126 (+ 87646us) op_driver.cc:464] REPLICATION: finished
0709 13:08:36.785150 (+227024us) write_op.cc:301] APPLY: starting
0709 13:08:36.785234 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:36.817145 (+ 31911us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:36.817238 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:36.819125 (+  1887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:36.819312 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:36.819358 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:36.819550 (+   192us) log.cc:844] Serialized 41 byte log entry
0709 13:08:36.820304 (+   754us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.820400 (+    96us) write_op.cc:454] Released schema lock
0709 13:08:36.820439 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:36.844790 (+ 24351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:36.851800 (+  7010us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100766,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":226778,"apply.run_cpu_time_us":5417,"apply.run_wall_time_us":35679,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":160531,"prepare.run_cpu_time_us":4537,"prepare.run_wall_time_us":330789,"replication_time_us":88228,"thread_start_us":240870,"threads_started":2}]]}
I20260709 13:08:38.497880 21812 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:08:38.518666 22170 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:38.519289 22170 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.482052 22038 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:08:38.525832 22131 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.528378 22131 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.528497 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3274c86d23d641758f36e812f849be43"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:38.556046 16615 raft_consensus.cc:606] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
W20260709 13:08:38.557333 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 62659.5us
I20260709 13:08:38.577769 22210 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:38.553280 22212 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:38.588557 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 94292.4us
I20260709 13:08:38.589803 16585 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:08:38.591719 16466 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Rejecting Update request from peer 59746530bb6d4726893c108602ffac27 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:38.639791 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47689.9us
W20260709 13:08:38.645324 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 55595.1us
I20260709 13:08:38.650441 16466 raft_consensus.cc:1275] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:08:38.658569 22051 consensus_queue.cc:1048] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:38.673223 22170 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:38.679584 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:38.680441 16615 raft_consensus.cc:606] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:38.663902 22209 raft_consensus.cc:993] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:38.681245 22209 raft_consensus.cc:1081] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:38.691979 16539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:38.644248 22045 consensus_queue.cc:1048] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:38.651397 22141 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:38.693432 16542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3274c86d23d641758f36e812f849be43"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:38.694093 16542 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:38.694339 16542 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.688349 22089 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:38.718394 16617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:38.719247 16617 raft_consensus.cc:606] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.719707 16617 raft_consensus.cc:614] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:38.736253 22247 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:08:38.739490 16542 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.746081 16542 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:38.717985 22087 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:38.763082 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:38.763695 16614 raft_consensus.cc:606] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:38.764036 16614 raft_consensus.cc:614] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.782243 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:38.783243 22068 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:38.783653 22068 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:38.791005 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a1257c346f6436b83f5cc36b5c04f18"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:38.801960 16614 raft_consensus.cc:606] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:38.802465 16614 raft_consensus.cc:614] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:38.810636 17093 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:38.816274 16538 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:38.784431 22068 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.813695 22076 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:38.832741 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:38.839923 22068 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:38.847618 22241 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 13:08:38.884068 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:38.884974 16461 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:38.885967 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:38.886562 16611 raft_consensus.cc:3055] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:38.886845 16611 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:38.924639 16461 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:38.930114 16511 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
W20260709 13:08:38.938791 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 111920us
I20260709 13:08:38.931854 16611 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:38.955669 16611 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:39.011623 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 194495us
W20260709 13:08:39.022521 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 76227.2us
W20260709 13:08:39.022320 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 100868us
I20260709 13:08:38.995162 22147 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:39.035806 16611 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:39.051450 22124 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.057328 22124 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.059470 22124 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.037041 22147 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:39.062255 22249 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.324s	user 0.003s	sys 0.000s
I20260709 13:08:39.062142 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:39.063001 16461 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:39.065431 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:39.060680 22147 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:08:39.067312 22243 log.cc:927] Time spent T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.498s	user 0.004s	sys 0.008s
I20260709 13:08:39.066655 22133 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:39.068598 22253 log.cc:927] Time spent T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:39.068661 22133 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.069185 22133 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:39.069537 22252 log.cc:927] Time spent T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:39.081374 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:39.097437 16618 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:39.086571 22167 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.106220 22167 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.121958 22038 raft_consensus.cc:993] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:39.122471 22209 raft_consensus.cc:1081] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:39.122762 22167 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:39.138820 22258 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:08:39.141613 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:39.105396 22231 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.149307 22231 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.151935 22231 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.103936 22124 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:08:39.169983 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66976.3us
I20260709 13:08:39.172508 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:39.199597 16366 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.203450 16366 catalog_manager.cc:5697] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 16, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.205152 16366 catalog_manager.cc:5697] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 15, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 15 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.206967 16366 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 17, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 17 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.120489 22133 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.208720 16366 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:39.216059 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 181678us
I20260709 13:08:39.205358 22016 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:39.225000 16542 raft_consensus.cc:1240] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:39.215971 22089 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:39.244196 16465 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:08:39.261931 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 179550us
W20260709 13:08:39.270069 16510 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.246.126:40851, user_credentials={real_user=slave}} blocked reactor thread for 54908.6us
I20260709 13:08:39.273022 16545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:39.273581 16545 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.273988 16545 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.275925 22141 consensus_queue.cc:1059] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:39.276628 22141 consensus_queue.cc:1243] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:39.278549 22157 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:39.236135 22016 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.280330 22168 raft_consensus.cc:3055] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:39.280717 22168 raft_consensus.cc:740] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:39.282243 22168 consensus_queue.cc:260] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.283397 22168 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:39.319736 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 50702.1us
I20260709 13:08:39.325074 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.352041 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:39.356338 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.357024 16544 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
I20260709 13:08:39.366142 17090 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:39.386216 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:39.387176 16461 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:08:39.390133 17127 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:08:39.399227 16545 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.395138 22269 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:39.417092 16545 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:39.395710 22212 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:39.470227 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:39.470909 16615 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:39.471206 16615 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:39.471930 16615 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.422406 22269 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.496292 16615 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.503345 22269 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:39.509316 22271 log.cc:927] Time spent T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.292s	user 0.001s	sys 0.002s
I20260709 13:08:39.511448 22016 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:08:39.515232 16364 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 257) took 95209 ms (client timeout 15000 ms). Trace:
I20260709 13:08:39.517763 22068 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:39.518462 16366 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 17, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 17 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.548918 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:39.523262 16615 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
W20260709 13:08:39.477452 22246 log.cc:927] Time spent T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:39.539469 17126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:39.541714 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:39.550796 17126 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.550915 16461 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:39.545652 16364 rpcz_store.cc:269] 0709 13:07:04.306220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.306560 (+   340us) service_pool.cc:224] Handling call
0709 13:08:39.515028 (+95208468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2392917,"reported_tablets":40}
I20260709 13:08:39.553370 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:39.537180 22133 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.446449 22212 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.549678 16366 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 17, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 17 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.565608 16366 catalog_manager.cc:5697] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.578941 22269 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.581048 17127 raft_consensus.cc:2368] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
I20260709 13:08:39.582799 22212 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.571336 16366 catalog_manager.cc:5697] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 17, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.590499 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.591245 16544 raft_consensus.cc:2393] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:39.594789 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.589921 16366 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 14 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 15 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.597971 16366 catalog_manager.cc:5697] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 14 to 15, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 15 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.600396 16366 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 13 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 14 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.599222 17126 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:39.598527 16461 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:39.604274 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:39.601933 16366 catalog_manager.cc:5697] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.605269 16611 raft_consensus.cc:2393] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:39.606256 16366 catalog_manager.cc:5697] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.608260 16366 catalog_manager.cc:5697] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 19, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 19 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.609827 16366 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 15, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.611155 16366 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 12 to 13, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.613651 22269 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:39.616407 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:39.616962 16544 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.617988 16545 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:39.622339 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:39.623024 16461 raft_consensus.cc:3060] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:39.632213 16461 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:39.618759 22275 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:39.633198 17093 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:39.622292 22151 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.649070 22151 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.667820 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:39.668497 16461 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:08:39.638554 22170 raft_consensus.cc:2804] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:39.671444 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:39.696323 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:39.698911 22284 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:39.699505 22284 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:39.700035 22284 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.676463 22170 raft_consensus.cc:697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:39.703018 22170 consensus_queue.cc:237] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.676759 21742 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:39.705349 21742 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.705885 21742 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:39.709650 22280 log.cc:927] Time spent T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 13:08:39.710814 22270 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:39.711408 22270 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.715091 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.715950 16545 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:39.717574 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:39.730631 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:39.718954 22151 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:39.731701 16611 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:39.727276 22129 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:39.728683 22270 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.735493 22129 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:39.741572 22129 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:39.747797 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.748543 16537 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:08:39.753562 16585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.758898 16434 leader_election.cc:400] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
I20260709 13:08:39.759300 16434 leader_election.cc:403] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.760322 22270 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961) with higher term. Message: Invalid argument: T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
W20260709 13:08:39.762648 22283 log.cc:927] Time spent T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:08:39.735460 21742 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.765004 21742 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:08:39.781392 22286 log.cc:927] Time spent T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.274s	user 0.003s	sys 0.000s
I20260709 13:08:39.786847 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:39.787518 16538 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.798270 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:39.804911 21183 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:39.805552 21183 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.806469 16511 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:39.810458 16464 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:39.814530 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:39.815477 16619 raft_consensus.cc:2410] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:08:39.812510 22268 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:39.819449 16544 raft_consensus.cc:2468] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:39.830969 16611 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:39.821520 22261 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:39.854686 22143 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.857952 22147 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:39.859901 16611 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.827349 22268 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:39.866070 22268 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.869413 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.874060 16511 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:39.888933 22124 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.893123 22129 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.906781 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:39.907171 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:39.907696 16614 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 11: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:08:39.911006 17125 raft_consensus.cc:2955] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:39.918255 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:39.919183 21812 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:39.864969 22261 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:39.923022 22261 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:39.926673 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:39.927318 17127 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:39.927918 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:39.928438 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:39.929107 16545 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:39.931310 22265 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:39.934095 21183 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:39.934825 21183 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:39.935240 21183 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:08:39.935635 21183 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:39.941109 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:39.942068 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:39.943060 16538 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:39.896322 22129 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.944052 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:39.950521 22067 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:39.951043 22067 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:39.951869 22067 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.896260 22284 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:39.954665 22284 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:39.955159 16463 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:39.956504 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:39.957728 16538 raft_consensus.cc:2368] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:39.959321 16433 leader_election.cc:400] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:39.959836 16433 leader_election.cc:403] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:08:39.961966 16463 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:08:39.989573 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:39.972481 22129 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) with higher term. Message: Invalid argument: T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 11. Current term is 12.
I20260709 13:08:39.991153 22038 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.009855 16537 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 11.
I20260709 13:08:39.992875 22143 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47556 (request call id 0) took 1207 ms. Trace:
I20260709 13:08:40.039491 22143 rpcz_store.cc:276] 0709 13:08:38.778086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.778634 (+   548us) service_pool.cc:224] Handling call
0709 13:08:38.830208 (+ 51574us) log.cc:844] Serialized 501 byte log entry
0709 13:08:39.985339 (+1155131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11743,"raft.queue_time_us":81559,"raft.run_cpu_time_us":1470,"raft.run_wall_time_us":60804,"thread_start_us":218112,"threads_started":3,"wal-append.queue_time_us":206021}
I20260709 13:08:40.047919 22038 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.079257 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 14ab75d98ba64a9caa062cd19a0594fb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:08:40.087634 16433 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:40.089120 21812 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:40.089862 21812 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:40.091071 21812 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.095407 22038 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:40.131152 16470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:40.142925 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:40.147483 21183 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.150566 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:40.151440 16537 raft_consensus.cc:2410] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:08:40.157533 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:40.161448 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:40.162146 16537 raft_consensus.cc:2393] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:40.162390 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:40.167596 21183 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:40.162427 22168 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:40.233743 16461 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:40.260687 17127 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:40.261880 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:08:40.270597 21812 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:40.275379 22291 log.cc:927] Time spent T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:08:40.257033 22277 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:08:40.265591 22068 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.286993 22068 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.295604 22143 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.297485 22143 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.298980 22068 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:40.299387 22143 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:40.306134 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:40.306772 17125 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:08:40.287101 21812 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:40.321367 21812 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.310407 22284 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.324113 22284 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.326444 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:40.327746 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:40.328564 16464 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 19.
I20260709 13:08:40.338213 22227 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.338663 22227 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.338997 22227 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.339021 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:40.340621 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:40.354995 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:40.355633 16615 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 19.
I20260709 13:08:40.358248 22133 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:40.358806 22133 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.359169 22133 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.359618 17125 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.363525 22124 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:40.378819 16615 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.380347 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:40.381114 16538 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:40.382517 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:40.397351 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:40.391824 22284 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:40.385133 22151 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:40.409415 22151 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.410401 16615 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 15.
I20260709 13:08:40.411548 22151 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:40.412122 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
I20260709 13:08:40.412436 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:40.413002 16538 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:40.414072 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:40.415153 22038 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:40.415500 22038 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:40.415864 22038 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.420467 22143 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:40.395136 22275 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.425858 22275 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.426205 22275 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.427841 22038 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.431911 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:40.432128 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:40.436900 22038 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:40.441082 16545 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:40.442087 16538 raft_consensus.cc:1275] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:40.452630 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:40.454025 22151 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.454561 22151 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:40.455355 22151 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.458794 16464 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:40.476790 22133 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.480366 22227 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.483649 22227 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:40.478657 22068 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:40.487154 22133 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:40.478583 22301 consensus_queue.cc:1048] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:08:40.489583 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:40.490248 17127 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.494064 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:40.494910 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:40.495499 16618 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.499281 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:40.499898 16464 raft_consensus.cc:3060] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:40.500916 17127 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:40.502381 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:40.517187 16464 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 20.
I20260709 13:08:40.517426 16618 raft_consensus.cc:2468] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 20.
I20260709 13:08:40.481081 22275 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.530128 16461 raft_consensus.cc:2368] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17.
I20260709 13:08:40.534610 22227 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:40.535202 22227 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:40.542402 22275 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:40.536077 22227 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.545326 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:40.548743 16585 leader_election.cc:400] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) with higher term. Message: Invalid argument: T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17.
I20260709 13:08:40.551726 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:40.552713 16545 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.564342 16545 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:40.566783 16366 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:32886 (request call id 175) took 2983 ms. Trace:
W20260709 13:08:40.581184 22303 log.cc:927] Time spent T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:40.583636 16461 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:40.568790 16433 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:40.567925 16511 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:40.567184 16366 rpcz_store.cc:276] 0709 13:08:37.580970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.581140 (+   170us) service_pool.cc:224] Handling call
0709 13:08:40.564645 (+2983505us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:39.813155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:39.824449 (+ 11294us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:39.824484 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:39.824501 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:39.852135 (+ 27634us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:39.852217 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:39.852244 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:39.853504 (+  1260us) tablet.cc:701] Row locks acquired
0709 13:08:39.853524 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:39.853668 (+   144us) write_op.cc:270] Start()
0709 13:08:39.853783 (+   115us) write_op.cc:276] Timestamp: P: 1783602519853624 usec, L: 0
0709 13:08:39.853819 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:08:39.856413 (+  2594us) log.cc:844] Serialized 6724 byte log entry
0709 13:08:40.238173 (+381760us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.285607 (+ 47434us) write_op.cc:301] APPLY: starting
0709 13:08:40.286845 (+  1238us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:40.368391 (+ 81546us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:40.368508 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:40.535919 (+167411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:40.536200 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:08:40.536255 (+    55us) write_op.cc:312] APPLY: finished
0709 13:08:40.536598 (+   343us) log.cc:844] Serialized 156 byte log entry
0709 13:08:40.536781 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.536934 (+   153us) write_op.cc:454] Released schema lock
0709 13:08:40.536990 (+    56us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1053803,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":33040,"apply.run_cpu_time_us":22557,"apply.run_wall_time_us":287985,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75153,"num_ops":17,"prepare.queue_time_us":105012,"prepare.run_cpu_time_us":13403,"prepare.run_wall_time_us":189471,"raft.queue_time_us":194887,"raft.run_cpu_time_us":19761,"raft.run_wall_time_us":39328,"replication_time_us":377118,"spinlock_wait_cycles":81664,"thread_start_us":271897,"threads_started":4,"wal-append.queue_time_us":142950}]]}
I20260709 13:08:40.588341 22279 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:40.600862 22279 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:40.601810 22279 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.590468 22143 raft_consensus.cc:2804] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:40.605129 22143 raft_consensus.cc:697] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:40.605993 22143 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.590598 21841 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:08:40.626492 16537 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:08:40.629273 22160 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:40.675601 16545 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.685910 22270 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:40.719763 22157 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.720309 22157 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.723356 16464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05" is_pre_election: true
W20260709 13:08:40.731372 16365 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 272) took 68695 ms (client timeout 15000 ms). Trace:
W20260709 13:08:40.741590 16365 rpcz_store.cc:269] 0709 13:07:32.035777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.041395 (+  5618us) service_pool.cc:224] Handling call
0709 13:08:40.731172 (+68689777us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":1225472}
I20260709 13:08:40.746522 16537 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.745797 17125 raft_consensus.cc:1240] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Rejecting Update request from peer 6f34f184d0dd4382bee8790b4c077d05 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:40.748155 22157 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:40.749004 22284 consensus_queue.cc:1059] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:40.751487 22284 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:40.751909 22284 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:40.752956 22284 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:40.754472 22284 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:40.757753 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:40.758343 16537 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:40.760409 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:40.763664 22157 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:40.764117 22157 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.768888 22157 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.807677 16361 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.811792 16361 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.809748 16619 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:40.814338 21812 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:40.829947 22275 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:08:40.830509 22275 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.830565 22157 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.832587 22275 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:40.834291 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:40.814342 16361 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 12, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.835294 16615 raft_consensus.cc:2368] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
I20260709 13:08:40.835745 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:40.836556 16537 raft_consensus.cc:2393] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 in current term 16: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:08:40.837540 16436 leader_election.cc:400] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
I20260709 13:08:40.837988 16436 leader_election.cc:403] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.839599 21812 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.846897 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:40.874292 22157 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:40.875083 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:40.875682 16537 raft_consensus.cc:3060] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.896442 16537 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:40.898175 16582 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:40.903698 22160 raft_consensus.cc:2804] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:40.897440 16361 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.919364 22160 raft_consensus.cc:697] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:40.918504 16361 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 6 to 9, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.921355 22160 consensus_queue.cc:237] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.924867 16464 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.926970 22233 consensus_queue.cc:1059] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:40.927551 21812 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347) with higher term. Message: Invalid argument: T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f34f184d0dd4382bee8790b4c077d05 for earlier term 16. Current term is 17.
I20260709 13:08:40.927944 22233 consensus_queue.cc:1243] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 6f34f184d0dd4382bee8790b4c077d05 log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:40.928580 22045 raft_consensus.cc:3055] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:40.929030 22045 raft_consensus.cc:740] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:40.929937 22045 consensus_queue.cc:260] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:40.932374 16538 raft_consensus.cc:1240] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:40.932830 22045 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:40.921970 16361 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.972201 17125 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:40.969417 16463 raft_consensus.cc:2468] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:08:40.974378 22268 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:40.949128 16361 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 7 to 10, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.991776 16361 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 10, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:40.999735 16361 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.014422 16463 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:08:41.014938 16463 pending_rounds.cc:85] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Aborting all ops after (but not including) 13
I20260709 13:08:41.015206 16463 pending_rounds.cc:107] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:08:41.015496 16463 raft_consensus.cc:2889] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.014624 16361 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 13 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.023871 16545 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:41.027544 21812 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:41.022189 22318 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:08:41.045339 16469 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:41.048965 16615 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:08:41.049433 16615 pending_rounds.cc:85] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Aborting all ops after (but not including) 10
I20260709 13:08:41.049696 16615 pending_rounds.cc:107] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:08:41.049973 16615 raft_consensus.cc:2889] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.052330 22284 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:41.054989 22124 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:41.032876 16361 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 12 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.069607 16361 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.078328 16361 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.085371 16361 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.086897 16361 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 13, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.115767 16361 catalog_manager.cc:5697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.130740 16615 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:41.127061 16361 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.135815 22124 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:41.140990 16361 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.157577 16361 catalog_manager.cc:5697] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.356094 16463 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:41.359493 22160 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:41.432902 16537 raft_consensus.cc:1275] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:08:41.435482 22168 consensus_queue.cc:1048] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:41.436260 22168 consensus_queue.cc:1243] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer 59746530bb6d4726893c108602ffac27 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:41.436298 16366 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 14 to 15, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:41.438789 16537 pending_rounds.cc:85] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Aborting all ops after (but not including) 8
I20260709 13:08:41.438323 16366 catalog_manager.cc:5697] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.439095 16537 pending_rounds.cc:107] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:08:41.439473 16537 raft_consensus.cc:2889] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:41.439982 16366 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 17, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 17 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:41.441486 16366 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 4 to 8, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 9 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:41.486477 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:41.518621 22275 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:41.519291 22275 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:41.524843 22275 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:41.527453 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:41.528759 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:41.530788 16436 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:41.531842 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:41.538937 22275 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:08:41.570048 16361 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 274) took 17570 ms (client timeout 15000 ms). Trace:
W20260709 13:08:41.570585 16361 rpcz_store.cc:269] 0709 13:08:23.999756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.999968 (+   212us) service_pool.cc:224] Handling call
0709 13:08:41.569947 (+17569979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:41.231981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:41.232624 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:41.232668 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:08:41.232692 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:41.234468 (+  1776us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:41.234562 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:41.234597 (+    35us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:08:41.236222 (+  1625us) tablet.cc:701] Row locks acquired
0709 13:08:41.236245 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:08:41.236420 (+   175us) write_op.cc:270] Start()
0709 13:08:41.236541 (+   121us) write_op.cc:276] Timestamp: P: 1783602521236362 usec, L: 0
0709 13:08:41.236566 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:08:41.245169 (+  8603us) log.cc:844] Serialized 7526 byte log entry
0709 13:08:41.293767 (+ 48598us) op_driver.cc:464] REPLICATION: finished
0709 13:08:41.317918 (+ 24151us) write_op.cc:301] APPLY: starting
0709 13:08:41.318000 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:41.355623 (+ 37623us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:41.355743 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:41.395162 (+ 39419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:41.395536 (+   374us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:08:41.395600 (+    64us) write_op.cc:312] APPLY: finished
0709 13:08:41.396086 (+   486us) log.cc:844] Serialized 172 byte log entry
0709 13:08:41.396282 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.396457 (+   175us) write_op.cc:454] Released schema lock
0709 13:08:41.396513 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.417437 (+ 20924us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.417474 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23650,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":23890,"apply.run_cpu_time_us":24509,"apply.run_wall_time_us":99460,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83509,"num_ops":19,"prepare.queue_time_us":24017,"prepare.run_cpu_time_us":5905,"prepare.run_wall_time_us":33138,"replication_time_us":56995,"thread_start_us":42666,"threads_started":2}]]}
I20260709 13:08:41.601537 16362 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 11 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } }
I20260709 13:08:41.606675 16362 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.612434 16362 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.692730 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:41.708165 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:41.708881 16537 raft_consensus.cc:606] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:08:41.733598 22336 tablet_replica.cc:333] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:08:41.743224 22321 raft_consensus.cc:993] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:41.743891 22321 raft_consensus.cc:1081] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:41.747080 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:41.747742 16537 raft_consensus.cc:606] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Received request to transfer leadership
W20260709 13:08:41.756313 16352 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 43cea492ee7e4f91b2ad509449c832f1 already in progress [suppressed 1 similar messages]
I20260709 13:08:41.766909 22336 raft_consensus.cc:2243] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.768064 22336 raft_consensus.cc:2272] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.771733 22336 ts_tablet_manager.cc:1916] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:41.773259 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 69283.5us
W20260709 13:08:41.778592 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 55404.5us
I20260709 13:08:41.795818 16615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:08:41.798943 16615 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.799396 16615 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.826496 16361 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 14 to 16, leader changed from 98881185daee4f13b69385e36026216c (127.14.246.68) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:41.834856 16352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 78568.9us
W20260709 13:08:41.835258 16362 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 260) took 19207 ms (client timeout 15000 ms). Trace:
I20260709 13:08:41.842514 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:41.843168 16619 raft_consensus.cc:606] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:08:41.835657 16362 rpcz_store.cc:269] 0709 13:08:22.627883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.628352 (+   469us) service_pool.cc:224] Handling call
0709 13:08:41.835161 (+19206809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:41.715583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:41.716121 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:41.716153 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:41.716178 (+    25us) tablet.cc:662] Decoding operations
0709 13:08:41.716706 (+   528us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:41.716758 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:41.716818 (+    60us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:41.717245 (+   427us) tablet.cc:701] Row locks acquired
0709 13:08:41.717259 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:08:41.717411 (+   152us) write_op.cc:270] Start()
0709 13:08:41.717514 (+   103us) write_op.cc:276] Timestamp: P: 1783602521717366 usec, L: 0
0709 13:08:41.717529 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:08:41.718134 (+   605us) log.cc:844] Serialized 1313 byte log entry
0709 13:08:41.719792 (+  1658us) op_driver.cc:464] REPLICATION: finished
0709 13:08:41.720194 (+   402us) write_op.cc:301] APPLY: starting
0709 13:08:41.720269 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:41.721947 (+  1678us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:41.722037 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:41.723823 (+  1786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:41.724020 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:08:41.724062 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:41.724260 (+   198us) log.cc:844] Serialized 41 byte log entry
0709 13:08:41.724442 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.724559 (+   117us) write_op.cc:454] Released schema lock
0709 13:08:41.724613 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:41.725675 (+  1062us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:41.725726 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110704,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":4783,"apply.run_wall_time_us":5408,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12534,"num_ops":3,"prepare.queue_time_us":91,"prepare.run_cpu_time_us":2734,"prepare.run_wall_time_us":2822,"replication_time_us":2166,"spinlock_wait_cycles":1792}]]}
I20260709 13:08:41.849107 16615 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:41.852012 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:41.852624 16618 raft_consensus.cc:606] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:41.852973 16618 raft_consensus.cc:614] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.854990 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:41.856256 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b92bb40598544d8591903d884ef151b0"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:41.856902 16618 raft_consensus.cc:606] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:41.858419 16463 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.859807 16618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:41.860458 16618 raft_consensus.cc:606] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:41.860862 16618 raft_consensus.cc:614] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.863282 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:41.863831 16537 raft_consensus.cc:606] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:08:41.865636 16619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:41.866221 16619 raft_consensus.cc:606] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:41.867825 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:41.869911 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:41.884815 22336 ts_tablet_manager.cc:1929] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 13:08:41.890324 22336 log.cc:1199] T 14ab75d98ba64a9caa062cd19a0594fb P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/14ab75d98ba64a9caa062cd19a0594fb
I20260709 13:08:41.896066 16363 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.902050 16363 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 13 to 17, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } }
I20260709 13:08:41.903450 16463 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:41.908361 16363 catalog_manager.cc:5697] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 15 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.912299 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 14ab75d98ba64a9caa062cd19a0594fb (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:41.915486 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:41.916154 17125 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.923851 17125 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:41.923883 16363 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 13, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.925091 16583 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:41.926833 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:41.933100 16545 raft_consensus.cc:3055] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:41.933449 16545 raft_consensus.cc:740] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:41.934231 16545 consensus_queue.cc:260] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:41.935683 16545 raft_consensus.cc:3060] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:41.937306 22160 raft_consensus.cc:2804] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:41.937896 22160 raft_consensus.cc:697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:41.938800 22160 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:41.928448 16615 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:41.949714 16545 raft_consensus.cc:2468] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:08:41.950179 16363 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 9 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 10 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.951869 16363 catalog_manager.cc:5697] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.956131 16363 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.960647 22233 raft_consensus.cc:993] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:41.961189 22233 raft_consensus.cc:1081] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:41.965699 16545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:41.961668 16363 catalog_manager.cc:5697] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 17 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.966338 16545 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:41.966763 16545 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.970964 16363 catalog_manager.cc:5697] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.972797 16363 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 13 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:41.974646 16363 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 13, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.977273 16363 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.978669 16363 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 11 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.985594 16545 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:41.986956 16363 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 9 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.988209 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:41.989514 16463 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:41.989732 16363 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 8 to 10, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 10 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.991232 16363 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.992321 16363 catalog_manager.cc:5697] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:41.993551 16363 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 8 to 14, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.995313 16363 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 14, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:41.996716 16463 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:41.997326 16363 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.002107 16511 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:42.002225 16363 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.003005 22265 raft_consensus.cc:2804] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:42.003561 22265 raft_consensus.cc:697] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:42.004439 22265 consensus_queue.cc:237] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:42.049355 16545 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:42.050294 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:42.052393 16618 raft_consensus.cc:3055] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:42.052716 16618 raft_consensus.cc:740] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:42.053520 16618 consensus_queue.cc:260] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:42.054834 16618 raft_consensus.cc:3060] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:42.061838 16618 raft_consensus.cc:2468] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:08:42.088920 16416 auto_rebalancer.cc:893] Removing replace marker failed: Replica 59746530bb6d4726893c108602ffac27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:42.089397 16416 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 43cea492ee7e4f91b2ad509449c832f1 already in progress
W20260709 13:08:42.089704 16416 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 43cea492ee7e4f91b2ad509449c832f1 already in progress
I20260709 13:08:42.116627 22045 raft_consensus.cc:993] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:42.117213 22045 raft_consensus.cc:1081] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:42.126746 16463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:08:42.129437 16463 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:42.130086 16463 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.152506 16463 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:42.154796 16463 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:42.155529 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:42.156134 16615 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:42.156446 16615 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:42.157188 16615 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:42.158095 16615 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.165120 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:42.165702 17127 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:42.168663 16615 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 18.
I20260709 13:08:42.169909 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:42.170984 22284 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:42.171932 22284 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:42.173192 22284 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:42.199853 17127 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 18.
I20260709 13:08:42.213907 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:42.214272 16363 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 281) took 2661 ms. Trace:
I20260709 13:08:42.214720 16363 rpcz_store.cc:276] 0709 13:08:39.552820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.556249 (+  3429us) service_pool.cc:224] Handling call
0709 13:08:42.214208 (+2657959us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.020476 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.022417 (+  1941us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.022457 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:08:42.022473 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:42.024662 (+  2189us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.024717 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.024741 (+    24us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:08:42.027691 (+  2950us) tablet.cc:701] Row locks acquired
0709 13:08:42.027710 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:42.027849 (+   139us) write_op.cc:270] Start()
0709 13:08:42.027970 (+   121us) write_op.cc:276] Timestamp: P: 1783602522027800 usec, L: 0
0709 13:08:42.027989 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.029290 (+  1301us) log.cc:844] Serialized 8298 byte log entry
0709 13:08:42.033268 (+  3978us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.034761 (+  1493us) write_op.cc:301] APPLY: starting
0709 13:08:42.034840 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.089784 (+ 54944us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.089886 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.123595 (+ 33709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.123945 (+   350us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:08:42.124001 (+    56us) write_op.cc:312] APPLY: finished
0709 13:08:42.124488 (+   487us) log.cc:844] Serialized 188 byte log entry
0709 13:08:42.125371 (+   883us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.125585 (+   214us) write_op.cc:454] Released schema lock
0709 13:08:42.125656 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.132036 (+  6380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.132069 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10339,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1281,"apply.run_cpu_time_us":26535,"apply.run_wall_time_us":97242,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87738,"num_ops":21,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":6251,"prepare.run_wall_time_us":9573,"replication_time_us":5128}]]}
I20260709 13:08:42.222911 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 14ab75d98ba64a9caa062cd19a0594fb (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:42.242693 16367 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.260013 16367 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 9 to 12, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.315296 16363 catalog_manager.cc:5697] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.317708 16363 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 17 to 18, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 18 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.320726 16363 catalog_manager.cc:5697] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 16, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 16 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
W20260709 13:08:42.337936 16367 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54058 (request call id 280) took 19047 ms (client timeout 15000 ms). Trace:
I20260709 13:08:42.341001 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 14ab75d98ba64a9caa062cd19a0594fb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:42.343930 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 14ab75d98ba64a9caa062cd19a0594fb (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
W20260709 13:08:42.338500 16367 rpcz_store.cc:269] 0709 13:08:23.290251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.290536 (+   285us) service_pool.cc:224] Handling call
0709 13:08:23.873844 (+583308us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540013d3d4. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa37467090 00007ffa37505f3a 00007ffa3d2bc1cc 00007ffa3d3ba37e 00007ffa3b87b2a4 00007ffa3b87b232 00007ffa3b87b161 00007ffa3b87b0dc 00007ffa3b87a392 00007ffa3583848c 00007ffa358378c6
0709 13:08:42.337866 (+18464022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:42.293927 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:42.294506 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:42.294541 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:42.294562 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:42.294955 (+   393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:42.295011 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:42.295041 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:42.295373 (+   332us) tablet.cc:701] Row locks acquired
0709 13:08:42.295389 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:42.295537 (+   148us) write_op.cc:270] Start()
0709 13:08:42.295645 (+   108us) write_op.cc:276] Timestamp: P: 1783602522295484 usec, L: 0
0709 13:08:42.295668 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:42.296312 (+   644us) log.cc:844] Serialized 929 byte log entry
0709 13:08:42.298542 (+  2230us) op_driver.cc:464] REPLICATION: finished
0709 13:08:42.298950 (+   408us) write_op.cc:301] APPLY: starting
0709 13:08:42.299024 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:42.300238 (+  1214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:42.300323 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:42.302469 (+  2146us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:42.302618 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:42.302659 (+    41us) write_op.cc:312] APPLY: finished
0709 13:08:42.302837 (+   178us) log.cc:844] Serialized 33 byte log entry
0709 13:08:42.302993 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.303074 (+    81us) write_op.cc:454] Released schema lock
0709 13:08:42.303110 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:42.303389 (+   279us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:42.303414 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":212,"reported_tablets":50,"spinlock_wait_cycles":294576896,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":3988,"apply.run_wall_time_us":4412,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2676,"prepare.run_wall_time_us":2677,"replication_time_us":2768}]]}
I20260709 13:08:42.378649 17125 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:42.380925 22168 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:42.383540 22168 raft_consensus.cc:993] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:42.383958 22168 raft_consensus.cc:1081] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:42.393218 16538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b92bb40598544d8591903d884ef151b0"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:42.393770 16538 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:42.394145 16538 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.400652 16538 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:42.403360 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:42.404031 16461 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.404428 16538 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:42.410339 16615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:42.411005 16615 raft_consensus.cc:3055] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:42.411295 16615 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:42.412036 16615 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:42.413352 16615 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:42.420977 16461 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:42.422245 16511 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:42.423204 22341 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:42.423808 22341 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:42.424149 16615 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
I20260709 13:08:42.424679 22341 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:42.370376 16363 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 15 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.426847 16363 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 12, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.436335 16461 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:42.441154 16363 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 10 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 11 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.442581 22045 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:42.448302 16363 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 15 to 20, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 20 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.457484 16363 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 12 to 17, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 17 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.472070 16538 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:42.476377 22045 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:42.472601 16463 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:42.487871 16619 raft_consensus.cc:1275] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:42.488085 22340 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.491261 22265 consensus_queue.cc:1048] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:42.572106 16367 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 16, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 16 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:42.632012 16619 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:42.633980 22284 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:42.649371 16361 catalog_manager.cc:5697] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 13 to 14, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } }
I20260709 13:08:42.686476 17125 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:42.688195 22284 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:42.710953 16368 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33444 (request call id 261) took 4056 ms. Trace:
I20260709 13:08:42.711524 16368 rpcz_store.cc:276] 0709 13:08:38.654988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.655187 (+   199us) service_pool.cc:224] Handling call
0709 13:08:42.710886 (+4055699us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418444,"reported_tablets":49}
I20260709 13:08:42.712318 16615 consensus_queue.cc:237] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:42.723405 17127 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:42.725106 22160 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:42.732429 22233 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 4 to 14, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:42.738629 17126 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 4 to 14, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:42.743201 16469 raft_consensus.cc:1275] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:42.745354 22160 consensus_queue.cc:1048] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:42.748560 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43cea492ee7e4f91b2ad509449c832f1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.757310 16469 raft_consensus.cc:2955] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 4 to 14, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:42.809156 16364 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54070 (request call id 275) took 2512 ms. Trace:
I20260709 13:08:42.809644 16364 rpcz_store.cc:276] 0709 13:08:40.297195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.299051 (+  1856us) service_pool.cc:224] Handling call
0709 13:08:40.416028 (+116977us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5400240590. stack: 00007ffa343de343 00007ffa343de240 00007ffa33d6d1d4 00007ffa3daab304 00007ffa3daab299 00007ffa34298db1 00007ffa343d8b71 00007ffa343d90b2 00007ffa3d352a89 00007ffa3d2eada6 00007ffa3d2bc088 00007ffa3d3ba37e 00007ffa3b87b2a4 00007ffa3b87b232 00007ffa3b87b161 00007ffa3b87b0dc
0709 13:08:42.809096 (+2393068us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19183,"reported_tablets":50,"spinlock_wait_cycles":6470912}
I20260709 13:08:42.844056 16368 catalog_manager.cc:5697] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 4 to 14, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 16 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.870993 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.888021 16364 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 10 to 11, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 11 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:42.898726 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 43cea492ee7e4f91b2ad509449c832f1 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:42.923609 22363 tablet_replica.cc:333] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:08:42.925171 22363 raft_consensus.cc:2243] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.925910 22363 raft_consensus.cc:2272] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.927892 16619 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.935343 22363 ts_tablet_manager.cc:1916] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.936503 22341 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:42.991741 22363 ts_tablet_manager.cc:1929] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:08:42.992359 22363 log.cc:1199] T 43cea492ee7e4f91b2ad509449c832f1 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/43cea492ee7e4f91b2ad509449c832f1
I20260709 13:08:42.994788 16469 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:08:42.996474 22360 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:42.998556 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 43cea492ee7e4f91b2ad509449c832f1 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
W20260709 13:08:43.496258 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 211561us
I20260709 13:08:43.632615 16538 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:08:43.666887 16509 consensus_peers.cc:597] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3274c86d23d641758f36e812f849be43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.669978 16614 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:43.671545 16469 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:43.674196 22360 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:43.676143 22360 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:43.772423 22341 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:43.786854 16469 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:43.798642 16619 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:43.817438 16364 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:43.916414 16619 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:43.968559 16537 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:43.968604 16583 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab144bc0671c46e6807f89d495e66473. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:43.975212 16469 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:43.979686 22233 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:43.995332 22045 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.083837 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.124598 22160 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.136790 16469 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.160844 22384 ts_tablet_manager.cc:933] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:44.198457 16361 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.208084 16537 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:44.219203 22384 tablet_copy_client.cc:323] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:08:44.226261 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 3274c86d23d641758f36e812f849be43 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:08:44.227025 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 3274c86d23d641758f36e812f849be43 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-3274c86d23d641758f36e812f849be43
I20260709 13:08:44.242069 16536 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:08:44.267997 16509 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad356f899692471d8abda66b7fe01205. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.269590 16555 tablet_copy_source_session.cc:215] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:44.271474 16614 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:44.291281 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3274c86d23d641758f36e812f849be43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.313699 22341 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:44.354125 16469 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:44.362386 22360 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:08:44.405313 22265 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.412686 16619 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.449680 16469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:08:44.450438 16469 raft_consensus.cc:606] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:08:44.477866 16361 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 20 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.506466 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "245c53b961134a578f08f960e84a789a"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:44.507956 16614 raft_consensus.cc:606] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:44.514731 22384 tablet_copy_client.cc:806] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:44.529072 16464 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.533018 22384 tablet_copy_client.cc:670] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:44.540561 22384 tablet_copy_client.cc:538] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:44.562644 16537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84545dee228c4faea4411a58c683bb27"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:44.563405 16537 raft_consensus.cc:606] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:44.572578 22360 raft_consensus.cc:993] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:44.573158 22341 raft_consensus.cc:1081] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:44.575220 16464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84545dee228c4faea4411a58c683bb27"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57652
I20260709 13:08:44.575842 16464 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.576207 16464 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.577879 16614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:44.581456 16614 raft_consensus.cc:606] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:44.585085 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:44.588088 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:44.592163 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 92578.4us
I20260709 13:08:44.605844 16464 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.614542 16469 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:44.614936 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:44.615816 16545 raft_consensus.cc:3055] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:44.616111 16545 raft_consensus.cc:740] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:44.617192 16545 consensus_queue.cc:260] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.618566 16545 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.614212 16464 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:44.623411 22396 ts_tablet_manager.cc:933] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:44.628750 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:44.631248 16619 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:44.638442 16545 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:44.656836 22384 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:44.665872 16433 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:44.667078 22394 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:44.667739 22394 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
W20260709 13:08:44.670982 16434 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15bb7626d64b480b9966ee39a4d8f1f9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.670660 22394 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.668099 16619 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:08:44.677850 16537 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:44.677927 16619 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:44.679482 22395 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.680966 22396 tablet_copy_client.cc:323] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:08:44.680841 22367 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.683192 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet ab144bc0671c46e6807f89d495e66473 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:08:44.683892 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet ab144bc0671c46e6807f89d495e66473 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-ab144bc0671c46e6807f89d495e66473
I20260709 13:08:44.710134 16628 tablet_copy_source_session.cc:215] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:44.734616 22396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab144bc0671c46e6807f89d495e66473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:44.742861 21812 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.743333 16614 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.753445 16361 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 15 to 16, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.795384 22233 raft_consensus.cc:993] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:44.796001 22160 raft_consensus.cc:1081] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:44.795523 16361 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.799176 16537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "245c53b961134a578f08f960e84a789a"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:44.799798 16537 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.800184 16537 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.813056 16537 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.816246 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:44.816931 16469 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.826387 16469 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:44.830317 16511 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:44.831388 22341 raft_consensus.cc:2804] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:44.831965 22341 raft_consensus.cc:697] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:44.833916 22341 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.835222 16537 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:44.843225 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:44.843792 16614 raft_consensus.cc:3055] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:44.844070 16614 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:44.844947 16614 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:44.846354 16614 raft_consensus.cc:3060] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:44.848860 22396 tablet_copy_client.cc:806] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:44.858481 22396 tablet_copy_client.cc:670] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:44.863134 22396 tablet_copy_client.cc:538] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:44.872432 21812 raft_consensus.cc:993] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:44.872983 21812 raft_consensus.cc:1081] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:44.875618 17125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53654
I20260709 13:08:44.876219 17125 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.876564 17125 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.885572 22396 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:44.894970 16545 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:44.907850 16614 raft_consensus.cc:2468] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:44.921411 17125 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:44.939399 16364 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 12 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.967715 22403 ts_tablet_manager.cc:933] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:44.974118 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:44.974860 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:44.975437 16614 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.974829 16469 raft_consensus.cc:3055] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:44.981262 16469 raft_consensus.cc:740] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:44.972924 17125 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:44.982196 16469 consensus_queue.cc:260] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:44.983682 16469 raft_consensus.cc:3060] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:44.992655 22384 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:44.993876 22384 tablet_bootstrap.cc:492] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:44.994657 22384 ts_tablet_manager.cc:1403] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.338s	user 0.043s	sys 0.010s
I20260709 13:08:44.985242 16614 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 19.
I20260709 13:08:44.998522 17093 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:44.999490 22372 raft_consensus.cc:2804] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:45.000026 22372 raft_consensus.cc:697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 19 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:45.000910 22372 consensus_queue.cc:237] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:45.004813 16469 raft_consensus.cc:2468] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 19.
I20260709 13:08:45.015547 22384 raft_consensus.cc:359] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:45.016692 22403 tablet_copy_client.cc:323] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:08:45.027570 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet ad356f899692471d8abda66b7fe01205 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:08:45.026552 22384 raft_consensus.cc:740] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:45.032557 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet ad356f899692471d8abda66b7fe01205 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-ad356f899692471d8abda66b7fe01205
I20260709 13:08:45.042127 22168 raft_consensus.cc:993] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:45.042632 22168 raft_consensus.cc:1081] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:45.044420 16555 tablet_copy_source_session.cc:215] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.044625 16537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:45.045450 16537 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.045984 16537 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.047899 22403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad356f899692471d8abda66b7fe01205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.051440 22384 consensus_queue.cc:260] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:45.054733 22384 ts_tablet_manager.cc:1434] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.060s	user 0.002s	sys 0.005s
I20260709 13:08:45.056597 16364 catalog_manager.cc:5697] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 18 to 19, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 19 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:45.081727 16545 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:45.084430 22367 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:45.087531 16537 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:45.090791 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:45.091353 16614 raft_consensus.cc:3055] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:45.091626 16614 raft_consensus.cc:740] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:45.092363 16614 consensus_queue.cc:260] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:45.093461 16614 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.097226 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:45.097805 17125 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:45.102581 16537 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Requested vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:45.106840 16614 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:45.108116 17125 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:08:45.111064 16511 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:45.120697 22340 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:45.126322 22340 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:45.127286 22340 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:45.128094 17125 raft_consensus.cc:1217] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:08:45.145004 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-3274c86d23d641758f36e812f849be43 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:45.145543 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-3274c86d23d641758f36e812f849be43 on tablet 3274c86d23d641758f36e812f849be43 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:45.193809 16614 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:45.250753 22384 ts_tablet_manager.cc:933] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:08:45.249233 22403 tablet_copy_client.cc:806] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.262153 22403 tablet_copy_client.cc:670] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.257386 22395 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:08:45.264343 16463 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:45.271298 22403 tablet_copy_client.cc:538] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.270771 22341 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:45.316560 16364 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 15 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:45.382234 16464 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:45.388530 22372 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:45.413004 22384 tablet_copy_client.cc:323] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:08:45.432443 16611 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:45.440274 16614 raft_consensus.cc:1275] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:45.443967 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 15bb7626d64b480b9966ee39a4d8f1f9 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:08:45.444294 22403 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:45.444603 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 15bb7626d64b480b9966ee39a4d8f1f9 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-15bb7626d64b480b9966ee39a4d8f1f9
I20260709 13:08:45.456804 22396 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:45.457787 22396 tablet_bootstrap.cc:492] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:45.458468 22396 ts_tablet_manager.cc:1403] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.573s	user 0.033s	sys 0.014s
I20260709 13:08:45.460094 22414 consensus_queue.cc:1048] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:45.434721 22360 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:45.540436 16480 tablet_copy_source_session.cc:215] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.562723 22384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bb7626d64b480b9966ee39a4d8f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.546061 22396 raft_consensus.cc:359] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:45.563349 22396 raft_consensus.cc:740] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:45.564067 22396 consensus_queue.cc:260] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:45.566818 22396 ts_tablet_manager.cc:1434] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:08:45.580521 22384 tablet_copy_client.cc:806] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:45.591464 22384 tablet_copy_client.cc:670] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:45.609242 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.620734 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-ab144bc0671c46e6807f89d495e66473 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:08:45.624634 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-ab144bc0671c46e6807f89d495e66473 on tablet ab144bc0671c46e6807f89d495e66473 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:45.648180 22340 raft_consensus.cc:1064] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:45.654645 22384 tablet_copy_client.cc:538] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:45.673944 17125 raft_consensus.cc:1217] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:08:45.652675 22340 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:45.687000 16611 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.692643 22341 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:45.664635 22384 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:45.708392 17125 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.712457 22422 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:45.762252 17127 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.780599 22265 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:45.791623 16619 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.803791 16464 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:45.813086 22340 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:45.863724 22391 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:45.925129 22341 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:45.941315 17125 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:45.978320 16469 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.013074 16368 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.046589 22403 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.047737 22403 tablet_bootstrap.cc:492] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:46.048593 22403 ts_tablet_manager.cc:1403] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.605s	user 0.035s	sys 0.015s
I20260709 13:08:46.052667 16619 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.064138 22384 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:46.065169 22384 tablet_bootstrap.cc:492] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:46.065879 22384 ts_tablet_manager.cc:1403] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.401s	user 0.035s	sys 0.008s
I20260709 13:08:46.069165 22384 raft_consensus.cc:359] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:46.071422 22384 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:46.086532 22403 raft_consensus.cc:359] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:46.087527 22403 raft_consensus.cc:740] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:46.095806 22384 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:46.098515 22384 ts_tablet_manager.cc:1434] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:08:46.088230 22403 consensus_queue.cc:260] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:46.100361 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-15bb7626d64b480b9966ee39a4d8f1f9 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:08:46.100927 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-15bb7626d64b480b9966ee39a4d8f1f9 on tablet 15bb7626d64b480b9966ee39a4d8f1f9 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:46.110021 22403 ts_tablet_manager.cc:1434] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:08:46.111935 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-ad356f899692471d8abda66b7fe01205 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:46.112396 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-ad356f899692471d8abda66b7fe01205 on tablet ad356f899692471d8abda66b7fe01205 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:46.122913 17125 raft_consensus.cc:1217] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:08:46.176159 16537 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.186862 22168 raft_consensus.cc:1064] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:46.189694 22168 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.241422 17125 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:46.246116 22341 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:46.253628 16614 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:46.258082 22341 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.264025 17127 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.271858 17126 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:46.273634 22233 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.281610 22431 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:46.281775 16364 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 13 to 14, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 16 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.302009 16545 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:46.303313 16469 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:46.305094 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 3274c86d23d641758f36e812f849be43 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:46.312546 17125 raft_consensus.cc:1217] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:08:46.317859 22233 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.322742 22443 tablet_replica.cc:333] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:08:46.323153 16614 raft_consensus.cc:2955] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.330139 22443 raft_consensus.cc:2243] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.331125 22443 raft_consensus.cc:2272] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.365440 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3274c86d23d641758f36e812f849be43 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:46.389191 22443 ts_tablet_manager.cc:1916] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.421201 22168 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.423806 16469 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:46.432992 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 98380.3us
I20260709 13:08:46.442773 16364 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.452697 22233 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:46.459976 17127 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.507375 22265 raft_consensus.cc:1064] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:46.511021 22265 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.558686 16619 consensus_queue.cc:237] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.566555 16537 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.585062 16463 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:46.585263 17127 raft_consensus.cc:1275] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:46.586535 22445 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.587505 17125 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:46.591590 22445 consensus_queue.cc:1048] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:46.593657 22233 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.597421 22360 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:46.603197 16469 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.607908 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab144bc0671c46e6807f89d495e66473 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:46.614044 16463 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:46.616698 22265 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:46.627308 17125 raft_consensus.cc:2955] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.641803 16364 catalog_manager.cc:5697] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.657809 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet ab144bc0671c46e6807f89d495e66473 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:46.654685 16619 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:46.675282 22391 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:08:46.726440 22452 tablet_replica.cc:333] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:08:46.727790 22452 raft_consensus.cc:2243] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.728511 22452 raft_consensus.cc:2272] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.730121 22431 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.732542 17127 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.743685 16619 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.756359 22452 ts_tablet_manager.cc:1916] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.761612 22443 ts_tablet_manager.cc:1929] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 13:08:46.774255 22443 log.cc:1199] T 3274c86d23d641758f36e812f849be43 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/3274c86d23d641758f36e812f849be43
I20260709 13:08:46.765837 16367 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.781306 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 3274c86d23d641758f36e812f849be43 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:46.770671 16463 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.864814 16536 consensus_queue.cc:237] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.874377 17127 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:46.896078 22360 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:46.927408 21812 raft_consensus.cc:1064] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:46.930014 21812 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:46.941875 16469 raft_consensus.cc:1275] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:46.944623 22360 consensus_queue.cc:1048] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:46.974071 22421 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.976526 17126 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.988741 16469 raft_consensus.cc:2955] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:46.992311 16545 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:46.998723 22425 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:47.009052 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad356f899692471d8abda66b7fe01205 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.013419 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:47.029906 17125 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:47.030052 16364 catalog_manager.cc:5697] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 13 to 14, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 20 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:47.066227 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 94100.9us
I20260709 13:08:47.069861 16619 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:47.073151 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet ad356f899692471d8abda66b7fe01205 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:58162
I20260709 13:08:47.091002 22425 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:47.096102 22452 ts_tablet_manager.cc:1929] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:08:47.106837 22394 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:47.118709 22452 log.cc:1199] T ab144bc0671c46e6807f89d495e66473 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/ab144bc0671c46e6807f89d495e66473
I20260709 13:08:47.127012 22456 tablet_replica.cc:333] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:08:47.128134 22456 raft_consensus.cc:2243] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:47.131322 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet ab144bc0671c46e6807f89d495e66473 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:47.137074 22456 raft_consensus.cc:2272] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:47.151489 22456 ts_tablet_manager.cc:1916] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:47.167900 22425 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.175760 17125 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.212913 16545 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.225615 16364 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.236290 16619 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.267972 22456 ts_tablet_manager.cc:1929] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.13
I20260709 13:08:47.269255 22456 log.cc:1199] T ad356f899692471d8abda66b7fe01205 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/ad356f899692471d8abda66b7fe01205
I20260709 13:08:47.269626 16536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:47.270579 16536 raft_consensus.cc:606] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:08:47.271582 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet ad356f899692471d8abda66b7fe01205 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:47.280115 16536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:47.280861 16536 raft_consensus.cc:606] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:47.284492 16469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:08:47.285115 16469 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:47.286453 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:47.288865 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:47.383987 22395 raft_consensus.cc:993] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:47.384641 22395 raft_consensus.cc:1081] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:47.387816 16536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:08:47.388505 16536 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.389041 16536 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.570878 22391 raft_consensus.cc:993] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:47.571394 22391 raft_consensus.cc:1081] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:47.568028 16461 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.575531 16536 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:47.579486 22360 raft_consensus.cc:993] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:47.583092 22360 raft_consensus.cc:1081] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:47.584659 16463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57652
I20260709 13:08:47.585191 16463 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.585501 16463 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.586908 17125 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:47.588371 21812 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:47.592939 16463 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.595774 22395 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.598768 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:47.599375 17125 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.602715 16463 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:47.610939 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:47.612004 16544 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:47.613978 17125 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:47.610392 16545 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:47.612311 16544 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:47.631096 17125 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.626433 16544 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.635977 16434 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:47.641083 16544 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:47.643630 21812 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:47.633118 22425 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:47.717383 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:47.719802 16463 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:47.720220 16463 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:47.716982 16536 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:47.722544 17126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:08:47.723078 17126 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:47.723441 17126 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.726651 16544 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 17.
I20260709 13:08:47.746670 21812 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:47.750531 16536 raft_consensus.cc:2955] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.754060 17126 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.746942 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:47.745875 16463 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:47.756012 16618 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.760076 21812 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.782270 17126 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:47.783933 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:47.784749 16545 raft_consensus.cc:3055] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:47.785208 16545 raft_consensus.cc:740] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:47.787285 16463 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:47.793305 16545 consensus_queue.cc:260] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.803701 16463 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:08:47.805698 16545 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:47.808326 16511 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:47.837920 16364 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:47.846011 22460 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:47.859468 16545 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:47.861187 17090 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:47.870795 22437 raft_consensus.cc:2804] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:47.885564 22437 raft_consensus.cc:697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:47.886548 22437 consensus_queue.cc:237] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:47.884639 16367 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 16 to 17, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 17 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.896801 16618 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:08:47.903959 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 172901us
W20260709 13:08:47.913146 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 106385us
I20260709 13:08:47.915561 22460 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
W20260709 13:08:47.938444 22474 log.cc:927] Time spent T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:08:47.940811 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:47.953860 16463 raft_consensus.cc:3060] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:47.957571 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 145612us
I20260709 13:08:47.987257 16463 raft_consensus.cc:2468] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
I20260709 13:08:47.986403 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15bb7626d64b480b9966ee39a4d8f1f9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:47.994804 22460 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:48.087410 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 15bb7626d64b480b9966ee39a4d8f1f9 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58162
I20260709 13:08:48.107656 16367 catalog_manager.cc:5697] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 10 to 11, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 11 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:48.132153 22488 tablet_replica.cc:333] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:08:48.133534 22488 raft_consensus.cc:2243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:48.134518 22488 raft_consensus.cc:2272] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:48.139436 22488 ts_tablet_manager.cc:1916] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:48.140236 16367 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 13 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:48.191576 22488 ts_tablet_manager.cc:1929] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:08:48.192153 22488 log.cc:1199] T 15bb7626d64b480b9966ee39a4d8f1f9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/15bb7626d64b480b9966ee39a4d8f1f9
I20260709 13:08:48.193921 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 15bb7626d64b480b9966ee39a4d8f1f9 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:48.221576 17126 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:48.223119 22468 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:48.242743 16544 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:48.257592 22465 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:48.289999 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:48.402582 16544 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:48.404158 22462 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:48.420539 16469 raft_consensus.cc:1275] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:48.431704 16469 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:48.433410 22437 consensus_queue.cc:1048] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:48.433729 22480 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:48.525756 16619 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:48.539667 22460 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.310762 16614 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:08:49.354401 16583 consensus_peers.cc:597] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a96ace5bf484a4eb2288cc869f95f80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.366058 16536 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:49.368263 22484 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.374825 16463 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:49.377525 22475 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:49.391824 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.581473 22502 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:08:49.632300 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 76322.6us
I20260709 13:08:49.628590 16461 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:08:49.649427 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 70700.5us
W20260709 13:08:49.657003 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 78876us
I20260709 13:08:49.677831 16469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:08:49.678455 16469 raft_consensus.cc:606] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
W20260709 13:08:49.704030 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 93576.6us
I20260709 13:08:49.709146 16536 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:49.710532 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:49.711114 16544 raft_consensus.cc:606] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:49.712631 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:49.715368 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:49.711767 16361 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:49.721585 16611 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:49.774641 16536 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:49.774672 16583 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 630ca4cf8bd64907bf8c82149ab5afb9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.775451 16461 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:49.776315 22518 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:49.777544 22502 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:49.824222 22518 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:49.829761 16461 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:49.830051 16536 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:49.845914 16461 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:08:49.864324 16434 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11c1a9d5e3dd45d7a937a9954de478cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.869305 16611 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:49.873045 22517 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:49.919621 22527 ts_tablet_manager.cc:933] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:49.941823 16544 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:49.947316 22505 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:49.979010 22469 raft_consensus.cc:993] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:49.979534 22469 raft_consensus.cc:1081] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:49.981369 16536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:08:49.981921 16536 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:49.982283 16536 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.004307 22517 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.007817 22460 raft_consensus.cc:993] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:50.008374 22460 raft_consensus.cc:1081] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:50.008646 16544 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.010464 16611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:08:50.011077 16611 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:50.011463 16611 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.019591 16611 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.035480 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:50.036178 17125 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.036757 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "486137446c7c411e8a8ec3d1dd300579" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:50.037468 16544 raft_consensus.cc:3055] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:50.037768 16544 raft_consensus.cc:740] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:50.038558 16544 consensus_queue.cc:260] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.039760 16544 raft_consensus.cc:3060] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:50.050232 16614 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.053428 16364 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.056346 17125 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:50.056747 16619 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:50.057822 16583 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:50.058746 22504 raft_consensus.cc:2804] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:50.059293 22504 raft_consensus.cc:697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:50.060135 16544 raft_consensus.cc:2468] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:08:50.060272 22504 consensus_queue.cc:237] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.059247 16611 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:50.087918 22527 tablet_copy_client.cc:323] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:08:50.075958 16536 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.095839 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:50.096688 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 4a96ace5bf484a4eb2288cc869f95f80 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:08:50.097309 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 4a96ace5bf484a4eb2288cc869f95f80 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-4a96ace5bf484a4eb2288cc869f95f80
I20260709 13:08:50.096517 16469 raft_consensus.cc:3055] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:50.099005 16469 raft_consensus.cc:740] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:50.099828 16469 consensus_queue.cc:260] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.101032 16469 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:50.104219 16361 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.106112 16536 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:50.109230 16628 tablet_copy_source_session.cc:215] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.117827 22527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96ace5bf484a4eb2288cc869f95f80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.121129 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:50.121788 17125 raft_consensus.cc:3060] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:50.133874 16583 consensus_peers.cc:597] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebc26e5c94524ffe84fdc3e560019f4f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:50.134519 16461 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:50.139122 22518 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.137286 16364 catalog_manager.cc:5697] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 13 to 14, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.155475 16544 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:50.158996 22518 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:50.181926 16469 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:08:50.182816 17125 raft_consensus.cc:2468] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:08:50.183485 16511 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05; no voters: 
I20260709 13:08:50.184340 22479 raft_consensus.cc:2804] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:50.184876 22479 raft_consensus.cc:697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:50.185746 22479 consensus_queue.cc:237] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:50.188511 22518 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.206387 16469 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.213799 22527 tablet_copy_client.cc:806] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.229866 22527 tablet_copy_client.cc:670] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.225049 16364 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.234086 22527 tablet_copy_client.cc:538] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.239905 22537 ts_tablet_manager.cc:933] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:50.276050 16545 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:50.303874 22527 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:50.303853 16367 catalog_manager.cc:5697] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 16 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 17 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.308347 22537 tablet_copy_client.cc:323] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:08:50.312584 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 630ca4cf8bd64907bf8c82149ab5afb9 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:08:50.314845 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 630ca4cf8bd64907bf8c82149ab5afb9 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-630ca4cf8bd64907bf8c82149ab5afb9
I20260709 13:08:50.328603 16628 tablet_copy_source_session.cc:215] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.343429 22537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630ca4cf8bd64907bf8c82149ab5afb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.400167 22537 tablet_copy_client.cc:806] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.400952 22537 tablet_copy_client.cc:670] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.411381 22537 tablet_copy_client.cc:538] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.455806 22540 ts_tablet_manager.cc:933] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:08:50.471310 22540 tablet_copy_client.cc:323] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:08:50.473258 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 11c1a9d5e3dd45d7a937a9954de478cc from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:08:50.473865 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 11c1a9d5e3dd45d7a937a9954de478cc from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-11c1a9d5e3dd45d7a937a9954de478cc
I20260709 13:08:50.487936 16480 tablet_copy_source_session.cc:215] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:50.503252 22540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11c1a9d5e3dd45d7a937a9954de478cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:50.521311 17125 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:50.524644 22518 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:50.525408 22527 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:50.529712 22527 tablet_bootstrap.cc:492] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:50.533381 22527 ts_tablet_manager.cc:1403] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.230s	user 0.039s	sys 0.002s
I20260709 13:08:50.540529 22537 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:50.560169 22527 raft_consensus.cc:359] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:50.561106 22527 raft_consensus.cc:740] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:50.561745 22527 consensus_queue.cc:260] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:50.564106 22527 ts_tablet_manager.cc:1434] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 13:08:50.583449 22540 tablet_copy_client.cc:806] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:50.585377 22540 tablet_copy_client.cc:670] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:50.589570 22540 tablet_copy_client.cc:538] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:50.612511 22540 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:50.618582 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-4a96ace5bf484a4eb2288cc869f95f80 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:08:50.723368 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-4a96ace5bf484a4eb2288cc869f95f80 on tablet 4a96ace5bf484a4eb2288cc869f95f80 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:50.623217 16545 raft_consensus.cc:1275] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:50.718302 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:50.718127 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 64238.1us
I20260709 13:08:50.740020 22518 consensus_queue.cc:1048] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:50.763583 17125 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:50.798846 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 145158us
I20260709 13:08:50.811734 22545 ts_tablet_manager.cc:933] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:50.819977 16469 raft_consensus.cc:1275] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:50.827296 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 76892us
I20260709 13:08:50.795610 22513 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:08:50.838337 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46477.3us
I20260709 13:08:50.845247 17127 raft_consensus.cc:1217] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:08:50.857740 22545 tablet_copy_client.cc:323] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
W20260709 13:08:50.916160 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 79939.7us
I20260709 13:08:50.945182 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet ebc26e5c94524ffe84fdc3e560019f4f from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:08:50.954316 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet ebc26e5c94524ffe84fdc3e560019f4f from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-ebc26e5c94524ffe84fdc3e560019f4f
I20260709 13:08:51.004951 16628 tablet_copy_source_session.cc:215] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:51.027223 22545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebc26e5c94524ffe84fdc3e560019f4f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:51.043267 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 71737.4us
W20260709 13:08:51.051405 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 84976.8us
W20260709 13:08:51.048785 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 202263us
W20260709 13:08:51.056560 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 121039us
W20260709 13:08:51.139062 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 208536us
W20260709 13:08:51.164218 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 94735.7us
I20260709 13:08:51.143991 22554 consensus_queue.cc:1048] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:08:51.270244 22545 tablet_copy_client.cc:806] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:51.270886 22545 tablet_copy_client.cc:670] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:51.272590 22580 raft_consensus.cc:1064] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:51.275718 22545 tablet_copy_client.cc:538] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:51.275347 22580 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:51.322461 17125 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:51.323833 22511 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:51.334208 16463 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:51.335048 22545 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:51.336233 22511 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:51.350668 16536 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:51.411337 22575 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:08:51.426774 22537 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.433861 22537 tablet_bootstrap.cc:492] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:51.456149 22537 ts_tablet_manager.cc:1403] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.942s	user 0.055s	sys 0.009s
I20260709 13:08:51.501151 22564 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.509523 16461 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.496376 22537 raft_consensus.cc:359] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.542359 22537 raft_consensus.cc:740] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:51.543201 22537 consensus_queue.cc:260] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.551237 22537 ts_tablet_manager.cc:1434] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.000s
W20260709 13:08:51.560525 22540 log.cc:927] Time spent T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 13:08:51.565366 16536 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.573879 17125 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.584007 16361 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.589015 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-630ca4cf8bd64907bf8c82149ab5afb9 received from {username='slave'} at 127.0.0.1:42898
I20260709 13:08:51.589519 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-630ca4cf8bd64907bf8c82149ab5afb9 on tablet 630ca4cf8bd64907bf8c82149ab5afb9 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:51.592643 22540 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.593703 22540 tablet_bootstrap.cc:492] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:51.594470 22540 ts_tablet_manager.cc:1403] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.982s	user 0.043s	sys 0.027s
I20260709 13:08:51.609800 22540 raft_consensus.cc:359] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.610749 22540 raft_consensus.cc:740] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:51.611490 22540 consensus_queue.cc:260] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.614665 22540 ts_tablet_manager.cc:1434] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:51.621654 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-11c1a9d5e3dd45d7a937a9954de478cc received from {username='slave'} at 127.0.0.1:50946
I20260709 13:08:51.622164 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-11c1a9d5e3dd45d7a937a9954de478cc on tablet 11c1a9d5e3dd45d7a937a9954de478cc with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:51.702256 22545 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:51.713590 22545 tablet_bootstrap.cc:492] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:51.745790 22545 ts_tablet_manager.cc:1403] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.411s	user 0.043s	sys 0.004s
I20260709 13:08:51.788877 16615 consensus_queue.cc:237] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:51.796043 17125 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:51.797626 22564 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:51.801117 22545 raft_consensus.cc:359] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.802433 16536 raft_consensus.cc:1275] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:51.805760 22504 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.807559 17127 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.838541 22564 consensus_queue.cc:1048] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:51.843916 16536 raft_consensus.cc:2955] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.849740 17125 raft_consensus.cc:1217] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:08:51.864904 22545 raft_consensus.cc:740] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:51.865888 22545 consensus_queue.cc:260] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:51.869212 22545 ts_tablet_manager.cc:1434] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 13:08:51.871716 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:51.884389 16364 catalog_manager.cc:5697] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 11 to 12, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:51.894706 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-ebc26e5c94524ffe84fdc3e560019f4f received from {username='slave'} at 127.0.0.1:42898
I20260709 13:08:51.895318 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-ebc26e5c94524ffe84fdc3e560019f4f on tablet ebc26e5c94524ffe84fdc3e560019f4f with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:51.899639 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a96ace5bf484a4eb2288cc869f95f80 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:51.924034 17127 raft_consensus.cc:1217] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 13:08:51.946166 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a96ace5bf484a4eb2288cc869f95f80 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:51.967136 22595 tablet_replica.cc:333] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:08:51.968446 22595 raft_consensus.cc:2243] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:51.991102 22595 raft_consensus.cc:2272] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:52.029568 22595 ts_tablet_manager.cc:1916] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:52.029637 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d214c667f1547569798ec88932945a2"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50106
I20260709 13:08:52.041217 16615 raft_consensus.cc:606] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:52.044598 16536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:52.045236 16536 raft_consensus.cc:606] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:52.049605 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:52.051450 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:52.086113 17125 raft_consensus.cc:1217] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:08:52.277599 22595 ts_tablet_manager.cc:1929] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:08:52.278242 22595 log.cc:1199] T 4a96ace5bf484a4eb2288cc869f95f80 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/4a96ace5bf484a4eb2288cc869f95f80
I20260709 13:08:52.294214 22564 raft_consensus.cc:1064] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:52.296901 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet 4a96ace5bf484a4eb2288cc869f95f80 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:52.298681 22564 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:52.358217 17125 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:52.360473 16536 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:52.360427 22511 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:52.362244 22504 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:52.362649 16470 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:52.364197 22504 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:52.403224 22425 raft_consensus.cc:1064] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:52.405550 22425 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:52.456779 22597 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:52.460662 17125 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:52.516948 16536 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:52.518915 22601 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:52.526576 17126 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:52.535579 22601 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:52.539716 22575 raft_consensus.cc:993] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:52.540894 22511 raft_consensus.cc:1081] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:52.550813 22564 raft_consensus.cc:1064] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:52.554853 16538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d214c667f1547569798ec88932945a2"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50264
I20260709 13:08:52.555433 16538 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:52.555774 16538 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:52.553411 22564 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:52.582489 16538 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:52.588801 16536 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:52.593026 16538 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:52.597214 16368 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:52.622215 16615 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:52.647053 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:52.647763 16611 raft_consensus.cc:3055] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:52.648138 16611 raft_consensus.cc:740] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:52.659368 16611 consensus_queue.cc:260] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:52.698881 16469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:52.699720 16469 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:52.708559 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 71011.4us
W20260709 13:08:52.709859 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 123438us
I20260709 13:08:52.718082 16611 raft_consensus.cc:3060] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:52.719730 22598 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:08:52.775157 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 152134us
I20260709 13:08:52.789461 16469 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:52.790004 22576 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:52.843500 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 198941us
W20260709 13:08:52.851502 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 141579us
I20260709 13:08:52.856567 16611 raft_consensus.cc:2468] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:08:52.885593 22569 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:08:52.960676 16537 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:52.961994 16469 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:08:52.964998 22605 log.cc:927] Time spent T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:08:52.972033 16537 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:52.974272 22511 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:08:52.983078 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 80896.3us
I20260709 13:08:52.986680 22612 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:53.007217 17123 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:53.074903 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:53.073359 22617 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:08:53.096998 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 192853us
I20260709 13:08:53.101222 16367 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.122083 17125 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.091523 16470 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:53.148272 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 126358us
I20260709 13:08:53.224679 16615 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:53.227137 22634 log.cc:927] Time spent T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:08:53.264635 22511 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.284016 16536 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.304021 16470 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.320585 16511 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:08:53.323200 22638 raft_consensus.cc:2804] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.323807 22638 raft_consensus.cc:697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:53.324911 22638 consensus_queue.cc:237] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:08:53.378122 17121 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.693584 16361 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.702826 16361 catalog_manager.cc:5697] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 12 to 13, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:53.795806 16619 consensus_queue.cc:237] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:53.807933 16614 consensus_queue.cc:237] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:53.822023 16470 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:53.823223 17125 raft_consensus.cc:1275] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:53.827853 16537 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:53.827955 17127 raft_consensus.cc:1275] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:53.830318 22575 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:53.832731 22575 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:53.836309 22504 consensus_queue.cc:1048] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:53.837170 22619 consensus_queue.cc:1048] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:53.850898 22504 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.873338 16464 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:53.875324 22614 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:53.875828 16537 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.876093 22619 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.885457 17127 raft_consensus.cc:2955] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.882872 16470 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:53.903111 16619 raft_consensus.cc:1275] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:08:53.905128 22614 consensus_queue.cc:1048] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:53.958451 17126 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:53.959841 16619 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:53.967525 22576 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:53.976737 22618 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.981046 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 630ca4cf8bd64907bf8c82149ab5afb9 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:53.986503 16470 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:53.993198 17126 raft_consensus.cc:2955] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:54.016013 16367 catalog_manager.cc:5697] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 10 to 11, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:54.017848 16614 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:54.034073 22610 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:54.039564 17125 raft_consensus.cc:2955] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:54.127563 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11c1a9d5e3dd45d7a937a9954de478cc with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:54.154479 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ebc26e5c94524ffe84fdc3e560019f4f with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:54.172600 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 172555us
I20260709 13:08:54.217892 16364 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 10 to 11, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 13 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:54.220153 16364 catalog_manager.cc:5697] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 13 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:54.235824 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:54.243292 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet ebc26e5c94524ffe84fdc3e560019f4f with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:54.250190 22655 tablet_replica.cc:333] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:08:54.284442 22655 raft_consensus.cc:2243] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.285631 22655 raft_consensus.cc:2272] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.289134 16527 tablet_service.cc:1558] Processing DeleteTablet for tablet 630ca4cf8bd64907bf8c82149ab5afb9 with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:54.289335 16531 tablet_service.cc:1558] Processing DeleteTablet for tablet 11c1a9d5e3dd45d7a937a9954de478cc with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:47556
I20260709 13:08:54.291126 22655 ts_tablet_manager.cc:1916] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.324747 22655 ts_tablet_manager.cc:1929] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:08:54.325346 22655 log.cc:1199] T ebc26e5c94524ffe84fdc3e560019f4f P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/ebc26e5c94524ffe84fdc3e560019f4f
I20260709 13:08:54.327270 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet ebc26e5c94524ffe84fdc3e560019f4f (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:54.357908 22656 tablet_replica.cc:333] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:08:54.441251 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:54.442179 16544 raft_consensus.cc:606] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Received request to transfer leadership to TS 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:08:54.549052 22614 raft_consensus.cc:993] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:54.549585 22614 raft_consensus.cc:1081] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:08:54.593192 16544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:54.596985 16470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57652
I20260709 13:08:54.597656 16470 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.598549 16470 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.631094 16470 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:54.594913 16544 raft_consensus.cc:606] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:08:54.633420 16470 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:54.638324 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:54.638150 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:54.638857 17125 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.639674 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:54.640440 22656 raft_consensus.cc:2243] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.641525 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:54.641803 22656 raft_consensus.cc:2272] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.638917 16544 raft_consensus.cc:3055] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:54.642562 16544 raft_consensus.cc:740] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:54.643405 16544 consensus_queue.cc:260] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:54.644465 16544 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:54.645732 22656 ts_tablet_manager.cc:1916] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.647565 17125 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:54.649151 16434 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:54.650028 22610 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:54.650520 22610 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:54.651376 22610 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:54.670575 16544 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 14.
I20260709 13:08:54.685545 22656 ts_tablet_manager.cc:1929] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:08:54.687330 22656 log.cc:1199] T 630ca4cf8bd64907bf8c82149ab5afb9 P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/630ca4cf8bd64907bf8c82149ab5afb9
I20260709 13:08:54.689590 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 630ca4cf8bd64907bf8c82149ab5afb9 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:54.690770 22656 tablet_replica.cc:333] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:08:54.691977 22656 raft_consensus.cc:2243] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:54.691241 16364 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 13 to 14, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.692972 22656 raft_consensus.cc:2272] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:54.696419 22656 ts_tablet_manager.cc:1916] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:54.733062 22656 ts_tablet_manager.cc:1929] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 13:08:54.733709 22656 log.cc:1199] T 11c1a9d5e3dd45d7a937a9954de478cc P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/11c1a9d5e3dd45d7a937a9954de478cc
I20260709 13:08:54.735256 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 11c1a9d5e3dd45d7a937a9954de478cc (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:08:54.980485 22629 raft_consensus.cc:993] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:54.981246 22629 raft_consensus.cc:1081] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:08:54.985215 17126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53652
I20260709 13:08:54.985890 17126 raft_consensus.cc:493] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:54.986315 17126 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.003206 17126 raft_consensus.cc:515] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:55.006496 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:55.007094 16544 raft_consensus.cc:3055] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:55.007411 16544 raft_consensus.cc:740] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:55.007508 17126 leader_election.cc:290] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:08:55.009199 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "866175a9d3d74ca692d4573f642d17a9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:08:55.008184 16544 consensus_queue.cc:260] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:55.026782 16619 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.027216 16544 raft_consensus.cc:3060] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.036571 16544 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:55.044349 16619 raft_consensus.cc:2468] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:08:55.047992 17093 leader_election.cc:304] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:55.052546 22657 raft_consensus.cc:2804] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:55.053164 22657 raft_consensus.cc:697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:08:55.054174 22657 consensus_queue.cc:237] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:55.091104 16364 catalog_manager.cc:5697] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 17, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.159291 16544 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:55.161660 22618 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:55.247340 17126 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:55.251987 22618 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.500151 16619 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:55.512619 22594 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.560719 16544 raft_consensus.cc:1275] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:55.562384 22594 consensus_queue.cc:1048] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.642740 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:55.698992 16544 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:08:55.738094 16509 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 859be0294f7f4761b91b80c75b983562. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.742862 16470 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:55.744829 16619 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:55.744602 22554 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:55.747503 22554 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:55.781002 22629 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.795047 16470 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.813786 16544 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:55.825922 16364 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:55.848067 16509 consensus_peers.cc:597] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b92bb40598544d8591903d884ef151b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.851001 16619 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:55.856644 16619 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.856662 16470 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:55.862311 22674 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:55.868340 22615 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:55.881129 22615 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.882652 16615 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.886581 16461 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:55.902878 16470 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:55.958767 16615 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:55.959204 16434 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45e6d6887bf149f9ad8ed2c85503056c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:55.961367 16545 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:08:55.963809 22665 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:55.965688 22665 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:55.984565 16367 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index -1 to 8, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 11 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.026978 22610 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.038622 16615 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.080386 16544 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.109436 16538 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:56.111681 16368 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.133520 16470 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:56.134652 16509 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 245c53b961134a578f08f960e84a789a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:56.134768 16615 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:56.137729 22674 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:56.139712 22674 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:56.185627 22629 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.196578 16615 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.205070 16470 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:08:56.277087 16368 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 10, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.345528 22689 ts_tablet_manager.cc:933] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:56.347977 22689 tablet_copy_client.cc:323] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:08:56.350417 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 859be0294f7f4761b91b80c75b983562 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:08:56.351025 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 859be0294f7f4761b91b80c75b983562 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-859be0294f7f4761b91b80c75b983562
I20260709 13:08:56.362349 16555 tablet_copy_source_session.cc:215] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.416172 22689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859be0294f7f4761b91b80c75b983562. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.489172 22691 ts_tablet_manager.cc:933] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:56.513293 22691 tablet_copy_client.cc:323] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:08:56.515219 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet b92bb40598544d8591903d884ef151b0 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:08:56.515808 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet b92bb40598544d8591903d884ef151b0 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-b92bb40598544d8591903d884ef151b0
I20260709 13:08:56.524195 16555 tablet_copy_source_session.cc:215] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.536808 22691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b92bb40598544d8591903d884ef151b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.550897 22693 ts_tablet_manager.cc:933] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:08:56.568722 22689 tablet_copy_client.cc:806] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.569525 22689 tablet_copy_client.cc:670] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.588187 22689 tablet_copy_client.cc:538] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.623030 22693 tablet_copy_client.cc:323] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:08:56.630862 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 45e6d6887bf149f9ad8ed2c85503056c from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:08:56.631553 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 45e6d6887bf149f9ad8ed2c85503056c from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-45e6d6887bf149f9ad8ed2c85503056c
I20260709 13:08:56.642076 22691 tablet_copy_client.cc:806] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.642617 16480 tablet_copy_source_session.cc:215] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.651974 22689 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:56.642724 22691 tablet_copy_client.cc:670] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.670115 22691 tablet_copy_client.cc:538] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.670508 22693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45e6d6887bf149f9ad8ed2c85503056c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.703079 22691 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:56.751838 22695 ts_tablet_manager.cc:933] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:08:56.758419 22693 tablet_copy_client.cc:806] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.759131 22693 tablet_copy_client.cc:670] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.769665 22689 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:56.770974 22689 tablet_bootstrap.cc:492] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
W20260709 13:08:56.769641 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 56767us
I20260709 13:08:56.782277 22689 ts_tablet_manager.cc:1403] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.131s	user 0.042s	sys 0.005s
I20260709 13:08:56.783007 22693 tablet_copy_client.cc:538] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.789600 22695 tablet_copy_client.cc:323] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.66:37367
I20260709 13:08:56.791714 16555 tablet_copy_service.cc:140] P 59746530bb6d4726893c108602ffac27: Received BeginTabletCopySession request for tablet 245c53b961134a578f08f960e84a789a from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:37072)
I20260709 13:08:56.795377 16555 tablet_copy_service.cc:161] P 59746530bb6d4726893c108602ffac27: Beginning new tablet copy session on tablet 245c53b961134a578f08f960e84a789a from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:37072: session id = 98881185daee4f13b69385e36026216c-245c53b961134a578f08f960e84a789a
I20260709 13:08:56.805102 22693 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:56.811990 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:56.814225 16555 tablet_copy_source_session.cc:215] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:56.810130 22689 raft_consensus.cc:359] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:56.817464 22695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 245c53b961134a578f08f960e84a789a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:56.834547 22689 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:56.860910 22689 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:56.863144 22689 ts_tablet_manager.cc:1434] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:08:56.864877 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-859be0294f7f4761b91b80c75b983562 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:56.865352 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-859be0294f7f4761b91b80c75b983562 on tablet 859be0294f7f4761b91b80c75b983562 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:56.919018 16470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:08:56.919658 16470 raft_consensus.cc:606] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Received request to transfer leadership to TS 59746530bb6d4726893c108602ffac27
I20260709 13:08:56.921563 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:56.923547 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:56.931192 22691 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:56.932135 22691 tablet_bootstrap.cc:492] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:56.932909 22691 ts_tablet_manager.cc:1403] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.230s	user 0.038s	sys 0.001s
I20260709 13:08:56.940285 22695 tablet_copy_client.cc:806] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:56.941043 22695 tablet_copy_client.cc:670] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:56.965807 22695 tablet_copy_client.cc:538] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:56.953239 22691 raft_consensus.cc:359] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:56.968343 22691 raft_consensus.cc:740] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:56.969094 22691 consensus_queue.cc:260] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:56.980011 22691 ts_tablet_manager.cc:1434] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 13:08:56.986756 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-b92bb40598544d8591903d884ef151b0 received from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:56.987181 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-b92bb40598544d8591903d884ef151b0 on tablet b92bb40598544d8591903d884ef151b0 with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:56.987066 17126 raft_consensus.cc:1217] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:08:57.036257 22695 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:08:57.052747 22693 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.061821 22693 tablet_bootstrap.cc:492] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:57.062572 22693 ts_tablet_manager.cc:1403] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.258s	user 0.035s	sys 0.011s
I20260709 13:08:57.074030 22693 raft_consensus.cc:359] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:57.074915 22693 raft_consensus.cc:740] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:57.075611 22693 consensus_queue.cc:260] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:57.084601 22693 ts_tablet_manager.cc:1434] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:08:57.089978 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-45e6d6887bf149f9ad8ed2c85503056c received from {username='slave'} at 127.0.0.1:50946
I20260709 13:08:57.090472 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-45e6d6887bf149f9ad8ed2c85503056c on tablet 45e6d6887bf149f9ad8ed2c85503056c with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:57.160905 22685 raft_consensus.cc:993] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:57.161439 22685 raft_consensus.cc:1081] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Signalling peer 59746530bb6d4726893c108602ffac27 to start an election
I20260709 13:08:57.169342 16544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8"
dest_uuid: "59746530bb6d4726893c108602ffac27"
 from {username='slave'} at 127.0.0.1:50270
I20260709 13:08:57.169965 16544 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:57.170351 16544 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.181456 16544 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:57.183976 16461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:57.184557 16461 raft_consensus.cc:3055] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:57.184881 16461 raft_consensus.cc:740] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:08:57.185995 16461 consensus_queue.cc:260] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:57.187242 16461 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.207829 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:57.208524 17125 raft_consensus.cc:3060] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.226466 17125 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:08:57.227968 16509 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:57.228888 22629 raft_consensus.cc:2804] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:57.229360 22629 raft_consensus.cc:697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:57.230229 22629 consensus_queue.cc:237] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:57.235272 16544 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:57.238421 16461 raft_consensus.cc:2468] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:08:57.261427 17125 raft_consensus.cc:1217] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:08:57.266183 16368 catalog_manager.cc:5697] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 17 to 18, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 18 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:57.277197 22695 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:57.278213 22695 tablet_bootstrap.cc:492] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:08:57.278949 22695 ts_tablet_manager.cc:1403] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.247s	user 0.031s	sys 0.012s
I20260709 13:08:57.294430 22695 raft_consensus.cc:359] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:57.307156 22695 raft_consensus.cc:740] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:08:57.307971 22695 consensus_queue.cc:260] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:08:57.319223 22695 ts_tablet_manager.cc:1434] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.001s
I20260709 13:08:57.324592 16555 tablet_copy_service.cc:342] P 59746530bb6d4726893c108602ffac27: Request end of tablet copy session 98881185daee4f13b69385e36026216c-245c53b961134a578f08f960e84a789a received from {username='slave'} at 127.0.0.1:37072
I20260709 13:08:57.325018 16555 tablet_copy_service.cc:434] P 59746530bb6d4726893c108602ffac27: ending tablet copy session 98881185daee4f13b69385e36026216c-245c53b961134a578f08f960e84a789a on tablet 245c53b961134a578f08f960e84a789a with peer 98881185daee4f13b69385e36026216c
I20260709 13:08:57.389986 22554 raft_consensus.cc:1064] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:57.392525 22554 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:57.398352 17126 raft_consensus.cc:1217] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:08:57.447187 17126 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:57.449672 22629 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:57.463270 16615 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:57.465149 22700 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:57.476085 16461 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:57.478744 22554 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:57.494758 22700 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:57.509617 16614 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:57.526122 16461 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:57.547291 16364 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 8 to 9, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:57.544272 17125 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:57.602625 17125 raft_consensus.cc:1217] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
W20260709 13:08:57.676529 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 47294.4us
I20260709 13:08:57.684301 16544 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:57.793246 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 146840us
W20260709 13:08:57.815704 22708 log.cc:927] Time spent T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
W20260709 13:08:57.823550 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 195771us
I20260709 13:08:57.866636 16470 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:57.868255 22712 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:57.922230 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 259170us
I20260709 13:08:57.924674 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:57.920596 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 83963.4us
W20260709 13:08:57.973192 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 54071.5us
I20260709 13:08:57.996228 16615 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:58.218286 17125 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:58.245383 17126 raft_consensus.cc:1275] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:58.246357 22712 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:58.276432 22712 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:58.278636 22712 raft_consensus.cc:1064] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
W20260709 13:08:58.279829 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 168121us
W20260709 13:08:58.292636 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 271924us
W20260709 13:08:58.366096 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 146325us
W20260709 13:08:58.379848 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 393353us
W20260709 13:08:58.402587 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 126531us
W20260709 13:08:58.406770 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 184013us
W20260709 13:08:58.417063 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 46920.8us
I20260709 13:08:58.417721 22745 raft_consensus.cc:1064] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:08:58.457480 22713 consensus_queue.cc:1048] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:58.470821 22745 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:58.476147 22712 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:08:58.564689 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 13:08:58.572703 17124 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:58.593377 22741 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:58.594686 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 49217.9us
I20260709 13:08:58.644944 22665 raft_consensus.cc:1064] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
W20260709 13:08:58.649004 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 49433.8us
I20260709 13:08:58.651772 22665 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:58.658313 16367 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 9 to 10, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New cstate: current_term: 11 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:58.688319 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 66263.1us
I20260709 13:08:58.693159 17124 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.708695 22741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:47556 (request call id 10) took 1016 ms. Trace:
I20260709 13:08:58.709304 22741 rpcz_store.cc:276] 0709 13:08:57.682040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.682186 (+   146us) service_pool.cc:224] Handling call
0709 13:08:57.687667 (+  5481us) log.cc:844] Serialized 501 byte log entry
0709 13:08:58.697499 (+1009832us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115235,"raft.run_cpu_time_us":1232,"raft.run_wall_time_us":1231}
I20260709 13:08:58.711519 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b92bb40598544d8591903d884ef151b0 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:58.714869 17127 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 LEARNER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:58.716506 22554 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:58.725248 17127 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:58.737598 16619 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:58.738315 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 48821.4us
I20260709 13:08:58.740732 16545 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:58.747845 16619 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.750507 16619 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:58.742650 22700 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:08:58.753232 16470 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:58.762992 16619 raft_consensus.cc:2955] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:58.740306 22724 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:58.792395 16463 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:58.781463 22712 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:58.803263 22737 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:58.804982 22721 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:58.787868 22700 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:58.826668 22763 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:08:58.852164 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 74844.3us
W20260709 13:08:58.901614 22766 log.cc:927] Time spent T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:58.906081 22769 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:08:58.947057 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 154771us
I20260709 13:08:59.028409 22735 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:08:59.029217 22735 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } attrs { replace: true } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.033453 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:08:59.004810 22743 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:59.037317 22771 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:08:59.191583 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 100653us
W20260709 13:08:59.202853 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 106828us
I20260709 13:08:59.203830 22741 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.209820 22700 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.237763 22735 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:59.250896 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:08:59.261658 16613 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.284368 16433 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:08:59.285261 22685 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:59.292435 17124 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.212594 16611 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.310379 16463 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.371289 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:59.409783 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:08:59.412937 16613 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.416514 16542 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.469885 17127 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.488444 16367 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:59.532347 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 169940us
W20260709 13:08:59.538216 16434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 46477.2us
I20260709 13:08:59.555831 16461 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.604570 17127 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:08:59.638411 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 74835.8us
I20260709 13:08:59.659384 16545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "59746530bb6d4726893c108602ffac27"
mode: GRACEFUL
new_leader_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:33132
I20260709 13:08:59.660091 16545 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Received request to transfer leadership to TS 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:08:59.662256 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:59.666345 16460 tablet_service.cc:1558] Processing DeleteTablet for tablet b92bb40598544d8591903d884ef151b0 with delete_type TABLET_DATA_TOMBSTONED (TS 6f34f184d0dd4382bee8790b4c077d05 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:57208
I20260709 13:08:59.676623 16363 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.682375 16463 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.687942 17127 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:59.689455 22743 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.690095 16363 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 10 to 11, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.697131 22716 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.698920 17127 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.720037 16611 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:59.696811 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:59.730408 22685 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.739645 16614 raft_consensus.cc:2955] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.741307 16355 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45e6d6887bf149f9ad8ed2c85503056c with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:59.784756 22785 tablet_replica.cc:333] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:08:59.786324 22785 raft_consensus.cc:2243] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:59.815102 16352 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:59.812808 22785 raft_consensus.cc:2272] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:59.817010 16355 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 45e6d6887bf149f9ad8ed2c85503056c with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER failed with leader 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 11 but the committed config has opid_index of 12
I20260709 13:08:59.825007 16368 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 11 to 12, VOTER 59746530bb6d4726893c108602ffac27 (127.14.246.66) evicted. New cstate: current_term: 12 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.829703 22785 ts_tablet_manager.cc:1916] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:59.833853 22745 raft_consensus.cc:993] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: : Instructing follower 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:59.834358 22745 raft_consensus.cc:1081] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Signalling peer 8e851f11d27b4a83aa395e05c4be6808 to start an election
I20260709 13:08:59.837324 16611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
 from {username='slave'} at 127.0.0.1:41796
I20260709 13:08:59.837906 16611 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:59.838275 16611 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:59.848330 16352 catalog_manager.cc:4755] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): ChangeConfig:REMOVE_PEER RPC failed for tablet 859be0294f7f4761b91b80c75b983562: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:59.854521 16545 consensus_queue.cc:237] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.859638 17121 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:59.861235 22768 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.867048 16611 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.873471 16461 raft_consensus.cc:1275] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:59.875722 22768 consensus_queue.cc:1048] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:59.882413 22700 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.885929 16461 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.884681 17121 raft_consensus.cc:2955] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:08:59.902668 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:08:59.903316 16463 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.905161 16611 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:08:59.905916 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:08:59.906517 16545 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:59.906793 16545 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:08:59.907548 16545 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.908278 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:08:59.908818 16545 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.908843 17127 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:59.935449 17127 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:59.938885 16463 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:59.940135 16585 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:08:59.941076 16545 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:08:59.945063 16363 catalog_manager.cc:5697] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 11 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:59.963014 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 245c53b961134a578f08f960e84a789a with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58162
I20260709 13:08:59.941146 22742 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:59.965760 22742 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:08:59.966287 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 245c53b961134a578f08f960e84a789a with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:59.966733 22742 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:08:59.985585 16527 tablet_service.cc:1558] Processing DeleteTablet for tablet 45e6d6887bf149f9ad8ed2c85503056c with delete_type TABLET_DATA_TOMBSTONED (TS 59746530bb6d4726893c108602ffac27 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:47556
W20260709 13:09:00.004405 16352 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 859be0294f7f4761b91b80c75b983562 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 59746530bb6d4726893c108602ffac27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:00.039026 22785 ts_tablet_manager.cc:1929] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:09:00.039685 22785 log.cc:1199] T b92bb40598544d8591903d884ef151b0 P 6f34f184d0dd4382bee8790b4c077d05: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/wals/b92bb40598544d8591903d884ef151b0
I20260709 13:09:00.041996 16355 catalog_manager.cc:5028] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): tablet b92bb40598544d8591903d884ef151b0 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:09:00.061628 22788 tablet_replica.cc:333] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:00.062870 22788 raft_consensus.cc:2243] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.063719 22788 raft_consensus.cc:2272] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.059244 22787 tablet_replica.cc:333] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:00.074018 22787 raft_consensus.cc:2243] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:00.088402 22787 raft_consensus.cc:2272] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:00.090994 16368 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 14 to 15, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 15 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.093580 22788 ts_tablet_manager.cc:1916] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:00.096001 22787 ts_tablet_manager.cc:1916] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:00.111001 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58162
I20260709 13:09:00.111629 16613 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:09:00.115743 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58162
I20260709 13:09:00.116281 16613 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Received request to transfer leadership
I20260709 13:09:00.119153 16613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58162
I20260709 13:09:00.119822 16613 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Received request to transfer leadership
W20260709 13:09:00.127362 16416 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:09:00.127931 16416 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 859be0294f7f4761b91b80c75b983562 already in progress
W20260709 13:09:00.128298 16416 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 859be0294f7f4761b91b80c75b983562 already in progress
W20260709 13:09:00.128984 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 108720us
I20260709 13:09:00.158313 22787 ts_tablet_manager.cc:1929] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:09:00.158917 22787 log.cc:1199] T 245c53b961134a578f08f960e84a789a P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/245c53b961134a578f08f960e84a789a
I20260709 13:09:00.160727 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 245c53b961134a578f08f960e84a789a (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:09:00.209568 22788 ts_tablet_manager.cc:1929] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.11
I20260709 13:09:00.225000 22788 log.cc:1199] T 45e6d6887bf149f9ad8ed2c85503056c P 59746530bb6d4726893c108602ffac27: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/wals/45e6d6887bf149f9ad8ed2c85503056c
I20260709 13:09:00.227279 16352 catalog_manager.cc:5028] TS 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): tablet 45e6d6887bf149f9ad8ed2c85503056c (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:09:00.449530 16461 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:00.457473 22742 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:00.495759 16538 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:00.506189 22742 raft_consensus.cc:993] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: : Instructing follower 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:09:00.507265 22742 raft_consensus.cc:1081] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Signalling peer 6f34f184d0dd4382bee8790b4c077d05 to start an election
I20260709 13:09:00.512593 16463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
 from {username='slave'} at 127.0.0.1:57636
I20260709 13:09:00.513454 16463 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.514006 16463 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.542678 16463 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:00.545745 16463 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:00.546577 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:09:00.547370 16545 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.547873 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:00.537377 22747 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:09:00.558936 16611 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:00.559391 16611 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:00.560081 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:00.560686 17127 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.563804 16545 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:09:00.564579 16544 raft_consensus.cc:1240] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Rejecting Update request from peer 8e851f11d27b4a83aa395e05c4be6808 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:09:00.577091 22792 consensus_queue.cc:1059] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:00.584060 16611 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:00.590751 16611 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:00.591877 17127 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
I20260709 13:09:00.597868 16434 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:00.599725 22685 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:00.600260 22685 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Becoming Leader. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:09:00.601279 22685 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:00.628794 16368 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: term changed from 15 to 16, leader changed from 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) to 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65). New cstate: current_term: 16 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:00.656822 16611 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f34f184d0dd4382bee8790b4c077d05 in term 16.
W20260709 13:09:00.659029 22747 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:09:00.730098 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.001901 16545 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:01.004268 22685 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:01.212174 16613 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:01.212690 17124 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:01.215019 22799 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:01.215983 22685 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:01.223896 16355 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 859be0294f7f4761b91b80c75b983562 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER failed with leader 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:09:01.232578 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 66860.6us
I20260709 13:09:01.413160 16463 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:09:01.446372 16434 consensus_peers.cc:597] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ad8175aa8b04b6099470077ebb9aea9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.447353 16614 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:01.452270 22804 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:01.461014 16545 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:01.462718 22807 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:01.481247 22804 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.484018 16544 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.489416 16614 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.535426 16363 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 9, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.572155 16613 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
W20260709 13:09:01.645478 16583 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 98881185daee4f13b69385e36026216c (127.14.246.68:34961): Couldn't send request to peer 98881185daee4f13b69385e36026216c. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a8afa934df14d3bb3e773c41ab520ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.645551 16544 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:01.645670 16463 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:09:01.647379 22781 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:01.649184 22747 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:01.677788 22781 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.682371 16461 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.716652 16545 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
I20260709 13:09:01.748690 16367 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index -1 to 11, NON_VOTER 98881185daee4f13b69385e36026216c (127.14.246.68) added. New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } } }
W20260709 13:09:01.766724 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 43497.4us
I20260709 13:09:01.793685 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.946719 16461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
mode: GRACEFUL
new_leader_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:09:01.947392 16461 raft_consensus.cc:606] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Received request to transfer leadership to TS 98881185daee4f13b69385e36026216c
I20260709 13:09:01.955981 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:01.957818 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:02.026955 22823 ts_tablet_manager.cc:933] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627)
I20260709 13:09:02.045656 22823 tablet_copy_client.cc:323] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.65:40627
I20260709 13:09:02.048096 16480 tablet_copy_service.cc:140] P 6f34f184d0dd4382bee8790b4c077d05: Received BeginTabletCopySession request for tablet 3ad8175aa8b04b6099470077ebb9aea9 from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:50946)
I20260709 13:09:02.048693 16480 tablet_copy_service.cc:161] P 6f34f184d0dd4382bee8790b4c077d05: Beginning new tablet copy session on tablet 3ad8175aa8b04b6099470077ebb9aea9 from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:50946: session id = 98881185daee4f13b69385e36026216c-3ad8175aa8b04b6099470077ebb9aea9
I20260709 13:09:02.072204 16480 tablet_copy_source_session.cc:215] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:02.076674 22823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ad8175aa8b04b6099470077ebb9aea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:02.159328 22825 ts_tablet_manager.cc:933] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Initiating tablet copy from peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:02.166435 22823 tablet_copy_client.cc:806] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:02.169766 22823 tablet_copy_client.cc:670] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:02.177058 22823 tablet_copy_client.cc:538] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:02.209021 22825 tablet_copy_client.cc:323] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: tablet copy: Beginning tablet copy session from remote peer at address 127.14.246.67:44347
I20260709 13:09:02.254637 16628 tablet_copy_service.cc:140] P 8e851f11d27b4a83aa395e05c4be6808: Received BeginTabletCopySession request for tablet 8a8afa934df14d3bb3e773c41ab520ec from peer 98881185daee4f13b69385e36026216c ({username='slave'} at 127.0.0.1:42898)
I20260709 13:09:02.255234 16628 tablet_copy_service.cc:161] P 8e851f11d27b4a83aa395e05c4be6808: Beginning new tablet copy session on tablet 8a8afa934df14d3bb3e773c41ab520ec from peer 98881185daee4f13b69385e36026216c at {username='slave'} at 127.0.0.1:42898: session id = 98881185daee4f13b69385e36026216c-8a8afa934df14d3bb3e773c41ab520ec
I20260709 13:09:02.295248 16628 tablet_copy_source_session.cc:215] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:09:02.335224 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 49568.6us
W20260709 13:09:02.335450 16355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 69240.4us
I20260709 13:09:02.338506 22825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8afa934df14d3bb3e773c41ab520ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:02.359140 16355 catalog_manager.cc:4755] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): ChangeConfig:REMOVE_PEER RPC failed for tablet 859be0294f7f4761b91b80c75b983562: Remote error: Service unavailable: leader transfer in progress
I20260709 13:09:02.364137 22823 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Bootstrap starting.
I20260709 13:09:02.379463 22825 tablet_copy_client.cc:806] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:02.380110 22825 tablet_copy_client.cc:670] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:02.429596 22825 tablet_copy_client.cc:538] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:02.444519 22825 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Bootstrap starting.
W20260709 13:09:02.487366 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 116151us
I20260709 13:09:02.490991 22799 raft_consensus.cc:993] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: : Instructing follower 98881185daee4f13b69385e36026216c to start an election
I20260709 13:09:02.491536 22799 raft_consensus.cc:1081] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Signalling peer 98881185daee4f13b69385e36026216c to start an election
I20260709 13:09:02.493503 17124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "859be0294f7f4761b91b80c75b983562"
dest_uuid: "98881185daee4f13b69385e36026216c"
 from {username='slave'} at 127.0.0.1:53654
I20260709 13:09:02.494275 17124 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:02.494874 17124 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.534744 17124 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:02.537595 16463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "6f34f184d0dd4382bee8790b4c077d05"
I20260709 13:09:02.537729 17124 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:02.538210 16463 raft_consensus.cc:3055] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:02.538517 16463 raft_consensus.cc:740] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6f34f184d0dd4382bee8790b4c077d05, State: Running, Role: LEADER
I20260709 13:09:02.539186 16463 consensus_queue.cc:260] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:02.540546 16463 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.540947 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:09:02.541744 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:02.541947 16544 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.542290 16613 raft_consensus.cc:3060] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:02.548137 16463 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:09:02.568475 16613 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:09:02.568842 16544 raft_consensus.cc:2468] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:09:02.573992 17093 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:02.574833 22789 raft_consensus.cc:2804] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:02.575325 22789 raft_consensus.cc:697] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:02.576192 22789 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:02.597935 22823 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:02.602221 22823 tablet_bootstrap.cc:492] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:09:02.616545 22823 ts_tablet_manager.cc:1403] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.253s	user 0.033s	sys 0.011s
I20260709 13:09:02.642957 22823 raft_consensus.cc:359] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:09:02.643956 22823 raft_consensus.cc:740] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:09:02.644745 22823 consensus_queue.cc:260] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:09:02.668644 22823 ts_tablet_manager.cc:1434] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.002s
I20260709 13:09:02.674095 16480 tablet_copy_service.cc:342] P 6f34f184d0dd4382bee8790b4c077d05: Request end of tablet copy session 98881185daee4f13b69385e36026216c-3ad8175aa8b04b6099470077ebb9aea9 received from {username='slave'} at 127.0.0.1:50946
I20260709 13:09:02.674563 16480 tablet_copy_service.cc:434] P 6f34f184d0dd4382bee8790b4c077d05: ending tablet copy session 98881185daee4f13b69385e36026216c-3ad8175aa8b04b6099470077ebb9aea9 on tablet 3ad8175aa8b04b6099470077ebb9aea9 with peer 98881185daee4f13b69385e36026216c
I20260709 13:09:02.685213 16363 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:02.706228 22825 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:02.871624 22825 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:02.872694 22825 tablet_bootstrap.cc:492] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Bootstrap complete.
I20260709 13:09:02.873489 22825 ts_tablet_manager.cc:1403] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Time spent bootstrapping tablet: real 0.429s	user 0.049s	sys 0.007s
I20260709 13:09:02.876482 22825 raft_consensus.cc:359] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:09:02.877391 22825 raft_consensus.cc:740] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 98881185daee4f13b69385e36026216c, State: Initialized, Role: LEARNER
I20260709 13:09:02.878096 22825 consensus_queue.cc:260] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:09:02.898088 22825 ts_tablet_manager.cc:1434] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:09:02.901602 16628 tablet_copy_service.cc:342] P 8e851f11d27b4a83aa395e05c4be6808: Request end of tablet copy session 98881185daee4f13b69385e36026216c-8a8afa934df14d3bb3e773c41ab520ec received from {username='slave'} at 127.0.0.1:42898
I20260709 13:09:02.902046 16628 tablet_copy_service.cc:434] P 8e851f11d27b4a83aa395e05c4be6808: ending tablet copy session 98881185daee4f13b69385e36026216c-8a8afa934df14d3bb3e773c41ab520ec on tablet 8a8afa934df14d3bb3e773c41ab520ec with peer 98881185daee4f13b69385e36026216c
I20260709 13:09:02.958971 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:03.030735 17125 raft_consensus.cc:1217] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:09:03.055678 17125 raft_consensus.cc:1217] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:09:03.073526 16542 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:03.078959 22827 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:03.105458 16461 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:03.107257 22789 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:03.110013 16613 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:03.112159 22789 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:03.114986 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
W20260709 13:09:03.195784 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 60837us
W20260709 13:09:03.245389 16511 consensus_peers.cc:597] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.264222 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 132711us
W20260709 13:09:03.294651 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 123088us
W20260709 13:09:03.360632 22839 log.cc:927] Time spent T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 13:09:03.443210 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.491515 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.492473 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.494692 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.495350 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.495921 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.497579 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.501274 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.501863 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.502579 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.519788 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.594429 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 195786us
W20260709 13:09:03.633994 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.649152 22857 raft_consensus.cc:1064] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:09:03.653414 22857 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:03.672430 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.672935 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 68039.7us
W20260709 13:09:03.673609 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.674350 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 67774.3us
W20260709 13:09:03.678743 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.687085 22820 raft_consensus.cc:1064] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: attempting to promote NON_VOTER 98881185daee4f13b69385e36026216c to VOTER
I20260709 13:09:03.689715 22820 consensus_queue.cc:237] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:03.743876 16542 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:03.762383 16545 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:03.766505 17125 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 LEARNER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:03.784348 22844 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:03.794798 16614 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 6f34f184d0dd4382bee8790b4c077d05: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:03.810361 22810 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:03.810561 22844 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:03.815596 17125 raft_consensus.cc:1275] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 LEARNER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:09:03.838200 22810 consensus_queue.cc:1048] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 13:09:03.853767 16511 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.876669 16511 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.877435 16511 consensus_peers.cc:597] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.878099 16511 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.884692 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.908222 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.909284 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.950628 22844 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:09:03.974216 16511 consensus_peers.cc:597] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.975055 16511 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.977365 16511 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.978518 16511 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.031755 22873 log.cc:927] Time spent T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:09:04.043618 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 101547us
I20260709 13:09:04.050521 22849 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.051478 22849 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.054093 22849 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.055908 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.063017 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab144bc0671c46e6807f89d495e66473" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:09:04.077883 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.082324 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 172293us
W20260709 13:09:04.098310 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.110669 22844 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:04.115613 16434 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.116443 17124 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:04.144073 22858 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.146734 22858 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.160624 22858 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:04.153474 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.164381 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.166247 22849 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.167228 22849 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.170338 22849 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.182863 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.241418 22849 raft_consensus.cc:493] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.242270 22849 raft_consensus.cc:515] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.246125 22857 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.246971 22857 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.254029 22848 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.254894 22848 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.293354 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.282271 22849 leader_election.cc:290] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.294844 22858 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:09:04.329133 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 111591us
I20260709 13:09:04.306372 22849 raft_consensus.cc:493] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.323239 22858 raft_consensus.cc:493] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.345026 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:09:04.347142 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 58365.2us
I20260709 13:09:04.354460 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.355078 22849 raft_consensus.cc:515] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.356905 22857 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.357311 22849 leader_election.cc:290] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.368034 22877 raft_consensus.cc:493] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.368853 22877 raft_consensus.cc:515] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.361285 22848 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.372293 22848 raft_consensus.cc:493] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.373011 22848 raft_consensus.cc:515] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.375247 22848 leader_election.cc:290] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.382145 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c1c59c7dab4ee3afd08075f673c2c8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.383183 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edc37979fbec49e3beeb0104b9711f73" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.385265 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1137091c3c0e4f76a0e16e0f8076bacb" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.391378 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:09:04.397949 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 45048.7us
I20260709 13:09:04.404240 22858 raft_consensus.cc:515] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.409010 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d214c667f1547569798ec88932945a2" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.411242 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.413502 22858 leader_election.cc:290] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.414971 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:09:04.415151 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 64040us
I20260709 13:09:04.414990 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.371405 22877 leader_election.cc:290] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.376643 22848 raft_consensus.cc:493] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
W20260709 13:09:04.445466 17090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 51533.6us
W20260709 13:09:04.447784 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 100633us
I20260709 13:09:04.435886 22858 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
W20260709 13:09:04.449633 22878 log.cc:927] Time spent T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:09:04.485541 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43cea492ee7e4f91b2ad509449c832f1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.488324 22830 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.489194 22830 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: NON_VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: true } }
I20260709 13:09:04.491277 16538 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:04.492799 22830 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:04.493040 22879 raft_consensus.cc:493] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.493680 22879 raft_consensus.cc:515] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.498634 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40ac1479cf4a42f2950de2628057ba50" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.503515 22877 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.504377 22877 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.507112 22877 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.510645 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.513983 22885 raft_consensus.cc:493] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.514786 22885 raft_consensus.cc:515] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.515662 22879 leader_election.cc:290] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.520309 22879 raft_consensus.cc:493] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.523432 22879 raft_consensus.cc:515] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.517825 16433 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.518641 22877 raft_consensus.cc:493] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.518723 22884 raft_consensus.cc:493] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.529520 22884 raft_consensus.cc:515] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.529907 16433 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:04.530769 22830 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.531454 22893 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.531817 22884 leader_election.cc:290] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.517131 22885 leader_election.cc:290] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.531452 16433 leader_election.cc:304] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:04.492689 22844 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.523600 16368 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 reported cstate change: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "6f34f184d0dd4382bee8790b4c077d05" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.528713 22879 leader_election.cc:290] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.532814 22844 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.533511 22879 raft_consensus.cc:2749] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:04.533265 16433 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:04.552186 22857 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.552891 22857 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.555094 22884 raft_consensus.cc:493] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.555717 22884 raft_consensus.cc:515] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.557950 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4021ce342efc430996265ce4a5a65e87" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.561290 22884 leader_election.cc:290] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.564929 22892 raft_consensus.cc:493] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.565555 22892 raft_consensus.cc:515] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.564921 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7735d77d64e14457985553596120e4cc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.569731 17118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.570120 22887 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.570778 22887 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.572160 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.573581 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.458460 16613 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:09:04.598083 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 63077.6us
I20260709 13:09:04.604498 16433 leader_election.cc:304] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:04.535761 22858 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.579622 22879 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.537190 22848 raft_consensus.cc:515] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.597049 22844 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.612177 22887 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.609941 22877 raft_consensus.cc:515] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:04.632501 22884 raft_consensus.cc:2749] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.644466 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.649235 16434 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.652040 16434 leader_election.cc:304] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.632006 22844 raft_consensus.cc:493] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:04.663671 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df33d6051c004b71a5d0f086053be1fe" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.666216 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.656268 22885 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:04.688275 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.697429 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.721427 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.688982 22893 raft_consensus.cc:2749] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:04.724496 16434 leader_election.cc:304] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.732054 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.733464 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.735737 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.743887 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb27cdf9e08471584fe7bce6bffd303" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:09:04.749099 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 140293us
I20260709 13:09:04.762882 22903 raft_consensus.cc:2749] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:04.765017 22877 leader_election.cc:290] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:04.782917 22848 leader_election.cc:290] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.783890 22858 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.786018 22857 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.787959 22892 leader_election.cc:290] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.745921 22844 raft_consensus.cc:515] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.794438 22844 leader_election.cc:290] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.801993 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.802783 17124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.818852 22852 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
W20260709 13:09:04.832875 22789 consensus_queue.cc:1175] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "59746530bb6d4726893c108602ffac27" responder_term: 17 status { last_received { term: 17 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 17 index: 15 } }
I20260709 13:09:04.835516 17125 consensus_queue.cc:237] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.836905 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:09:04.866969 17093 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260709 13:09:04.879441 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5eccbd91402541c4bb6edc9c47f3cf8f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.883327 16613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.882733 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fec5040680744828ce3ed1844be1ac1" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:09:04.891299 16433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 286860us
I20260709 13:09:04.892050 16433 leader_election.cc:304] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.889276 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:04.882942 17121 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:04.902323 22910 raft_consensus.cc:2749] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:04.938621 16545 raft_consensus.cc:1275] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:09:04.940795 22789 consensus_queue.cc:1048] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:09:04.951834 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8afa934df14d3bb3e773c41ab520ec" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.960193 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad356f899692471d8abda66b7fe01205" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.965375 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e831b8c574943b8b259e490e4d208" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.965652 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ae44ac0f4e496caaa8405cb3f946d8" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.966250 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79efbc85967d4384bfa3825ef0ec5a14" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.965726 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "922b28b4b68e4191b6f4e8c9291cd40d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.973644 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "245c53b961134a578f08f960e84a789a" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.975864 22907 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:04.976549 22907 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.978977 22907 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:04.985795 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74c0af8eb7234215a518fd144bd450af" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.986084 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6689ca00362248ce81b56252a62e85a9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.987651 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "859be0294f7f4761b91b80c75b983562" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.987941 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18effeb8d3aa4c58bffd8cce4093fd3d" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.988904 22907 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:04.988947 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e9a6d3e5b24df58aa452e3b70637fc" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:04.993319 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:04.968449 16436 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:04.989734 22907 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:04.994522 16542 raft_consensus.cc:2955] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:04.998283 22827 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Committing config change with OpId 17.16: config changed from index 12 to 16, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:05.001525 22911 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:09:05.009338 17090 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.011472 16536 raft_consensus.cc:2955] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Committing config change with OpId 17.16: config changed from index 12 to 16, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:05.028421 16433 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.026428 22910 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:09:05.041122 16436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 72747.3us
I20260709 13:09:05.046949 16433 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.043108 22844 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.061798 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:05.046226 22885 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.051681 22857 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:05.064008 22907 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:05.046706 22910 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:05.066172 22910 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:05.046561 22911 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:05.069094 22887 raft_consensus.cc:493] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 98881185daee4f13b69385e36026216c)
I20260709 13:09:05.069726 22911 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:05.070946 16433 leader_election.cc:304] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.069751 22887 raft_consensus.cc:515] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:05.074021 22887 leader_election.cc:290] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:05.077225 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:05.083367 22893 raft_consensus.cc:2749] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.079048 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:05.093438 16433 leader_election.cc:304] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.094478 16433 leader_election.cc:304] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.097889 22911 raft_consensus.cc:2749] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:05.100839 22887 raft_consensus.cc:2749] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:05.097406 16436 leader_election.cc:304] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.102435 16433 leader_election.cc:304] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.103715 16433 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.103971 16436 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.104897 22911 raft_consensus.cc:2749] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:05.105394 22887 raft_consensus.cc:2749] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.105892 22911 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:05.107043 16436 leader_election.cc:304] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
W20260709 13:09:05.113893 16509 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 62600.8us
I20260709 13:09:05.125348 16433 leader_election.cc:304] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.125978 22911 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.126458 22887 raft_consensus.cc:2749] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.129132 16353 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 859be0294f7f4761b91b80c75b983562 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:09:05.133188 22887 raft_consensus.cc:2749] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.138384 16433 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.139106 22887 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:05.149324 16433 leader_election.cc:304] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.150133 22887 raft_consensus.cc:2749] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.153074 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630ca4cf8bd64907bf8c82149ab5afb9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:05.159296 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:05.157083 16433 leader_election.cc:304] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.176724 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "facc0e17b2a549b4b071a55d5f7c2167" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:05.177521 16542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bb7626d64b480b9966ee39a4d8f1f9" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:05.181596 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92aeb38730a646668d4f528d66afd917" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:05.190459 16537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30da0730b354efb9fefd9ef646ce15f" candidate_uuid: "6f34f184d0dd4382bee8790b4c077d05" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:05.195379 16433 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.197430 22844 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.183189 22848 raft_consensus.cc:2749] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.197741 16433 leader_election.cc:304] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.218094 16433 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.218827 22858 raft_consensus.cc:2749] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:05.226126 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:05.230553 22858 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:05.233374 16436 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:05.234280 22858 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:05.240924 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:05.240437 16367 catalog_manager.cc:5697] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: config changed from index 11 to 12, 98881185daee4f13b69385e36026216c (127.14.246.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.242383 15321 tablet_replica.cc:333] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.243420 15321 raft_consensus.cc:2243] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.249413 15321 raft_consensus.cc:2272] T 18effeb8d3aa4c58bffd8cce4093fd3d P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.253013 15321 tablet_replica.cc:333] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.254063 15321 raft_consensus.cc:2243] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.254702 15321 raft_consensus.cc:2272] T 7735d77d64e14457985553596120e4cc P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.259481 16436 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f34f184d0dd4382bee8790b4c077d05; no voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c
I20260709 13:09:05.262564 22858 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:05.271973 16363 catalog_manager.cc:5697] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 reported cstate change: config changed from index 12 to 16, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:05.283403 15321 tablet_replica.cc:333] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.309609 15321 raft_consensus.cc:2243] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.345889 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 859be0294f7f4761b91b80c75b983562 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:58162
I20260709 13:09:05.355057 15321 raft_consensus.cc:2272] T ab144bc0671c46e6807f89d495e66473 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.354997 16355 catalog_manager.cc:4755] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): ChangeConfig:REMOVE_PEER RPC failed for tablet 3ad8175aa8b04b6099470077ebb9aea9: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:05.367340 15321 tablet_replica.cc:333] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.368257 22920 tablet_replica.cc:333] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:05.373278 22920 raft_consensus.cc:2243] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.374475 22920 raft_consensus.cc:2272] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.377739 15321 raft_consensus.cc:2243] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.378726 15321 raft_consensus.cc:2272] T edc37979fbec49e3beeb0104b9711f73 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.381634 15321 tablet_replica.cc:333] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.387662 22920 ts_tablet_manager.cc:1916] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:05.397303 15321 raft_consensus.cc:2243] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.398278 15321 raft_consensus.cc:2272] T facc0e17b2a549b4b071a55d5f7c2167 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.401392 15321 tablet_replica.cc:333] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.402328 15321 raft_consensus.cc:2243] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.426904 15321 raft_consensus.cc:2272] T 9077e45eb7ce4f25a250be02bedafeb4 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.429939 15321 tablet_replica.cc:333] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.442737 22920 ts_tablet_manager.cc:1929] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.15
I20260709 13:09:05.452056 22920 log.cc:1199] T 859be0294f7f4761b91b80c75b983562 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/859be0294f7f4761b91b80c75b983562
I20260709 13:09:05.430723 15321 raft_consensus.cc:2243] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.469357 15321 raft_consensus.cc:2272] T 1fec5040680744828ce3ed1844be1ac1 P 6f34f184d0dd4382bee8790b4c077d05 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.470377 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 859be0294f7f4761b91b80c75b983562 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
I20260709 13:09:05.473652 15321 tablet_replica.cc:333] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.474751 15321 raft_consensus.cc:2243] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.476094 15321 raft_consensus.cc:2272] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.493718 15321 tablet_replica.cc:333] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.503059 15321 raft_consensus.cc:2243] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.512295 15321 raft_consensus.cc:2272] T 922b28b4b68e4191b6f4e8c9291cd40d P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.530860 15321 tablet_replica.cc:333] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
W20260709 13:09:05.539098 16511 consensus_peers.cc:597] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.540407 15321 raft_consensus.cc:2243] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.561694 15321 raft_consensus.cc:2272] T 9d214c667f1547569798ec88932945a2 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.575037 15321 tablet_replica.cc:333] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.576217 15321 raft_consensus.cc:2243] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.577761 15321 raft_consensus.cc:2272] T 3ad8175aa8b04b6099470077ebb9aea9 P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.581486 15321 tablet_replica.cc:333] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.582548 15321 raft_consensus.cc:2243] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.583607 15321 raft_consensus.cc:2272] T 630ca4cf8bd64907bf8c82149ab5afb9 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.591992 15321 tablet_replica.cc:333] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.592940 15321 raft_consensus.cc:2243] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.594277 15321 raft_consensus.cc:2272] T 11c1a9d5e3dd45d7a937a9954de478cc P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.597442 15321 tablet_replica.cc:333] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.598318 15321 raft_consensus.cc:2243] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.599085 15321 raft_consensus.cc:2272] T df33d6051c004b71a5d0f086053be1fe P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.602007 15321 tablet_replica.cc:333] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.602829 15321 raft_consensus.cc:2243] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.603520 15321 raft_consensus.cc:2272] T 40ac1479cf4a42f2950de2628057ba50 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.606585 15321 tablet_replica.cc:333] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.607612 15321 raft_consensus.cc:2243] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.608337 15321 raft_consensus.cc:2272] T ad356f899692471d8abda66b7fe01205 P 6f34f184d0dd4382bee8790b4c077d05 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.611197 15321 tablet_replica.cc:333] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.628427 15321 raft_consensus.cc:2243] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.629859 15321 raft_consensus.cc:2272] T 84545dee228c4faea4411a58c683bb27 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:05.643848 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:05.661669 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.664726 15321 tablet_replica.cc:333] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.665818 15321 raft_consensus.cc:2243] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.667095 15321 raft_consensus.cc:2272] T 4021ce342efc430996265ce4a5a65e87 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.670076 15321 tablet_replica.cc:333] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.671016 15321 raft_consensus.cc:2243] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.671741 15321 pending_rounds.cc:70] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Trying to abort 1 pending ops.
I20260709 13:09:05.672035 15321 pending_rounds.cc:77] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05: Aborting op as it isn't in flight: id { term: 17 index: 15 } timestamp: 7305636014408175616 op_type: NO_OP noop_request { }
I20260709 13:09:05.672499 15321 raft_consensus.cc:2889] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:05.672899 15321 raft_consensus.cc:2272] T 859be0294f7f4761b91b80c75b983562 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.686214 15321 tablet_replica.cc:333] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.687084 15321 raft_consensus.cc:2243] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.688156 15321 raft_consensus.cc:2272] T c2cd1155e69c4429b642e17940dde1e6 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.690915 15321 tablet_replica.cc:333] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.691727 15321 raft_consensus.cc:2243] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.692870 15321 raft_consensus.cc:2272] T eb71b78423ad47fbb40e65fef063a173 P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.695596 15321 tablet_replica.cc:333] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.696336 15321 raft_consensus.cc:2243] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.696952 15321 raft_consensus.cc:2272] T 5eccbd91402541c4bb6edc9c47f3cf8f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.744941 15321 tablet_replica.cc:333] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.745957 15321 raft_consensus.cc:2243] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.748994 15321 raft_consensus.cc:2272] T 92aeb38730a646668d4f528d66afd917 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.758090 15321 tablet_replica.cc:333] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.759042 15321 raft_consensus.cc:2243] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.760197 15321 raft_consensus.cc:2272] T c8566128e1c24c7fa1f9894bd8ffdec7 P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.762802 15321 tablet_replica.cc:333] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.763594 15321 raft_consensus.cc:2243] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.764663 15321 raft_consensus.cc:2272] T 245c53b961134a578f08f960e84a789a P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.787562 15321 tablet_replica.cc:333] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.788349 15321 raft_consensus.cc:2243] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.789117 15321 raft_consensus.cc:2272] T 1137091c3c0e4f76a0e16e0f8076bacb P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.803771 15321 tablet_replica.cc:333] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.804697 15321 raft_consensus.cc:2243] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.807130 15321 raft_consensus.cc:2272] T 4caba52d3ee04ab8b71cd4236ee0ccde P 6f34f184d0dd4382bee8790b4c077d05 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.824457 15321 tablet_replica.cc:333] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.825369 15321 raft_consensus.cc:2243] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.826129 15321 raft_consensus.cc:2272] T 13ae44ac0f4e496caaa8405cb3f946d8 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.842631 15321 tablet_replica.cc:333] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.843515 15321 raft_consensus.cc:2243] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.852731 15321 raft_consensus.cc:2272] T 45e6d6887bf149f9ad8ed2c85503056c P 6f34f184d0dd4382bee8790b4c077d05 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.855425 15321 tablet_replica.cc:333] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.856216 15321 raft_consensus.cc:2243] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.857271 15321 raft_consensus.cc:2272] T d0499df31d9f40178fb10011eef7ece6 P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.864347 15321 tablet_replica.cc:333] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.865127 15321 raft_consensus.cc:2243] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.866386 15321 raft_consensus.cc:2272] T 58e2513ac115476c9eb7fcddb908cb9b P 6f34f184d0dd4382bee8790b4c077d05 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.872200 15321 tablet_replica.cc:333] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.873363 15321 raft_consensus.cc:2243] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.875114 15321 raft_consensus.cc:2272] T e30da0730b354efb9fefd9ef646ce15f P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.879125 15321 tablet_replica.cc:333] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.880375 15321 raft_consensus.cc:2243] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.893219 15321 raft_consensus.cc:2272] T 6689ca00362248ce81b56252a62e85a9 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.905818 15321 tablet_replica.cc:333] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.906731 15321 raft_consensus.cc:2243] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.907492 15321 raft_consensus.cc:2272] T c9e9a6d3e5b24df58aa452e3b70637fc P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.910662 15321 tablet_replica.cc:333] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.911388 15321 raft_consensus.cc:2243] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.912087 15321 raft_consensus.cc:2272] T deb27cdf9e08471584fe7bce6bffd303 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.914678 15321 tablet_replica.cc:333] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.915410 15321 raft_consensus.cc:2243] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:05.915520 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.916091 15321 raft_consensus.cc:2272] T 8a8afa934df14d3bb3e773c41ab520ec P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.925887 15321 tablet_replica.cc:333] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.926486 15321 raft_consensus.cc:2243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.927346 15321 raft_consensus.cc:2272] T b6c87fc9474b4fd2806ea6a4c1104e22 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.929900 15321 tablet_replica.cc:333] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.940923 15321 raft_consensus.cc:2243] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.953693 15321 raft_consensus.cc:2272] T 53c1c59c7dab4ee3afd08075f673c2c8 P 6f34f184d0dd4382bee8790b4c077d05 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.961153 15321 tablet_replica.cc:333] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.961987 15321 raft_consensus.cc:2243] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.963176 15321 raft_consensus.cc:2272] T 628b797ac16849cca2b2c6254663f2f7 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.981635 15321 tablet_replica.cc:333] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:05.989308 15321 raft_consensus.cc:2243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.001181 15321 raft_consensus.cc:2272] T 15bb7626d64b480b9966ee39a4d8f1f9 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.006170 15321 tablet_replica.cc:333] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:06.006830 15321 raft_consensus.cc:2243] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.007351 15321 raft_consensus.cc:2272] T 605e831b8c574943b8b259e490e4d208 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.027041 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.027381 15321 tablet_replica.cc:333] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:06.028259 15321 raft_consensus.cc:2243] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.028985 15321 raft_consensus.cc:2272] T 74c0af8eb7234215a518fd144bd450af P 6f34f184d0dd4382bee8790b4c077d05 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.039059 15321 tablet_replica.cc:333] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:06.039820 15321 raft_consensus.cc:2243] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.041061 15321 raft_consensus.cc:2272] T 43cea492ee7e4f91b2ad509449c832f1 P 6f34f184d0dd4382bee8790b4c077d05 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.071491 15321 tablet_replica.cc:333] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
I20260709 13:09:06.072279 15321 raft_consensus.cc:2243] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.073505 15321 raft_consensus.cc:2272] T 8806363158d645279801d4633a1c7d74 P 6f34f184d0dd4382bee8790b4c077d05 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.074620 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.075232 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.076318 15321 tablet_replica.cc:333] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05: stopping tablet replica
W20260709 13:09:06.089048 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.101125 15321 raft_consensus.cc:2243] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.101838 15321 raft_consensus.cc:2272] T 79efbc85967d4384bfa3825ef0ec5a14 P 6f34f184d0dd4382bee8790b4c077d05 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.122390 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.156886 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.160287 16511 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.182951 16511 consensus_peers.cc:597] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.230942 16511 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.325214 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.330543 16511 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.369938 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.392781 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.503175 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.543839 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.565543 16355 catalog_manager.cc:4755] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): ChangeConfig:REMOVE_PEER RPC failed for tablet 3ad8175aa8b04b6099470077ebb9aea9: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:06.567016 16511 consensus_peers.cc:597] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.676241 22927 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.676815 22927 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.677790 22921 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.678459 22921 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.680486 22921 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.682070 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:09:06.685281 16585 leader_election.cc:336] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:06.690526 17093 leader_election.cc:336] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.690713 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:06.691008 17093 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:06.691776 22921 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:06.692485 16583 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:09:06.693446 22852 raft_consensus.cc:2749] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:06.694448 22927 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:06.710614 22906 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.711305 22927 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.711248 22906 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.711899 22927 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.713948 22927 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:06.716045 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
W20260709 13:09:06.719343 16585 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.719794 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.720626 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:06.720991 22927 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:06.722280 17093 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.722750 17093 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.723735 22921 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.728684 22906 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.728799 22852 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.729485 22852 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.731565 22852 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:06.732023 22852 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.732383 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:06.732473 22852 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.734758 16611 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 14.
I20260709 13:09:06.737418 22845 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.737941 22845 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.739130 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:06.739420 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:06.739921 22845 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.741195 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:06.741808 17125 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
W20260709 13:09:06.746276 16511 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:06.747239 16585 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.747702 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.747256 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:06.748674 16611 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:09:06.748955 16585 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.748674 22927 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:06.749424 16585 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.752110 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.752550 22904 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.752992 22845 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:06.753350 22845 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.742583 22852 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:06.753762 22845 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:06.768622 22845 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.790809 22845 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.794839 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9077e45eb7ce4f25a250be02bedafeb4" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:06.795588 16616 raft_consensus.cc:3060] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:06.806749 16511 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.818365 22845 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.819064 16616 raft_consensus.cc:2468] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:09:06.819123 22845 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.832378 22845 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.829977 22852 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.833693 22852 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.835165 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:06.835865 16611 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:09:06.835875 22852 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:06.838131 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:06.838775 16544 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:09:06.840330 22921 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.840974 22921 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.843475 22921 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.840049 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:09:06.844864 16585 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.847843 22852 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:06.848323 22852 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.848733 22852 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:06.852428 17093 leader_election.cc:336] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.852861 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:06.853250 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:06.856387 16611 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:09:06.854806 22845 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:06.857515 22845 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.857944 22845 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:06.862383 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.863821 22906 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:06.864240 22906 raft_consensus.cc:493] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.864611 22906 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:06.868886 16511 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.879576 22906 raft_consensus.cc:515] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.895931 22906 leader_election.cc:290] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.889559 22845 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.902364 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e23c7e0edd4ed18d5cf6b93c2b1607" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:06.909215 16611 raft_consensus.cc:3060] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:06.916868 16511 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.917673 22905 raft_consensus.cc:2804] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:06.918669 22905 raft_consensus.cc:697] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:06.919281 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:06.919545 22905 consensus_queue.cc:237] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.922628 16611 raft_consensus.cc:2468] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 18.
I20260709 13:09:06.933832 22927 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.910952 22845 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:06.912233 22906 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:06.934484 22927 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.935341 22906 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.937639 22906 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:06.907505 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.941323 17093 leader_election.cc:336] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:06.905267 22852 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:06.947105 17125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:06.947203 17093 leader_election.cc:304] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:06.947957 17125 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:09:07.086835 22932 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.087474 22932 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.090613 22932 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.149163 22934 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.149806 22934 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.152014 22934 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.152210 22845 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.152891 22845 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.153594 22931 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.154227 22931 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.156266 22906 raft_consensus.cc:2804] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:07.156955 22906 raft_consensus.cc:697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 18 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:07.157514 22931 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.158128 22845 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:06.945452 22927 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.157992 22906 consensus_queue.cc:237] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.166308 22936 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.166849 22936 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.169399 22936 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.185861 22940 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.187587 22938 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.188197 22938 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.190544 22938 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.191392 22940 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.193830 22940 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.201804 16616 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:09:07.209998 22942 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.210915 22942 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:06.947851 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.213308 22942 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:07.219192 16511 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.229635 16585 leader_election.cc:336] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.233801 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 283243us
W20260709 13:09:07.238602 16585 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.239483 16585 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.240880 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.241546 16619 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 11.
W20260709 13:09:07.240190 16585 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.242913 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.243506 16616 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:09:07.247125 22942 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.247723 22942 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.249647 16583 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.251799 22942 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.254700 22852 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.257903 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.258100 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.258807 17093 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.260260 22936 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:07.258837 17119 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:09:07.269448 22936 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.259292 22929 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.269881 22936 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.270232 22929 raft_consensus.cc:493] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.270663 22929 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.264047 16361 catalog_manager.cc:5697] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 17 to 18, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 18 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:07.232089 16511 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.277022 22852 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.278007 22906 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.278450 22906 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.278214 22852 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:07.277225 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 45157.3us
I20260709 13:09:07.278853 22906 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:07.279318 16511 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.280615 22852 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:07.279806 16511 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.284839 16511 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.290822 16511 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.292182 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.292318 22768 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.293102 17120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.293756 17120 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:09:07.292927 22768 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.297529 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.295238 17122 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:09:07.311255 22768 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.311414 22905 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.308313 22936 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.314358 22936 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.321908 16583 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:07.326297 16585 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.312242 22905 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:07.334120 16582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:37367, user_credentials={real_user=slave}} blocked reactor thread for 388302us
W20260709 13:09:07.339061 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.339563 17093 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.333873 22904 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.341714 22904 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.334180 22938 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.343277 22938 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.343699 22938 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.343888 22904 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.345098 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11c1a9d5e3dd45d7a937a9954de478cc" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.345760 17119 raft_consensus.cc:3060] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.347316 22929 raft_consensus.cc:515] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.357388 22905 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.336944 22927 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:07.358251 22927 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.358670 22927 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:07.360735 17093 leader_election.cc:336] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.368045 15321 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16491)
I20260709 13:09:07.369095 17119 raft_consensus.cc:2468] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:09:07.369285 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.367256 17093 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:09:07.370493 16511 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.370558 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.371007 16511 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.371137 17093 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.371994 17093 leader_election.cc:336] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.369886 17122 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
W20260709 13:09:07.373072 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:07.373799 17093 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.374599 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:09:07.375023 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.373386 22932 raft_consensus.cc:2749] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.334580 22906 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.368871 22931 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.377978 22906 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.378273 22931 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.378839 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.379061 16583 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.380003 22936 raft_consensus.cc:2804] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:07.380187 22931 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.380825 22936 raft_consensus.cc:697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:07.381858 22929 leader_election.cc:290] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:07.382102 16585 leader_election.cc:336] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.381790 22936 consensus_queue.cc:237] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:07.382844 16585 leader_election.cc:336] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.386297 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.386557 16583 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:09:07.387575 22944 raft_consensus.cc:2749] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:07.393100 16511 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.397475 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0499df31d9f40178fb10011eef7ece6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.398190 16616 raft_consensus.cc:3060] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:07.399533 17093 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.403345 16509 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.403584 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:07.404184 16545 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
I20260709 13:09:07.406586 16545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:09:07.407634 22905 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.417148 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.417953 16614 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:09:07.408964 22933 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.417115 22905 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.419068 22905 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.418990 22933 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.409612 22937 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.421082 22937 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.421717 22938 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.399518 22931 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.423291 16545 raft_consensus.cc:2393] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:09:07.423432 22937 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.415907 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.426115 16619 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 16.
I20260709 13:09:07.416579 16616 raft_consensus.cc:2468] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 12.
I20260709 13:09:07.412899 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:07.409539 22927 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:07.417083 16511 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.429930 16618 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 13: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:09:07.430979 22927 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.431264 22933 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.429252 16538 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
I20260709 13:09:07.433926 22938 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:09:07.435303 16585 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.435956 17093 leader_election.cc:304] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.434952 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.436942 16538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2cd1155e69c4429b642e17940dde1e6" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:07.437485 17122 raft_consensus.cc:3060] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.437700 16538 raft_consensus.cc:2393] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 18: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:09:07.438938 22947 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.439802 22947 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:07.440640 16585 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.442139 16585 leader_election.cc:336] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.444959 16511 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.445333 17122 raft_consensus.cc:2468] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
I20260709 13:09:07.441571 22947 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.446966 16509 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.447948 22947 raft_consensus.cc:2804] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:07.449463 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:07.451771 17093 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:07.452659 22929 raft_consensus.cc:2804] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:07.453197 22929 raft_consensus.cc:697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:07.454059 22929 consensus_queue.cc:237] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.457273 17090 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.458631 22906 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.461404 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.459272 22947 raft_consensus.cc:697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:07.462222 22932 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.463088 22947 consensus_queue.cc:237] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.464694 16619 raft_consensus.cc:1275] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:07.466234 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.466861 16619 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 11.
W20260709 13:09:07.461578 17093 leader_election.cc:336] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.468330 17119 raft_consensus.cc:2393] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 13: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:09:07.468457 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.468896 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.459584 22905 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.469511 16619 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:09:07.469978 16536 raft_consensus.cc:2393] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 98881185daee4f13b69385e36026216c in current term 15: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:09:07.471014 22905 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.462333 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:07.472242 16583 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05, 98881185daee4f13b69385e36026216c
I20260709 13:09:07.472679 17127 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:09:07.473673 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4caba52d3ee04ab8b71cd4236ee0ccde" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.474164 17119 raft_consensus.cc:3060] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.485888 17119 raft_consensus.cc:2468] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:09:07.487496 16367 catalog_manager.cc:5697] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 13 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.490334 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.491562 22933 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.491606 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.492147 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.492525 16618 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
I20260709 13:09:07.493621 16509 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.493460 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.494683 22938 raft_consensus.cc:2804] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:07.495038 22931 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:07.495512 22931 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.495894 22931 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.495162 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.495213 22938 raft_consensus.cc:697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:07.497689 22905 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:07.498237 22905 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.497748 22938 consensus_queue.cc:237] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.498631 22905 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:07.491851 22927 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.501973 22927 raft_consensus.cc:493] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.502401 22927 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.503053 22904 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:07.503513 22904 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.503930 22904 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.505519 22942 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.506103 22942 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.508360 22942 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.513000 22946 consensus_queue.cc:1048] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:07.512252 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.517542 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.521179 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27" is_pre_election: true
I20260709 13:09:07.521893 16536 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
I20260709 13:09:07.516724 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.512145 16363 catalog_manager.cc:5697] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 14 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.528168 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.527019 22852 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:07.532167 22945 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.532629 22945 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.541785 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:07.542222 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.542573 16618 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 15.
I20260709 13:09:07.543393 22933 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.532749 22905 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.543852 22933 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.547833 17090 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.548208 22933 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.542451 22931 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.535286 22946 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:07.550516 22946 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.550904 22946 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:07.534996 22904 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.556242 22904 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.532873 22937 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:07.567067 22937 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.567561 22937 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.533150 22945 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:07.577317 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:09:07.580677 22927 raft_consensus.cc:515] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:07.588961 16585 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.565316 22905 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.607004 22931 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.609287 22927 leader_election.cc:290] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:07.617712 17119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.631505 22946 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.645854 17119 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:07.609233 22952 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:07.657897 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 121602us
W20260709 13:09:07.672276 16585 leader_election.cc:336] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.674540 17119 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:09:07.673624 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:07.676653 16544 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 14: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
W20260709 13:09:07.676599 16511 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.677536 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.664186 22945 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.681468 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.617924 22933 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.683884 22946 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.684559 22952 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:07.685014 22952 raft_consensus.cc:493] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.685454 22952 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.683790 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c87fc9474b4fd2806ea6a4c1104e22" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:07.688524 17127 raft_consensus.cc:3060] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.676108 22937 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.690173 22945 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.691854 22937 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:07.692006 16536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
I20260709 13:09:07.692893 16536 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 12: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:09:07.677670 22931 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:07.697008 22931 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6f34f184d0dd4382bee8790b4c077d05)
I20260709 13:09:07.697662 22931 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:07.697391 16582 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.699010 22940 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:07.708595 17127 raft_consensus.cc:2468] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 18.
I20260709 13:09:07.715256 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84545dee228c4faea4411a58c683bb27" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.715880 16618 raft_consensus.cc:3060] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:07.717144 17093 leader_election.cc:336] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.720430 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ad8175aa8b04b6099470077ebb9aea9" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.721374 16616 raft_consensus.cc:3060] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:07.726064 16355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 53119.6us
I20260709 13:09:07.727905 16614 raft_consensus.cc:1275] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:09:07.740728 22933 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:07.747135 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:07.740828 16583 leader_election.cc:304] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.740888 16544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "59746530bb6d4726893c108602ffac27"
W20260709 13:09:07.744587 16585 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.746449 22956 consensus_queue.cc:1048] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:09:07.749172 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.749990 22904 raft_consensus.cc:2804] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:07.750483 22904 raft_consensus.cc:697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:07.751348 22904 consensus_queue.cc:237] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.752043 22940 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.746449 16618 raft_consensus.cc:2468] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 17.
W20260709 13:09:07.758477 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:07.765597 16585 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.766991 16355 catalog_manager.cc:4755] TS 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): ChangeConfig:REMOVE_PEER RPC failed for tablet 3ad8175aa8b04b6099470077ebb9aea9: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.775971 22952 raft_consensus.cc:515] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.780046 16616 raft_consensus.cc:2468] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
I20260709 13:09:07.781491 22931 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.785828 16544 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 18: Already voted for candidate 59746530bb6d4726893c108602ffac27 in this term.
I20260709 13:09:07.787388 22931 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.801541 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:07.807307 16611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8806363158d645279801d4633a1c7d74" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.809721 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.812644 16611 raft_consensus.cc:3060] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:07.808828 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.812973 16618 raft_consensus.cc:2393] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 12: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:09:07.813755 16616 raft_consensus.cc:2393] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 14: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:09:07.778546 22952 leader_election.cc:290] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:07.823478 16511 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:07.825238 16511 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:07.817442 16367 catalog_manager.cc:5697] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 11 to 12, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 12 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:07.831287 16611 raft_consensus.cc:2468] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
W20260709 13:09:07.834535 17093 leader_election.cc:336] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.835888 17093 leader_election.cc:304] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:07.840152 16511 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.840691 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:07.840754 22964 raft_consensus.cc:2804] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:07.841429 22905 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:07.841459 22964 raft_consensus.cc:697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:07.821000 22933 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.836833 22955 raft_consensus.cc:2804] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:07.848949 22955 raft_consensus.cc:697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:07.850714 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:07.849915 22955 consensus_queue.cc:237] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:07.856462 16614 raft_consensus.cc:2393] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 59746530bb6d4726893c108602ffac27 in current term 18: Already voted for candidate 8e851f11d27b4a83aa395e05c4be6808 in this term.
I20260709 13:09:07.842916 22938 raft_consensus.cc:2804] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:07.859071 22938 raft_consensus.cc:697] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:07.859304 22964 consensus_queue.cc:237] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:07.860060 22938 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:07.896788 16585 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:07.907956 16363 catalog_manager.cc:5697] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 17 to 18, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 18 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:07.934680 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:07.937294 17121 raft_consensus.cc:1275] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:09:07.926173 16361 catalog_manager.cc:5697] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 17 to 18, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 18 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:07.940940 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:07.943634 22946 consensus_queue.cc:1048] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:07.943527 16361 catalog_manager.cc:5697] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 14 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:07.947564 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 111742us
I20260709 13:09:07.964465 22946 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:07.964972 16619 raft_consensus.cc:1275] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:07.983209 17127 raft_consensus.cc:1275] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:09:07.983861 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 49220.2us
W20260709 13:09:07.991623 16511 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.992326 16511 consensus_peers.cc:597] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:07.992720 16511 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:07.993548 16511 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:08.000958 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59746530bb6d4726893c108602ffac27; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:08.004675 22946 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:08.013536 16363 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 14 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.015518 16363 catalog_manager.cc:5697] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 16 to 17, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 17 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:08.000263 16361 catalog_manager.cc:5697] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 15 to 16, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 16 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:08.028060 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9780 after lost signal to thread 15324
W20260709 13:09:08.029484 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08002088a0 after lost signal to thread 16402
W20260709 13:09:08.031093 16399 debug-util.cc:398] Leaking SignalData structure 0x7b0800034e60 after lost signal to thread 16569
W20260709 13:09:08.032612 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef320 after lost signal to thread 16643
I20260709 13:09:08.038316 17122 raft_consensus.cc:1275] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:09:08.039927 22946 consensus_queue.cc:1048] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:09:08.040867 17093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 46941.4us
W20260709 13:09:08.047339 16399 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0160 after lost signal to thread 17151
I20260709 13:09:08.060679 22937 consensus_queue.cc:1048] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:09:08.073820 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.074972 22952 consensus_queue.cc:1048] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:09:08.134613 16511 consensus_peers.cc:597] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.194475 16585 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.195966 17122 raft_consensus.cc:1275] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:09:08.199797 22936 consensus_queue.cc:1048] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:09:08.197134 16511 consensus_peers.cc:597] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.227622 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:08.288187 16614 raft_consensus.cc:1275] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:08.290071 22906 consensus_queue.cc:1048] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:08.292904 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:08.314082 16614 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:08.315689 22955 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:08.365195 16511 consensus_peers.cc:597] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.368554 15321 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16491)
I20260709 13:09:08.373416 16614 raft_consensus.cc:1275] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:09:08.376376 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:08.376601 22955 consensus_queue.cc:1048] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:08.399096 17127 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:08.401389 22931 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:08.405714 16511 consensus_peers.cc:597] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.412906 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.458923 16511 consensus_peers.cc:597] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:08.518599 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.563253 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.707805 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.722551 16511 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.792450 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.818451 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.823695 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:08.846863 16511 consensus_peers.cc:597] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.021744 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.022660 16511 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.026839 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.022687 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.037752 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.044258 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.170531 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.206765 22946 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.207319 22946 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.209425 22946 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.216933 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:09.217695 16618 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:09:09.222625 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:09.223814 22946 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:09.224211 22946 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.224550 22946 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:09.229197 16511 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.229722 16511 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.232167 22946 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.238495 22946 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.242086 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb71b78423ad47fbb40e65fef063a173" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:09.242739 16618 raft_consensus.cc:3060] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:09.253511 16511 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.255998 16618 raft_consensus.cc:2468] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:09:09.267997 22982 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.268596 22982 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:09.276700 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:09.277451 17121 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 13.
W20260709 13:09:09.278558 16585 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.279786 16583 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:09.282070 22936 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:09.282567 22936 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.282948 22936 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:09.270982 22982 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:09.281001 16511 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:09.293553 22946 raft_consensus.cc:2804] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:09.294183 22946 raft_consensus.cc:697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:09.295231 22946 consensus_queue.cc:237] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.313611 22936 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:09.324568 16367 catalog_manager.cc:5697] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 12 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 14 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:09.348860 16585 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.355831 22936 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:09.357067 17121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45e6d6887bf149f9ad8ed2c85503056c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:09.357846 17121 raft_consensus.cc:3060] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:09.369065 15321 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16491)
I20260709 13:09:09.372325 17121 raft_consensus.cc:2468] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 14.
I20260709 13:09:09.377065 16583 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:09.378945 22982 raft_consensus.cc:2804] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:09.379523 22982 raft_consensus.cc:697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:09.380448 22982 consensus_queue.cc:237] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:09.431860 16367 catalog_manager.cc:5697] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 12 to 14, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 14 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.443251 22947 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.443939 22947 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.447147 22947 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.466699 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:09.467422 16618 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 12.
I20260709 13:09:09.468604 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:09.475461 22947 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:09.476215 22947 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.476574 22947 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:09.487797 16511 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.495080 22947 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.503640 22947 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.509249 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58e2513ac115476c9eb7fcddb908cb9b" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:09.512715 16618 raft_consensus.cc:3060] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:09.519959 16618 raft_consensus.cc:2468] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 13.
I20260709 13:09:09.536502 16511 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
W20260709 13:09:09.538296 16511 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.538813 22947 raft_consensus.cc:2804] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:09.543751 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.543864 22947 raft_consensus.cc:697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:09.545163 22947 consensus_queue.cc:237] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:09.548605 16511 consensus_peers.cc:597] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.551322 22946 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.559518 22946 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.561842 22946 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.575666 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:09.576261 16614 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 14.
I20260709 13:09:09.586615 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:09.588467 22946 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:09.588938 22946 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.589339 22946 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.597110 22946 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:09.601261 16511 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.605625 22946 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.617471 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8566128e1c24c7fa1f9894bd8ffdec7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:09.618155 16618 raft_consensus.cc:3060] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:09.635599 16367 catalog_manager.cc:5697] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 11 to 13, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 13 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.636627 16618 raft_consensus.cc:2468] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 15.
W20260709 13:09:09.644672 16511 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.647339 16511 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:09.648427 22947 raft_consensus.cc:2804] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:09.648957 22947 raft_consensus.cc:697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:09.649806 22947 consensus_queue.cc:237] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:09.687685 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.704088 16367 catalog_manager.cc:5697] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 13 to 15, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.728422 22947 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.729126 22947 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.785661 22947 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:09.787539 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:09.788193 16618 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 18.
W20260709 13:09:09.789072 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:09.793493 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:09.802191 22947 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:09.803680 22947 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.804119 22947 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:09.820863 16618 raft_consensus.cc:1275] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:09.827304 22946 consensus_queue.cc:1048] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:09.837462 22947 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.855284 16544 consensus_queue.cc:237] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:09.874990 22947 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 election: Requested vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:09.862519 16511 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.880152 17093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111) [suppressed 402 similar messages]
I20260709 13:09:09.902150 16614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "628b797ac16849cca2b2c6254663f2f7" candidate_uuid: "59746530bb6d4726893c108602ffac27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:09.902832 16614 raft_consensus.cc:3060] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:09.904626 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:09.917834 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.918820 16614 raft_consensus.cc:2468] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59746530bb6d4726893c108602ffac27 in term 19.
W20260709 13:09:09.937145 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:09.927630 16511 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808; no voters: 
I20260709 13:09:09.953344 22931 raft_consensus.cc:2804] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:09.954675 22931 raft_consensus.cc:697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 19 LEADER]: Becoming Leader. State: Replica: 59746530bb6d4726893c108602ffac27, State: Running, Role: LEADER
I20260709 13:09:09.955760 22931 consensus_queue.cc:237] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:09.968652 17121 raft_consensus.cc:1275] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:09:09.971783 22982 consensus_queue.cc:1048] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:09:09.973104 17121 raft_consensus.cc:1275] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:09:09.975018 22946 consensus_queue.cc:1048] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:09.982586 16585 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:09.989929 16511 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:09.990952 16511 consensus_peers.cc:597] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.005218 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.035498 16511 consensus_peers.cc:597] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.041090 16511 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:10.041713 16511 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:10.042145 16511 consensus_peers.cc:597] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.060910 16367 catalog_manager.cc:5697] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 reported cstate change: term changed from 17 to 19, leader changed from 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65) to 59746530bb6d4726893c108602ffac27 (127.14.246.66). New cstate: current_term: 19 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.064693 16614 raft_consensus.cc:1275] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:10.066514 22997 consensus_queue.cc:1048] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:09:10.074239 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:10.095589 16511 consensus_peers.cc:597] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:10.102877 17121 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:10.098274 22997 raft_consensus.cc:2955] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 10 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:10.214635 16614 raft_consensus.cc:1275] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:10.225804 16367 catalog_manager.cc:5697] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c reported cstate change: config changed from index 10 to 12, VOTER 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67) evicted. New cstate: current_term: 15 leader_uuid: "59746530bb6d4726893c108602ffac27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } } }
I20260709 13:09:10.244822 22931 consensus_queue.cc:1048] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:09:10.271440 16606 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ad8175aa8b04b6099470077ebb9aea9 with delete_type TABLET_DATA_TOMBSTONED (TS 8e851f11d27b4a83aa395e05c4be6808 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58162
I20260709 13:09:10.285311 16352 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ad8175aa8b04b6099470077ebb9aea9 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:09:10.305289 23011 tablet_replica.cc:333] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:09:10.325052 16511 consensus_peers.cc:597] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.326681 23011 raft_consensus.cc:2243] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:10.327741 23011 raft_consensus.cc:2272] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:10.343032 23011 ts_tablet_manager.cc:1916] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:09:10.369581 15321 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16491)
I20260709 13:09:10.379628 23011 ts_tablet_manager.cc:1929] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:09:10.380281 23011 log.cc:1199] T 3ad8175aa8b04b6099470077ebb9aea9 P 8e851f11d27b4a83aa395e05c4be6808: Deleting WAL directory at /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/wals/3ad8175aa8b04b6099470077ebb9aea9
I20260709 13:09:10.384143 16355 catalog_manager.cc:5028] TS 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): tablet 3ad8175aa8b04b6099470077ebb9aea9 (table test-workload [id=33f9beb0747545679c040044c30ca602]) successfully deleted
W20260709 13:09:10.435985 16511 consensus_peers.cc:597] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.451274 16585 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.464829 16511 consensus_peers.cc:597] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.536535 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:10.545679 16618 raft_consensus.cc:1275] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Refusing update from remote peer 59746530bb6d4726893c108602ffac27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:09:10.553808 22947 consensus_queue.cc:1048] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:09:10.555972 16511 consensus_peers.cc:597] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:10.594964 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.709527 16585 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.888090 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.900938 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.930619 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:10.936527 16511 consensus_peers.cc:597] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:10.942430 16511 consensus_peers.cc:597] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:11.167760 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.308270 16511 consensus_peers.cc:597] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.324820 16511 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.342116 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.370291 15321 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 16491)
W20260709 13:09:11.379261 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.458140 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.458647 16585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:40627, user_credentials={real_user=slave}} blocked reactor thread for 61036.5us
W20260709 13:09:11.492897 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.495126 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.500942 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.513811 16511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:44347, user_credentials={real_user=slave}} blocked reactor thread for 127349us
W20260709 13:09:11.522013 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.561777 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.576453 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.617285 16511 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.694114 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.722427 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.944216 16511 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:11.985394 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.281646 16511 consensus_peers.cc:597] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.294107 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:12.316359 16511 consensus_peers.cc:597] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.336362 16511 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.344130 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.371959 15321 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 16491)
W20260709 13:09:12.377899 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.385430 16511 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.382447 16585 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.418597 16511 consensus_peers.cc:597] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.508291 16511 consensus_peers.cc:597] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:12.560719 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.591272 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.601491 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:12.603015 16511 consensus_peers.cc:597] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:12.769219 16585 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:12.848387 16511 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:13.051360 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.081187 16511 consensus_peers.cc:597] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:13.081699 16511 consensus_peers.cc:597] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.119302 16511 consensus_peers.cc:597] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.235873 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.270789 16511 consensus_peers.cc:597] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.291720 16511 consensus_peers.cc:597] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:13.354736 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.403741 16511 consensus_peers.cc:597] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.437021 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.499222 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.512353 16585 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:13.571904 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.649226 16511 consensus_peers.cc:597] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.684728 16511 consensus_peers.cc:597] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.722858 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.780282 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.809352 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:13.974268 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:13.993580 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
W20260709 13:09:14.039898 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.104609 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.143949 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.187458 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.231577 16511 consensus_peers.cc:597] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.247466 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.306674 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.503129 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:14.524305 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.557629 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.569972 16511 consensus_peers.cc:597] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.700052 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.734243 16511 consensus_peers.cc:597] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:14.751281 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
W20260709 13:09:14.835716 17090 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.839201 16582 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.854687 16582 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.865798 16582 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.867137 17090 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.879431 16511 consensus_peers.cc:597] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:14.883045 16585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111) [suppressed 453 similar messages]
W20260709 13:09:14.882812 17090 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.900264 16582 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:14.917142 16511 consensus_peers.cc:597] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:15.017807 16511 consensus_peers.cc:597] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:15.031816 17090 consensus_peers.cc:597] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.032169 16511 consensus_peers.cc:597] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:15.041086 17090 consensus_peers.cc:597] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.044438 17090 consensus_peers.cc:597] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.043064 16582 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.059170 16582 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.069459 17090 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.073513 17090 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.113456 17090 consensus_peers.cc:597] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.114248 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:15.114825 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:15.116500 16582 consensus_peers.cc:597] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.121263 16582 consensus_peers.cc:597] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.146612 17090 consensus_peers.cc:597] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.150959 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:15.153302 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:15.182664 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:15.190693 17090 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.184262 16583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:34961, user_credentials={real_user=slave}} blocked reactor thread for 116931us
I20260709 13:09:15.193957 15321 tablet_replica.cc:333] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.195080 15321 raft_consensus.cc:2243] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.196270 15321 raft_consensus.cc:2272] T 18effeb8d3aa4c58bffd8cce4093fd3d P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.209903 16585 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:15.210446 15321 tablet_replica.cc:333] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.211438 15321 raft_consensus.cc:2243] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.214195 15321 raft_consensus.cc:2272] T edc37979fbec49e3beeb0104b9711f73 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.226480 15321 tablet_replica.cc:333] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.228623 15321 raft_consensus.cc:2243] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.230993 15321 raft_consensus.cc:2272] T 14ab75d98ba64a9caa062cd19a0594fb P 59746530bb6d4726893c108602ffac27 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.231475 16511 consensus_peers.cc:597] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:15.237473 15321 tablet_replica.cc:333] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.238323 15321 raft_consensus.cc:2243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.239588 15321 raft_consensus.cc:2272] T 15bb7626d64b480b9966ee39a4d8f1f9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.246831 16582 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.247123 16511 consensus_peers.cc:597] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:15.254884 15321 tablet_replica.cc:333] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.260259 15321 raft_consensus.cc:2243] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.264479 15321 raft_consensus.cc:2272] T 605e831b8c574943b8b259e490e4d208 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.272464 15321 tablet_replica.cc:333] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.273344 15321 raft_consensus.cc:2243] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.284096 15321 raft_consensus.cc:2272] T 628b797ac16849cca2b2c6254663f2f7 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.287528 15321 tablet_replica.cc:333] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.288671 15321 raft_consensus.cc:2243] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.289850 15321 raft_consensus.cc:2272] T facc0e17b2a549b4b071a55d5f7c2167 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.294695 15321 tablet_replica.cc:333] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.303220 15321 raft_consensus.cc:2243] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.305894 15321 raft_consensus.cc:2272] T 9077e45eb7ce4f25a250be02bedafeb4 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.313655 16582 consensus_peers.cc:597] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:15.332377 16511 consensus_peers.cc:597] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:15.346587 15321 tablet_replica.cc:333] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.350164 15321 raft_consensus.cc:2243] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.351938 15321 raft_consensus.cc:2272] T 486137446c7c411e8a8ec3d1dd300579 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.357767 15321 tablet_replica.cc:333] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27: stopping tablet replica
W20260709 13:09:15.369036 16511 consensus_peers.cc:597] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:15.375072 15321 raft_consensus.cc:2243] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.375876 15321 raft_consensus.cc:2272] T 922b28b4b68e4191b6f4e8c9291cd40d P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.380334 15321 tablet_replica.cc:333] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.392532 15321 raft_consensus.cc:2243] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.393823 15321 raft_consensus.cc:2272] T b92bb40598544d8591903d884ef151b0 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.397925 15321 tablet_replica.cc:333] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.416239 15321 raft_consensus.cc:2243] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.418462 15321 raft_consensus.cc:2272] T 3ad8175aa8b04b6099470077ebb9aea9 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.421408 15321 tablet_replica.cc:333] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.429535 15321 raft_consensus.cc:2243] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.432276 15321 raft_consensus.cc:2272] T 9d214c667f1547569798ec88932945a2 P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.444993 15321 tablet_replica.cc:333] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.446372 15321 raft_consensus.cc:2243] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.479225 15321 raft_consensus.cc:2272] T 11dd34f18a6f4fcf882d199ba467c56c P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.506281 16585 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:15.529747 15321 tablet_replica.cc:333] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.531008 15321 raft_consensus.cc:2243] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.531890 15321 raft_consensus.cc:2272] T 343fbc074bb94714900a4da026ab998a P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.535135 15321 tablet_replica.cc:333] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.536183 15321 raft_consensus.cc:2243] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:15.546799 16511 consensus_peers.cc:597] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:15.548941 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:15.563357 15321 raft_consensus.cc:2272] T 866175a9d3d74ca692d4573f642d17a9 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.581337 15321 tablet_replica.cc:333] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.584312 15321 raft_consensus.cc:2243] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.585394 15321 raft_consensus.cc:2272] T df33d6051c004b71a5d0f086053be1fe P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.603219 16511 consensus_peers.cc:597] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:15.613773 15321 tablet_replica.cc:333] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.614915 15321 raft_consensus.cc:2243] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.615897 15321 raft_consensus.cc:2272] T 40ac1479cf4a42f2950de2628057ba50 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.619485 15321 tablet_replica.cc:333] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.622750 15321 raft_consensus.cc:2243] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.625950 15321 raft_consensus.cc:2272] T ad356f899692471d8abda66b7fe01205 P 59746530bb6d4726893c108602ffac27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.633538 15321 tablet_replica.cc:333] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.653234 15321 raft_consensus.cc:2243] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.654654 15321 raft_consensus.cc:2272] T 84545dee228c4faea4411a58c683bb27 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.657718 15321 tablet_replica.cc:333] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.664973 15321 raft_consensus.cc:2243] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.673415 15321 raft_consensus.cc:2272] T 859be0294f7f4761b91b80c75b983562 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.676329 15321 tablet_replica.cc:333] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.677987 15321 raft_consensus.cc:2243] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.679428 15321 raft_consensus.cc:2272] T c2cd1155e69c4429b642e17940dde1e6 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.682497 15321 tablet_replica.cc:333] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.693466 15321 raft_consensus.cc:2243] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.694792 15321 raft_consensus.cc:2272] T 9bf604205a574ee6a5fba699476010ee P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.697906 15321 tablet_replica.cc:333] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.698838 15321 raft_consensus.cc:2243] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.699797 15321 raft_consensus.cc:2272] T 4a96ace5bf484a4eb2288cc869f95f80 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.702864 15321 tablet_replica.cc:333] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.709439 15321 raft_consensus.cc:2243] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.713238 15321 raft_consensus.cc:2272] T 58e2513ac115476c9eb7fcddb908cb9b P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.717990 15321 tablet_replica.cc:333] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.718840 15321 raft_consensus.cc:2243] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.720162 15321 raft_consensus.cc:2272] T e30da0730b354efb9fefd9ef646ce15f P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.723209 15321 tablet_replica.cc:333] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.724174 15321 raft_consensus.cc:2243] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.725390 15321 raft_consensus.cc:2272] T 79efbc85967d4384bfa3825ef0ec5a14 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.743034 15321 tablet_replica.cc:333] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.744134 15321 raft_consensus.cc:2243] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.747134 15321 raft_consensus.cc:2272] T 9a1257c346f6436b83f5cc36b5c04f18 P 59746530bb6d4726893c108602ffac27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.754070 15321 tablet_replica.cc:333] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.755131 15321 raft_consensus.cc:2243] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.756274 15321 raft_consensus.cc:2272] T 92aeb38730a646668d4f528d66afd917 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.759565 15321 tablet_replica.cc:333] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.760506 15321 raft_consensus.cc:2243] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.761857 15321 raft_consensus.cc:2272] T c8566128e1c24c7fa1f9894bd8ffdec7 P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.765007 15321 tablet_replica.cc:333] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.765949 15321 raft_consensus.cc:2243] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.767464 15321 raft_consensus.cc:2272] T eb71b78423ad47fbb40e65fef063a173 P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.770541 15321 tablet_replica.cc:333] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.771438 15321 raft_consensus.cc:2243] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.772140 15321 raft_consensus.cc:2272] T 1137091c3c0e4f76a0e16e0f8076bacb P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.777244 15321 tablet_replica.cc:333] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.778370 15321 raft_consensus.cc:2243] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.780830 15321 raft_consensus.cc:2272] T 4caba52d3ee04ab8b71cd4236ee0ccde P 59746530bb6d4726893c108602ffac27 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.782253 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:15.785239 15321 tablet_replica.cc:333] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.786300 15321 raft_consensus.cc:2243] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.787019 15321 raft_consensus.cc:2272] T 13ae44ac0f4e496caaa8405cb3f946d8 P 59746530bb6d4726893c108602ffac27 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.790179 15321 tablet_replica.cc:333] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.791121 15321 raft_consensus.cc:2243] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.793916 15321 raft_consensus.cc:2272] T 8de1d4f10dad40289b4f0b93992ff9b6 P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:15.795475 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:15.799325 15321 tablet_replica.cc:333] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.800397 15321 raft_consensus.cc:2243] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.802047 15321 raft_consensus.cc:2272] T d994045524f7444ba202d5cf05c49d7f P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.830287 15321 tablet_replica.cc:333] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.831373 15321 raft_consensus.cc:2243] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.835461 15321 raft_consensus.cc:2272] T 400e1c04ef6646108d16357968e6e8d1 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.839797 15321 tablet_replica.cc:333] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.840821 15321 raft_consensus.cc:2243] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.842360 15321 raft_consensus.cc:2272] T 245c53b961134a578f08f960e84a789a P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.845369 15321 tablet_replica.cc:333] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.846328 15321 raft_consensus.cc:2243] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.847640 15321 raft_consensus.cc:2272] T ebc26e5c94524ffe84fdc3e560019f4f P 59746530bb6d4726893c108602ffac27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.852437 15321 tablet_replica.cc:333] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.853549 15321 raft_consensus.cc:2243] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.854875 15321 raft_consensus.cc:2272] T 6689ca00362248ce81b56252a62e85a9 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.871945 15321 tablet_replica.cc:333] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.873045 15321 raft_consensus.cc:2243] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.874054 15321 raft_consensus.cc:2272] T c9e9a6d3e5b24df58aa452e3b70637fc P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.877226 15321 tablet_replica.cc:333] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.878213 15321 raft_consensus.cc:2243] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.879760 15321 raft_consensus.cc:2272] T 8a8afa934df14d3bb3e773c41ab520ec P 59746530bb6d4726893c108602ffac27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.884930 15321 tablet_replica.cc:333] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.895215 15321 raft_consensus.cc:2243] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.896569 15321 raft_consensus.cc:2272] T 53c1c59c7dab4ee3afd08075f673c2c8 P 59746530bb6d4726893c108602ffac27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.899689 15321 tablet_replica.cc:333] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.900552 15321 raft_consensus.cc:2243] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:15.901901 15321 raft_consensus.cc:2272] T 3274c86d23d641758f36e812f849be43 P 59746530bb6d4726893c108602ffac27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:15.907748 15321 tablet_replica.cc:333] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27: stopping tablet replica
I20260709 13:09:15.909752 15321 raft_consensus.cc:2243] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:15.910576 15321 raft_consensus.cc:2272] T 74c0af8eb7234215a518fd144bd450af P 59746530bb6d4726893c108602ffac27 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:16.002701 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:16.050357 16585 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:16.169492 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.177637 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.187551 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.190346 23035 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.191004 23035 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:16.201148 17090 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.202585 23035 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:16.203920 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:16.209227 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:16.217394 23035 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.222369 23035 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.222976 23035 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:16.230854 17090 leader_election.cc:336] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.237720 23035 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.254843 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.258994 17093 leader_election.cc:336] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.259505 17093 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.260211 23035 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:16.276485 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.346575 23038 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.347112 23038 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:16.357040 16582 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.359531 23038 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.362457 16585 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.363545 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.364812 23038 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:16.408962 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.409039 23038 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.409668 23038 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.411757 23038 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:16.414983 23037 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.418579 23037 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.420990 23037 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:16.423086 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:16.423830 17127 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 9.
I20260709 13:09:16.426373 16583 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
W20260709 13:09:16.427071 16582 leader_election.cc:336] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.430423 16582 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.431470 16585 leader_election.cc:336] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.431998 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.433398 23037 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:16.434294 23038 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:16.434789 23038 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.435329 23038 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:16.445433 23038 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:16.466784 16582 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.468976 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ab75d98ba64a9caa062cd19a0594fb" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:16.469609 17127 raft_consensus.cc:3060] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:16.483779 17127 raft_consensus.cc:2468] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 10.
I20260709 13:09:16.468356 23038 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:16.486001 16583 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:16.488382 23038 raft_consensus.cc:2804] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:16.493342 23038 raft_consensus.cc:697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:16.494431 23038 consensus_queue.cc:237] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:16.495267 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.534089 16363 catalog_manager.cc:5697] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 9 to 10, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 10 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.540372 23038 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.551281 23038 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.555286 23038 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.558496 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:16.561787 16585 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:16.569240 16582 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.569818 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.571759 23037 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:16.626513 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.659255 23035 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.661661 23036 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.662425 23036 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.660079 23035 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.668435 23036 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:16.670583 23035 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:16.674288 23035 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.675402 23035 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.677176 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
W20260709 13:09:16.683280 17090 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.683904 17090 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.692840 17093 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:16.694950 23036 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:16.682233 23035 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.698657 17090 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.694084 17093 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.709697 17093 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:16.707648 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.710747 23036 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:16.722892 17093 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.723380 17093 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.723913 23036 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.725049 23036 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.726356 23048 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:16.729894 23037 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.730623 23037 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.733443 23037 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.737565 16582 leader_election.cc:336] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.738618 17090 leader_election.cc:336] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.753096 23037 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.753773 23037 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.762216 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:16.762653 23036 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:16.763500 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:16.764394 23051 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.762435 23037 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.767156 16582 leader_election.cc:336] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.768519 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.789740 23037 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:09:16.790298 16585 leader_election.cc:336] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.790252 23037 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.790863 16585 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.791774 23038 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:16.792328 23037 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:09:16.792138 16585 leader_election.cc:336] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.792992 16585 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.793648 23037 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:16.793582 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:16.794476 17122 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 11.
W20260709 13:09:16.797914 16582 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.798874 16583 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:16.799851 23037 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:16.800212 23037 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.800556 23037 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.807843 23038 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.808173 23037 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.808473 23038 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.810866 23038 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.817831 16582 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.818315 16582 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.820462 16585 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.820894 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.821764 23038 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:16.824153 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b92bb40598544d8591903d884ef151b0" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:16.824837 17122 raft_consensus.cc:3060] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:16.824867 23037 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:16.833710 17122 raft_consensus.cc:2468] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 12.
I20260709 13:09:16.836282 16583 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:16.837296 23038 raft_consensus.cc:2804] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:16.837790 23038 raft_consensus.cc:697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:16.838717 23038 consensus_queue.cc:237] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.869002 16363 catalog_manager.cc:5697] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 11 to 12, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 12 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.870443 23037 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.871006 23037 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:16.873215 23037 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:16.881069 16582 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.883492 16585 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:16.883934 16585 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:16.885043 23038 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:16.906828 16582 consensus_peers.cc:597] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:16.937094 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:16.969254 23051 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.969806 23051 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.972003 23051 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:16.973920 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:16.975557 23050 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.976099 23050 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.978170 23050 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:16.980522 23042 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.980584 23037 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
W20260709 13:09:16.980522 17090 leader_election.cc:336] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.981175 23042 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.981594 17090 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:16.981302 23037 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:16.983143 23048 raft_consensus.cc:2749] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:16.983361 23042 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:16.985695 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:16.986295 16618 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
W20260709 13:09:16.987013 17090 leader_election.cc:336] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.989452 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:09:16.989975 16582 leader_election.cc:336] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:16.990512 16582 leader_election.cc:336] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:16.983402 23037 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:16.991055 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:16.991849 17122 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 15.
I20260709 13:09:16.992940 23050 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:16.993363 23050 raft_consensus.cc:493] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:16.993717 23050 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.000612 17127 raft_consensus.cc:1275] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:17.000946 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:17.002182 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:17.002921 23042 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:17.003360 23042 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.004664 23042 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.023054 23038 consensus_queue.cc:1048] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:17.024855 23048 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.025386 23048 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:17.026714 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:17.033617 17090 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.034490 23035 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.035053 23035 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.027606 23048 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:17.035485 23038 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.036175 23038 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:17.037452 23035 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:17.040602 23038 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:17.042455 17090 leader_election.cc:336] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:17.042990 16585 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:17.046613 16582 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.047027 16582 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.048095 23038 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:17.056725 23035 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.057279 23035 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:17.059160 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.020277 23050 raft_consensus.cc:515] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:17.065411 17090 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.059278 23035 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:17.066005 17122 raft_consensus.cc:2393] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e851f11d27b4a83aa395e05c4be6808 in current term 17: Already voted for candidate 98881185daee4f13b69385e36026216c in this term.
W20260709 13:09:17.070463 17093 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:17.074368 15321 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16566)
I20260709 13:09:17.078362 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.079177 23035 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:17.076711 23042 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:17.075343 17090 leader_election.cc:336] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.073807 23050 leader_election.cc:290] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:17.085040 16583 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:17.085875 23037 raft_consensus.cc:3060] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:17.092936 16582 leader_election.cc:336] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.094996 23037 raft_consensus.cc:2749] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:17.112080 16582 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.118062 23038 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.118618 23038 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.120852 23038 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
W20260709 13:09:17.126688 16582 leader_election.cc:336] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.128616 23042 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:17.143508 16618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf604205a574ee6a5fba699476010ee" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:17.147650 23037 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.148273 23037 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:17.149168 23050 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.149705 23050 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.151582 23037 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:17.151597 23050 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:17.154423 16585 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:17.156298 17090 leader_election.cc:336] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.156785 16618 raft_consensus.cc:2468] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
W20260709 13:09:17.158587 16582 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.159017 16582 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.159653 23037 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:17.163281 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd34f18a6f4fcf882d199ba467c56c" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:17.163883 17122 raft_consensus.cc:3060] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:17.171505 17122 raft_consensus.cc:2468] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 16.
I20260709 13:09:17.175958 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
W20260709 13:09:17.178391 17093 leader_election.cc:336] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:17.179864 17093 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.180675 23050 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:17.180862 17093 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:17.181314 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.184783 23050 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:17.202360 16583 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:17.203686 23054 raft_consensus.cc:2804] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:17.204469 23054 raft_consensus.cc:697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:17.205200 23050 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.205387 23054 consensus_queue.cc:237] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.205741 23050 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.207896 23050 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:17.212127 17090 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.218369 16583 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 98881185daee4f13b69385e36026216c
I20260709 13:09:17.219552 23037 raft_consensus.cc:2749] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:17.223007 17093 leader_election.cc:304] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:09:17.228489 17090 consensus_peers.cc:597] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.231791 23037 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.232378 23037 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.234555 23037 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:17.239051 23036 raft_consensus.cc:2804] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:09:17.239351 16582 leader_election.cc:336] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.239646 23036 raft_consensus.cc:697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:17.240638 23036 consensus_queue.cc:237] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.244987 23050 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.245525 23050 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.247491 23050 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:17.254048 17090 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.263298 16363 catalog_manager.cc:5697] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 17, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.292616 16363 catalog_manager.cc:5697] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 15 to 16, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 16 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:17.300192 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:17.324724 17127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c" is_pre_election: true
I20260709 13:09:17.325366 17127 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 17.
W20260709 13:09:17.336894 17093 leader_election.cc:336] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:17.337340 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.338044 23036 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:17.340577 16582 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.349040 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:17.350692 23037 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:17.351097 23037 raft_consensus.cc:493] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.351459 23037 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:09:17.363364 17090 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.363655 16582 consensus_peers.cc:597] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.363214 17093 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:17.364534 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.365607 23051 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:17.366601 17093 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:17.368603 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:17.369318 23051 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:17.381063 23037 raft_consensus.cc:515] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:17.391053 16582 leader_election.cc:336] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:17.391322 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.393464 23036 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.393731 23037 leader_election.cc:290] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 98881185daee4f13b69385e36026216c (127.14.246.68:34961)
I20260709 13:09:17.394007 23036 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.396101 23036 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:17.396811 17122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d994045524f7444ba202d5cf05c49d7f" candidate_uuid: "8e851f11d27b4a83aa395e05c4be6808" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "98881185daee4f13b69385e36026216c"
I20260709 13:09:17.397375 17122 raft_consensus.cc:3060] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:17.397593 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808" is_pre_election: true
I20260709 13:09:17.398190 16619 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 16.
W20260709 13:09:17.399730 17090 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.401079 17093 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 
I20260709 13:09:17.401801 23036 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:17.402141 23036 raft_consensus.cc:493] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:17.402462 23036 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:17.406129 17090 leader_election.cc:336] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:17.406459 17122 raft_consensus.cc:2468] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e851f11d27b4a83aa395e05c4be6808 in term 18.
I20260709 13:09:17.410905 17121 raft_consensus.cc:1275] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:17.412460 23036 raft_consensus.cc:515] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.417408 23037 consensus_queue.cc:1048] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:17.422506 17090 leader_election.cc:336] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:17.427480 17090 consensus_peers.cc:597] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.430455 16583 leader_election.cc:304] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
I20260709 13:09:17.431255 23036 leader_election.cc:290] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Requested vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:17.432600 16619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3274c86d23d641758f36e812f849be43" candidate_uuid: "98881185daee4f13b69385e36026216c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8e851f11d27b4a83aa395e05c4be6808"
I20260709 13:09:17.433182 16619 raft_consensus.cc:3060] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:17.433971 23038 raft_consensus.cc:2804] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:09:17.434499 23038 raft_consensus.cc:697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 18 LEADER]: Becoming Leader. State: Replica: 8e851f11d27b4a83aa395e05c4be6808, State: Running, Role: LEADER
I20260709 13:09:17.435415 23038 consensus_queue.cc:237] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.442899 16619 raft_consensus.cc:2468] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98881185daee4f13b69385e36026216c in term 17.
I20260709 13:09:17.444033 17093 leader_election.cc:304] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808, 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27
W20260709 13:09:17.445590 16582 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.446041 23051 raft_consensus.cc:2804] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:17.453972 23051 raft_consensus.cc:697] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Becoming Leader. State: Replica: 98881185daee4f13b69385e36026216c, State: Running, Role: LEADER
I20260709 13:09:17.456051 23051 consensus_queue.cc:237] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:17.493258 16363 catalog_manager.cc:5697] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 reported cstate change: term changed from 17 to 18, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67). New cstate: current_term: 18 leader_uuid: "8e851f11d27b4a83aa395e05c4be6808" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:17.502182 16582 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.522558 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:17.524144 17090 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.529330 16582 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.531809 17090 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.540472 16367 catalog_manager.cc:5697] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c reported cstate change: term changed from 16 to 17, leader changed from 59746530bb6d4726893c108602ffac27 (127.14.246.66) to 98881185daee4f13b69385e36026216c (127.14.246.68). New cstate: current_term: 17 leader_uuid: "98881185daee4f13b69385e36026216c" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:17.588243 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:17.613462 16582 consensus_peers.cc:597] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.618008 16585 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:17.628221 16618 raft_consensus.cc:1275] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:09:17.630357 16582 consensus_peers.cc:597] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.633128 17090 consensus_peers.cc:597] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:17.639197 23036 consensus_queue.cc:1048] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:09:17.663499 16582 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.698351 17090 consensus_peers.cc:597] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.711745 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.722957 17121 raft_consensus.cc:1275] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:17.725211 23038 consensus_queue.cc:1048] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:09:17.741360 17090 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.751379 17090 consensus_peers.cc:597] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.762125 16582 consensus_peers.cc:597] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.770678 16582 consensus_peers.cc:597] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.775187 16585 consensus_peers.cc:597] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:17.793339 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:17.866460 16619 raft_consensus.cc:1275] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Refusing update from remote peer 98881185daee4f13b69385e36026216c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:09:17.868392 23035 consensus_queue.cc:1048] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:09:17.890246 17122 raft_consensus.cc:1275] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Refusing update from remote peer 8e851f11d27b4a83aa395e05c4be6808: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:09:17.892459 23042 consensus_queue.cc:1048] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [LEADER]: Connected to new peer: Peer: permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:09:17.966375 17090 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.970709 17090 consensus_peers.cc:597] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:17.971282 17090 consensus_peers.cc:597] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:17.981814 16582 consensus_peers.cc:597] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:18.072638 16582 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:18.190722 16585 consensus_peers.cc:597] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.299921 23067 raft_consensus.cc:493] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.300540 23067 raft_consensus.cc:515] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.302717 23067 leader_election.cc:290] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.319371 16585 leader_election.cc:336] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:18.321696 16582 leader_election.cc:336] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.323747 16582 leader_election.cc:304] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:18.326555 23048 raft_consensus.cc:493] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.326598 23067 raft_consensus.cc:2749] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:18.327171 23048 raft_consensus.cc:515] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:18.329552 23048 leader_election.cc:290] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.333268 17090 leader_election.cc:336] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.406247 23067 raft_consensus.cc:493] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.406780 23067 raft_consensus.cc:515] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.408851 23067 leader_election.cc:290] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.418812 16582 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:18.419579 16585 leader_election.cc:336] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:18.420007 16585 leader_election.cc:304] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:18.421205 23048 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.422026 23048 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:18.423075 23067 raft_consensus.cc:2749] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:18.440447 17090 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.441308 23048 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:18.531487 23067 raft_consensus.cc:493] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.532068 23067 raft_consensus.cc:515] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.534358 23037 raft_consensus.cc:493] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.534904 23037 raft_consensus.cc:515] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.543458 23037 leader_election.cc:290] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.548799 16585 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:18.549355 16582 leader_election.cc:336] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.549824 23067 leader_election.cc:290] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.570257 16585 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:18.571132 16585 leader_election.cc:336] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:18.572904 16585 leader_election.cc:304] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:18.573963 16585 consensus_peers.cc:597] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:18.574450 23067 raft_consensus.cc:2749] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:18.572355 16582 leader_election.cc:336] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.585840 16582 leader_election.cc:304] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:18.588160 23067 raft_consensus.cc:2749] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:18.612695 16585 consensus_peers.cc:597] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:18.642858 16585 consensus_peers.cc:597] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:18.653167 16585 consensus_peers.cc:597] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.653970 23036 raft_consensus.cc:493] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.654531 23036 raft_consensus.cc:515] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:18.656556 23036 leader_election.cc:290] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.662159 17090 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.752808 23037 raft_consensus.cc:493] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.753481 23037 raft_consensus.cc:515] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.755800 23037 leader_election.cc:290] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.777088 16585 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:18.779574 23048 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.780125 23048 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:18.782073 23048 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:18.786991 17090 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:18.797824 16582 leader_election.cc:336] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.798511 16582 leader_election.cc:304] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:18.799685 23037 raft_consensus.cc:2749] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:18.834617 16585 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.856088 23036 raft_consensus.cc:493] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.856853 23036 raft_consensus.cc:515] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:18.859315 23036 leader_election.cc:290] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:18.862432 23037 raft_consensus.cc:493] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.862990 23037 raft_consensus.cc:515] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:18.863528 17090 leader_election.cc:336] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:18.870173 16585 leader_election.cc:336] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:18.889765 16582 leader_election.cc:336] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:18.890955 23037 leader_election.cc:290] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:18.891505 16582 leader_election.cc:304] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:18.899860 23037 raft_consensus.cc:2749] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:18.919889 16585 consensus_peers.cc:597] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:18.987900 23037 raft_consensus.cc:493] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:18.988435 23037 raft_consensus.cc:515] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:18.990317 23037 leader_election.cc:290] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:19.002065 16585 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:19.013149 16585 consensus_peers.cc:597] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:19.022701 16582 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:19.023960 16585 leader_election.cc:336] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.024470 16585 leader_election.cc:304] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.027626 23067 raft_consensus.cc:2749] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:19.035681 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:19.052922 17093 leader_election.cc:336] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.056834 17093 leader_election.cc:304] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.057965 23036 raft_consensus.cc:2749] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:19.060747 17093 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.061270 17093 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.062037 23036 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:19.072108 17093 leader_election.cc:336] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.072659 17093 leader_election.cc:304] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.085852 23036 raft_consensus.cc:2749] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:19.087496 17093 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.106768 17093 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:19.107419 16585 consensus_peers.cc:597] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:19.111583 23036 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:19.112603 17093 leader_election.cc:336] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.114753 17093 leader_election.cc:304] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.115545 23036 raft_consensus.cc:2749] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.173180 23036 raft_consensus.cc:493] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.173794 23036 raft_consensus.cc:515] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:19.181386 17090 leader_election.cc:336] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:19.182200 23036 leader_election.cc:290] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:19.182968 23036 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.183521 23036 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:19.200927 17090 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:19.208194 23036 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:19.224687 16582 consensus_peers.cc:597] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:19.261883 23037 raft_consensus.cc:493] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.262513 23037 raft_consensus.cc:515] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
W20260709 13:09:19.269634 16582 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:19.273196 23048 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.273908 23048 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:19.276072 23048 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:19.277774 23037 leader_election.cc:290] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:19.295470 23067 raft_consensus.cc:493] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.296066 23067 raft_consensus.cc:515] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } }
I20260709 13:09:19.298117 23067 leader_election.cc:290] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:19.314139 16585 leader_election.cc:336] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.318225 16585 leader_election.cc:304] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.324357 23037 raft_consensus.cc:2749] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:19.326315 16582 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:19.334478 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
W20260709 13:09:19.336748 17090 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:19.356353 16585 consensus_peers.cc:597] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:19.357066 16585 leader_election.cc:336] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.357547 16585 leader_election.cc:304] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e851f11d27b4a83aa395e05c4be6808; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.358775 23037 raft_consensus.cc:2749] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:19.361466 23036 raft_consensus.cc:493] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:19.362041 23036 raft_consensus.cc:515] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:19.372418 23036 leader_election.cc:290] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:19.386822 17093 leader_election.cc:336] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:19.389384 17090 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:19.387820 17093 leader_election.cc:304] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.391462 23048 raft_consensus.cc:2749] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:19.392715 17093 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.393334 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.394212 23048 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:19.550235 17093 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.553673 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.556556 23036 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:19.550951 16585 consensus_peers.cc:597] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:19.567554 16582 consensus_peers.cc:597] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:19.637638 17093 leader_election.cc:336] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:19.638411 17093 leader_election.cc:304] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:19.639365 23036 raft_consensus.cc:2749] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:19.643640 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:19.664844 17090 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.681370 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
W20260709 13:09:19.749035 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.774590 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:19.775846 15321 tablet_replica.cc:333] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.777017 15321 raft_consensus.cc:2243] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.777941 15321 raft_consensus.cc:2272] T 7735d77d64e14457985553596120e4cc P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.781940 15321 tablet_replica.cc:333] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.782876 15321 raft_consensus.cc:2243] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.789907 17090 consensus_peers.cc:597] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.791294 15321 raft_consensus.cc:2272] T ab144bc0671c46e6807f89d495e66473 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.794241 15321 tablet_replica.cc:333] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.795231 15321 raft_consensus.cc:2243] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.795991 15321 raft_consensus.cc:2272] T edc37979fbec49e3beeb0104b9711f73 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.798803 15321 tablet_replica.cc:333] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.799717 15321 raft_consensus.cc:2243] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.800838 15321 raft_consensus.cc:2272] T 18effeb8d3aa4c58bffd8cce4093fd3d P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.803556 15321 tablet_replica.cc:333] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.804419 15321 raft_consensus.cc:2243] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.805054 15321 raft_consensus.cc:2272] T facc0e17b2a549b4b071a55d5f7c2167 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.807883 15321 tablet_replica.cc:333] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.808861 15321 raft_consensus.cc:2243] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.810349 15321 raft_consensus.cc:2272] T deb27cdf9e08471584fe7bce6bffd303 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.813647 15321 tablet_replica.cc:333] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.814575 15321 raft_consensus.cc:2243] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.815711 15321 raft_consensus.cc:2272] T c9e9a6d3e5b24df58aa452e3b70637fc P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.822515 15321 tablet_replica.cc:333] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.824692 15321 raft_consensus.cc:2243] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.825256 17093 consensus_peers.cc:597] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.829214 15321 raft_consensus.cc:2272] T 14ab75d98ba64a9caa062cd19a0594fb P 8e851f11d27b4a83aa395e05c4be6808 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.831969 15321 tablet_replica.cc:333] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.832943 15321 raft_consensus.cc:2243] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.833658 15321 raft_consensus.cc:2272] T 9077e45eb7ce4f25a250be02bedafeb4 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.836795 15321 tablet_replica.cc:333] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.837704 15321 raft_consensus.cc:2243] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.838662 15321 raft_consensus.cc:2272] T 486137446c7c411e8a8ec3d1dd300579 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.841718 15321 tablet_replica.cc:333] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.842578 15321 raft_consensus.cc:2243] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.843226 15321 raft_consensus.cc:2272] T 1fec5040680744828ce3ed1844be1ac1 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.847123 15321 tablet_replica.cc:333] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.847990 15321 raft_consensus.cc:2243] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.849493 15321 raft_consensus.cc:2272] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.850670 17093 consensus_peers.cc:597] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.852293 15321 tablet_replica.cc:333] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.853266 15321 raft_consensus.cc:2243] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.854737 15321 raft_consensus.cc:2272] T b92bb40598544d8591903d884ef151b0 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.857476 15321 tablet_replica.cc:333] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:09:19.863519 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:19.864209 15321 raft_consensus.cc:2243] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.869261 17093 consensus_peers.cc:597] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.864980 15321 raft_consensus.cc:2272] T 9d214c667f1547569798ec88932945a2 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.872560 15321 tablet_replica.cc:333] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.873353 15321 raft_consensus.cc:2243] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.874538 15321 raft_consensus.cc:2272] T 11dd34f18a6f4fcf882d199ba467c56c P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.876952 15321 tablet_replica.cc:333] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.878284 15321 raft_consensus.cc:2243] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.879827 15321 raft_consensus.cc:2272] T 11c1a9d5e3dd45d7a937a9954de478cc P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.882643 15321 tablet_replica.cc:333] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.883949 15321 raft_consensus.cc:2243] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.884603 15321 raft_consensus.cc:2272] T 343fbc074bb94714900a4da026ab998a P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.887394 15321 tablet_replica.cc:333] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.888190 15321 raft_consensus.cc:2243] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.888631 16582 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111) [suppressed 606 similar messages]
I20260709 13:09:19.891723 15321 raft_consensus.cc:2272] T 630ca4cf8bd64907bf8c82149ab5afb9 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.892922 16582 consensus_peers.cc:597] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.894430 15321 tablet_replica.cc:333] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.895316 15321 raft_consensus.cc:2243] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.896070 15321 raft_consensus.cc:2272] T 866175a9d3d74ca692d4573f642d17a9 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.898641 15321 tablet_replica.cc:333] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.899406 15321 raft_consensus.cc:2243] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.900417 15321 raft_consensus.cc:2272] T 5eccbd91402541c4bb6edc9c47f3cf8f P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.910856 15321 tablet_replica.cc:333] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.911652 15321 raft_consensus.cc:2243] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.912320 15321 raft_consensus.cc:2272] T c8566128e1c24c7fa1f9894bd8ffdec7 P 8e851f11d27b4a83aa395e05c4be6808 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.915319 15321 tablet_replica.cc:333] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.916283 15321 raft_consensus.cc:2243] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:19.929067 17090 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.929677 15321 raft_consensus.cc:2272] T 9a1257c346f6436b83f5cc36b5c04f18 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.934830 15321 tablet_replica.cc:333] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.938230 15321 raft_consensus.cc:2243] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.938902 15321 raft_consensus.cc:2272] T 8806363158d645279801d4633a1c7d74 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.942435 15321 tablet_replica.cc:333] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.943390 15321 raft_consensus.cc:2243] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.943974 15321 raft_consensus.cc:2272] T 9bf604205a574ee6a5fba699476010ee P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.946432 15321 tablet_replica.cc:333] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.947256 15321 raft_consensus.cc:2243] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.948342 15321 raft_consensus.cc:2272] T 79efbc85967d4384bfa3825ef0ec5a14 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.950925 15321 tablet_replica.cc:333] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.951666 15321 raft_consensus.cc:2243] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.952307 15321 raft_consensus.cc:2272] T 58e2513ac115476c9eb7fcddb908cb9b P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.954933 15321 tablet_replica.cc:333] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.955704 15321 raft_consensus.cc:2243] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.956739 15321 raft_consensus.cc:2272] T 8de1d4f10dad40289b4f0b93992ff9b6 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.957369 16585 consensus_peers.cc:597] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:19.965411 15321 tablet_replica.cc:333] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:09:19.966257 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:19.966495 17090 consensus_peers.cc:597] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.966264 15321 raft_consensus.cc:2243] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.972121 17093 consensus_peers.cc:597] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:19.970857 15321 raft_consensus.cc:2272] T 1137091c3c0e4f76a0e16e0f8076bacb P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.975409 15321 tablet_replica.cc:333] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.976229 15321 raft_consensus.cc:2243] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:19.976902 15321 raft_consensus.cc:2272] T 400e1c04ef6646108d16357968e6e8d1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:19.980278 15321 tablet_replica.cc:333] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.981108 15321 raft_consensus.cc:2243] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:19.982324 15321 raft_consensus.cc:2272] T ebc26e5c94524ffe84fdc3e560019f4f P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:19.983909 17090 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.993793 15321 tablet_replica.cc:333] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:19.995494 15321 raft_consensus.cc:2243] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:09:19.997329 16582 consensus_peers.cc:597] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:19.998184 15321 raft_consensus.cc:2272] T 45e6d6887bf149f9ad8ed2c85503056c P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.001627 15321 tablet_replica.cc:333] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:09:20.004848 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:20.005359 17093 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:20.005561 15321 raft_consensus.cc:2243] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.007514 15321 raft_consensus.cc:2272] T 40ac1479cf4a42f2950de2628057ba50 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.014155 15321 tablet_replica.cc:333] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.015978 15321 raft_consensus.cc:2243] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.017475 15321 raft_consensus.cc:2272] T d0499df31d9f40178fb10011eef7ece6 P 8e851f11d27b4a83aa395e05c4be6808 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.025456 15321 tablet_replica.cc:333] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.027281 15321 raft_consensus.cc:2243] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.028749 15321 raft_consensus.cc:2272] T 84545dee228c4faea4411a58c683bb27 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.029758 17090 consensus_peers.cc:597] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:20.032594 15321 tablet_replica.cc:333] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
W20260709 13:09:20.039227 17090 consensus_peers.cc:597] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.046732 17090 consensus_peers.cc:597] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:20.045039 15321 raft_consensus.cc:2243] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.048597 15321 raft_consensus.cc:2272] T 4021ce342efc430996265ce4a5a65e87 P 8e851f11d27b4a83aa395e05c4be6808 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.058008 17093 consensus_peers.cc:597] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.061374 17093 consensus_peers.cc:597] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:20.066015 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.068534 15321 tablet_replica.cc:333] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.069482 15321 raft_consensus.cc:2243] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.070655 15321 raft_consensus.cc:2272] T 4a96ace5bf484a4eb2288cc869f95f80 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.073318 15321 tablet_replica.cc:333] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.074112 15321 raft_consensus.cc:2243] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.074734 15321 raft_consensus.cc:2272] T eb71b78423ad47fbb40e65fef063a173 P 8e851f11d27b4a83aa395e05c4be6808 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.079780 17093 consensus_peers.cc:597] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.082263 15321 tablet_replica.cc:333] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.083129 15321 raft_consensus.cc:2243] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.084537 15321 raft_consensus.cc:2272] T 8a8afa934df14d3bb3e773c41ab520ec P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.087246 15321 tablet_replica.cc:333] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.088819 15321 raft_consensus.cc:2243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.090020 15321 raft_consensus.cc:2272] T b6c87fc9474b4fd2806ea6a4c1104e22 P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.092872 15321 tablet_replica.cc:333] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.094775 15321 raft_consensus.cc:2243] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:09:20.098183 17090 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:20.098829 15321 raft_consensus.cc:2272] T d994045524f7444ba202d5cf05c49d7f P 8e851f11d27b4a83aa395e05c4be6808 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.106248 17093 consensus_peers.cc:597] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.109290 17093 consensus_peers.cc:597] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:20.110486 15321 tablet_replica.cc:333] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.111297 15321 raft_consensus.cc:2243] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.112062 15321 raft_consensus.cc:2272] T 3274c86d23d641758f36e812f849be43 P 8e851f11d27b4a83aa395e05c4be6808 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.114782 15321 tablet_replica.cc:333] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.115482 15321 raft_consensus.cc:2243] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:20.116086 15321 raft_consensus.cc:2272] T 628b797ac16849cca2b2c6254663f2f7 P 8e851f11d27b4a83aa395e05c4be6808 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.118067 16582 consensus_peers.cc:597] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:20.118857 15321 tablet_replica.cc:333] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.119630 15321 raft_consensus.cc:2243] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.120738 15321 raft_consensus.cc:2272] T 605e831b8c574943b8b259e490e4d208 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:20.123373 15321 tablet_replica.cc:333] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808: stopping tablet replica
I20260709 13:09:20.124030 15321 raft_consensus.cc:2243] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:20.125109 15321 raft_consensus.cc:2272] T 43cea492ee7e4f91b2ad509449c832f1 P 8e851f11d27b4a83aa395e05c4be6808 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:20.167152 17090 consensus_peers.cc:597] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:20.226279 17093 consensus_peers.cc:597] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.228760 17090 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.259578 17093 consensus_peers.cc:597] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c -> Peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Couldn't send request to peer 8e851f11d27b4a83aa395e05c4be6808. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.273037 17090 consensus_peers.cc:597] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:20.415179 17093 consensus_peers.cc:597] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:20.481346 17093 consensus_peers.cc:597] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:20.588995 17093 consensus_peers.cc:597] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:20.665330 17090 consensus_peers.cc:597] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c -> Peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Couldn't send request to peer 59746530bb6d4726893c108602ffac27. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:20.830500 17093 consensus_peers.cc:597] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:20.864522 17093 consensus_peers.cc:597] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:20.901223 23068 raft_consensus.cc:493] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:20.901821 23068 raft_consensus.cc:515] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:20.903818 23068 leader_election.cc:290] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:20.911499 17090 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:20.921444 23068 raft_consensus.cc:493] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:20.921995 23068 raft_consensus.cc:515] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:20.924028 23068 leader_election.cc:290] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
W20260709 13:09:20.928792 17090 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:20.935371 17093 leader_election.cc:336] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:20.936187 17093 leader_election.cc:304] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:20.937024 23068 raft_consensus.cc:2749] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:20.942910 17093 leader_election.cc:336] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:20.943409 17093 leader_election.cc:304] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:20.944180 23068 raft_consensus.cc:2749] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:20.961478 23068 raft_consensus.cc:493] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:20.961994 23068 raft_consensus.cc:515] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:20.964035 23068 leader_election.cc:290] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:20.968160 23068 raft_consensus.cc:493] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:20.968779 23068 raft_consensus.cc:515] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:20.971009 23068 leader_election.cc:290] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:20.988833 17093 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:20.990366 17093 leader_election.cc:336] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:20.991044 17093 leader_election.cc:336] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:20.991544 17093 leader_election.cc:304] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:20.992328 23068 raft_consensus.cc:2749] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:20.993317 17093 leader_election.cc:336] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:20.993769 17093 leader_election.cc:304] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:20.994485 23068 raft_consensus.cc:2749] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:21.099283 17093 consensus_peers.cc:597] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:21.125159 23068 raft_consensus.cc:493] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.125701 23068 raft_consensus.cc:515] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.127632 23068 leader_election.cc:290] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:21.137213 17093 leader_election.cc:336] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:21.137898 17093 leader_election.cc:336] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.138309 17093 leader_election.cc:304] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.139000 23068 raft_consensus.cc:2749] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:21.177752 23068 raft_consensus.cc:493] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.178337 23068 raft_consensus.cc:515] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.183648 23048 raft_consensus.cc:493] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.180439 23071 raft_consensus.cc:493] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.185063 23071 raft_consensus.cc:515] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.187001 23071 leader_election.cc:290] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:21.184249 23048 raft_consensus.cc:515] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } attrs { replace: true } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.196650 23048 leader_election.cc:290] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:21.192866 23068 leader_election.cc:290] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:21.194303 17090 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:21.203712 17090 leader_election.cc:336] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:21.206800 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:09:21.211175 23068 raft_consensus.cc:493] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:21.211798 23068 raft_consensus.cc:515] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.213930 23068 leader_election.cc:290] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:21.214982 23068 raft_consensus.cc:493] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:21.215517 23068 raft_consensus.cc:515] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.218850 23068 leader_election.cc:290] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:21.220934 23072 raft_consensus.cc:493] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 59746530bb6d4726893c108602ffac27)
I20260709 13:09:21.224968 23072 raft_consensus.cc:515] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.227160 23072 leader_election.cc:290] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367)
I20260709 13:09:21.220036 23048 raft_consensus.cc:493] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.224076 23071 raft_consensus.cc:493] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.227802 23048 raft_consensus.cc:515] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.228143 23071 raft_consensus.cc:515] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.229847 23048 leader_election.cc:290] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:21.230417 23071 leader_election.cc:290] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:21.234943 17093 leader_election.cc:336] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.235543 17093 leader_election.cc:304] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.236552 23072 raft_consensus.cc:2749] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:21.237538 17090 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:21.238178 17090 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:21.238606 17093 leader_election.cc:336] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
W20260709 13:09:21.239091 17093 leader_election.cc:336] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.239463 17093 leader_election.cc:304] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:09:21.240821 17093 leader_election.cc:336] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.240351 23068 raft_consensus.cc:2749] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:21.241235 17093 leader_election.cc:304] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
W20260709 13:09:21.242035 17093 leader_election.cc:336] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.242506 23072 raft_consensus.cc:2749] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:21.242774 17093 leader_election.cc:336] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
W20260709 13:09:21.245244 17090 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:21.245550 17093 leader_election.cc:304] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
W20260709 13:09:21.245791 17090 leader_election.cc:336] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
W20260709 13:09:21.246439 17093 leader_election.cc:336] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.246264 23068 raft_consensus.cc:2749] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:21.246896 17093 leader_election.cc:304] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:21.249006 23068 raft_consensus.cc:2749] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:21.254308 17093 leader_election.cc:336] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
W20260709 13:09:21.254926 17093 leader_election.cc:336] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.255517 17093 leader_election.cc:304] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.257886 23068 raft_consensus.cc:2749] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:21.259348 17093 leader_election.cc:336] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.259846 17093 leader_election.cc:304] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 6f34f184d0dd4382bee8790b4c077d05
I20260709 13:09:21.260640 23068 raft_consensus.cc:2749] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:21.261797 17093 leader_election.cc:336] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.262283 17093 leader_election.cc:304] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.263053 23068 raft_consensus.cc:2749] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:21.266635 23068 raft_consensus.cc:493] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.267174 23068 raft_consensus.cc:515] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
W20260709 13:09:21.274362 17090 leader_election.cc:336] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:21.275601 23068 leader_election.cc:290] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:21.283027 23068 raft_consensus.cc:493] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.283574 23068 raft_consensus.cc:515] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.286172 23068 leader_election.cc:290] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:21.293372 23068 raft_consensus.cc:493] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.294066 23068 raft_consensus.cc:515] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6f34f184d0dd4382bee8790b4c077d05" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 40627 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.296305 23068 leader_election.cc:290] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:21.292685 17093 leader_election.cc:336] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.296995 17093 leader_election.cc:304] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.298755 23068 raft_consensus.cc:2749] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:21.311398 17093 leader_election.cc:336] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
W20260709 13:09:21.312600 17093 leader_election.cc:336] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.313030 17093 leader_election.cc:304] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.317655 23068 raft_consensus.cc:2749] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:09:21.320868 17093 leader_election.cc:336] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
W20260709 13:09:21.321520 17093 leader_election.cc:336] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111)
I20260709 13:09:21.321913 17093 leader_election.cc:304] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 6f34f184d0dd4382bee8790b4c077d05, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.322680 23068 raft_consensus.cc:2749] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:21.340139 23068 raft_consensus.cc:493] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.340687 23068 raft_consensus.cc:515] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.343078 23068 leader_election.cc:290] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
W20260709 13:09:21.348430 17090 leader_election.cc:336] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:21.362015 15321 tablet_server.cc:179] TabletServer@127.14.246.68:0 shutting down...
W20260709 13:09:21.369839 17093 leader_election.cc:336] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.370450 17093 leader_election.cc:304] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.371184 23068 raft_consensus.cc:2749] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:21.438642 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:21.441404 15321 tablet_replica.cc:333] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.442371 15321 raft_consensus.cc:2243] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.443114 15321 raft_consensus.cc:2272] T 3ad8175aa8b04b6099470077ebb9aea9 P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.446427 15321 tablet_replica.cc:333] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.447567 15321 raft_consensus.cc:2243] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.448318 15321 raft_consensus.cc:2272] T b92bb40598544d8591903d884ef151b0 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.451419 15321 tablet_replica.cc:333] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.452582 15321 raft_consensus.cc:2243] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.453481 15321 raft_consensus.cc:2272] T 630ca4cf8bd64907bf8c82149ab5afb9 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.456915 15321 tablet_replica.cc:333] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.457792 15321 raft_consensus.cc:2243] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.458604 15321 raft_consensus.cc:2272] T ad356f899692471d8abda66b7fe01205 P 98881185daee4f13b69385e36026216c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.465346 15321 tablet_replica.cc:333] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.466238 15321 raft_consensus.cc:2243] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.467041 15321 raft_consensus.cc:2272] T ab144bc0671c46e6807f89d495e66473 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.470191 15321 tablet_replica.cc:333] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.471042 15321 raft_consensus.cc:2243] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.472273 15321 raft_consensus.cc:2272] T 3274c86d23d641758f36e812f849be43 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.475204 15321 tablet_replica.cc:333] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.476032 15321 raft_consensus.cc:2243] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.476958 15321 raft_consensus.cc:2272] T 14ab75d98ba64a9caa062cd19a0594fb P 98881185daee4f13b69385e36026216c [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.480276 15321 tablet_replica.cc:333] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.481127 15321 raft_consensus.cc:2243] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.481911 15321 raft_consensus.cc:2272] T 43cea492ee7e4f91b2ad509449c832f1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.485037 15321 tablet_replica.cc:333] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.485877 15321 raft_consensus.cc:2243] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.486497 15321 raft_consensus.cc:2272] T 6689ca00362248ce81b56252a62e85a9 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.489289 15321 tablet_replica.cc:333] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.490144 15321 raft_consensus.cc:2243] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.491065 15321 raft_consensus.cc:2272] T 1fec5040680744828ce3ed1844be1ac1 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.494077 15321 tablet_replica.cc:333] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.494961 15321 raft_consensus.cc:2243] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.496088 15321 raft_consensus.cc:2272] T 8de1d4f10dad40289b4f0b93992ff9b6 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.498869 23072 raft_consensus.cc:493] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8e851f11d27b4a83aa395e05c4be6808)
I20260709 13:09:21.501416 23072 raft_consensus.cc:515] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "59746530bb6d4726893c108602ffac27" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 37367 } } peers { permanent_uuid: "8e851f11d27b4a83aa395e05c4be6808" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 44347 } } peers { permanent_uuid: "98881185daee4f13b69385e36026216c" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 34961 } attrs { promote: false } }
I20260709 13:09:21.503583 23072 leader_election.cc:290] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367), 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347)
I20260709 13:09:21.500934 15321 tablet_replica.cc:333] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.504951 15321 raft_consensus.cc:2243] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.505613 15321 raft_consensus.cc:2272] T 11dd34f18a6f4fcf882d199ba467c56c P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.508093 17090 leader_election.cc:336] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 59746530bb6d4726893c108602ffac27 (127.14.246.66:37367): Network error: Client connection negotiation failed: client connection to 127.14.246.66:37367: connect: Connection refused (error 111)
I20260709 13:09:21.508200 15321 tablet_replica.cc:333] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.510142 15321 raft_consensus.cc:2243] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:21.510241 17093 consensus_peers.cc:597] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c -> Peer 6f34f184d0dd4382bee8790b4c077d05 (127.14.246.65:40627): Couldn't send request to peer 6f34f184d0dd4382bee8790b4c077d05. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:40627: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:21.510893 15321 raft_consensus.cc:2272] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.512077 23072 raft_consensus.cc:670] T d994045524f7444ba202d5cf05c49d7f P 98881185daee4f13b69385e36026216c: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
W20260709 13:09:21.514793 17093 leader_election.cc:336] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8e851f11d27b4a83aa395e05c4be6808 (127.14.246.67:44347): Network error: Client connection negotiation failed: client connection to 127.14.246.67:44347: connect: Connection refused (error 111)
I20260709 13:09:21.515252 17093 leader_election.cc:304] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 98881185daee4f13b69385e36026216c; no voters: 59746530bb6d4726893c108602ffac27, 8e851f11d27b4a83aa395e05c4be6808
I20260709 13:09:21.516314 23068 raft_consensus.cc:2749] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:21.515296 15321 tablet_replica.cc:333] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.518335 15321 raft_consensus.cc:2243] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.520021 15321 raft_consensus.cc:2272] T 4021ce342efc430996265ce4a5a65e87 P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.522630 15321 tablet_replica.cc:333] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.523501 15321 raft_consensus.cc:2243] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.524231 15321 raft_consensus.cc:2272] T 8a8afa934df14d3bb3e773c41ab520ec P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.526947 15321 tablet_replica.cc:333] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.527639 15321 raft_consensus.cc:2243] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.528401 15321 raft_consensus.cc:2272] T b6c87fc9474b4fd2806ea6a4c1104e22 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.530871 15321 tablet_replica.cc:333] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.531620 15321 raft_consensus.cc:2243] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.532240 15321 raft_consensus.cc:2272] T deb27cdf9e08471584fe7bce6bffd303 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.535383 15321 tablet_replica.cc:333] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.536177 15321 raft_consensus.cc:2243] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.536876 15321 raft_consensus.cc:2272] T 245c53b961134a578f08f960e84a789a P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.539664 15321 tablet_replica.cc:333] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.540356 15321 raft_consensus.cc:2243] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.540951 15321 raft_consensus.cc:2272] T 5eccbd91402541c4bb6edc9c47f3cf8f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.543452 15321 tablet_replica.cc:333] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.544220 15321 raft_consensus.cc:2243] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.544797 15321 raft_consensus.cc:2272] T 4caba52d3ee04ab8b71cd4236ee0ccde P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.547215 15321 tablet_replica.cc:333] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.547951 15321 raft_consensus.cc:2243] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.548970 15321 raft_consensus.cc:2272] T 866175a9d3d74ca692d4573f642d17a9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.551364 15321 tablet_replica.cc:333] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.552078 15321 raft_consensus.cc:2243] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.553148 15321 raft_consensus.cc:2272] T 343fbc074bb94714900a4da026ab998a P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.555754 15321 tablet_replica.cc:333] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.556458 15321 raft_consensus.cc:2243] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.557566 15321 raft_consensus.cc:2272] T 55e23c7e0edd4ed18d5cf6b93c2b1607 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.560230 15321 tablet_replica.cc:333] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.561642 15321 raft_consensus.cc:2243] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.562712 15321 raft_consensus.cc:2272] T 74c0af8eb7234215a518fd144bd450af P 98881185daee4f13b69385e36026216c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.565284 15321 tablet_replica.cc:333] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.566039 15321 raft_consensus.cc:2243] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.566749 15321 raft_consensus.cc:2272] T 45e6d6887bf149f9ad8ed2c85503056c P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.569484 15321 tablet_replica.cc:333] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.570349 15321 raft_consensus.cc:2243] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.570955 15321 raft_consensus.cc:2272] T ebc26e5c94524ffe84fdc3e560019f4f P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.574478 15321 tablet_replica.cc:333] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.575206 15321 raft_consensus.cc:2243] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.576416 15321 raft_consensus.cc:2272] T d0499df31d9f40178fb10011eef7ece6 P 98881185daee4f13b69385e36026216c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.579025 15321 tablet_replica.cc:333] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.579707 15321 raft_consensus.cc:2243] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.580749 15321 raft_consensus.cc:2272] T 9a1257c346f6436b83f5cc36b5c04f18 P 98881185daee4f13b69385e36026216c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.583179 15321 tablet_replica.cc:333] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.583927 15321 raft_consensus.cc:2243] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.584581 15321 raft_consensus.cc:2272] T 15bb7626d64b480b9966ee39a4d8f1f9 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.587334 15321 tablet_replica.cc:333] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.588027 15321 raft_consensus.cc:2243] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.589036 15321 raft_consensus.cc:2272] T df33d6051c004b71a5d0f086053be1fe P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.591514 15321 tablet_replica.cc:333] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.592185 15321 raft_consensus.cc:2243] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.593187 15321 raft_consensus.cc:2272] T 922b28b4b68e4191b6f4e8c9291cd40d P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.595670 15321 tablet_replica.cc:333] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.596359 15321 raft_consensus.cc:2243] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.596951 15321 raft_consensus.cc:2272] T 53c1c59c7dab4ee3afd08075f673c2c8 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.599450 15321 tablet_replica.cc:333] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.600162 15321 raft_consensus.cc:2243] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.601153 15321 raft_consensus.cc:2272] T 13ae44ac0f4e496caaa8405cb3f946d8 P 98881185daee4f13b69385e36026216c [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.603585 15321 tablet_replica.cc:333] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.604342 15321 raft_consensus.cc:2243] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.605934 15321 raft_consensus.cc:2272] T 400e1c04ef6646108d16357968e6e8d1 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.608440 15321 tablet_replica.cc:333] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.609210 15321 raft_consensus.cc:2243] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.610244 15321 raft_consensus.cc:2272] T 7735d77d64e14457985553596120e4cc P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.612730 15321 tablet_replica.cc:333] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.613445 15321 raft_consensus.cc:2243] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.614121 15321 raft_consensus.cc:2272] T e30da0730b354efb9fefd9ef646ce15f P 98881185daee4f13b69385e36026216c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.616510 15321 tablet_replica.cc:333] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.617214 15321 raft_consensus.cc:2243] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.618309 15321 raft_consensus.cc:2272] T 92aeb38730a646668d4f528d66afd917 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.621115 15321 tablet_replica.cc:333] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.621799 15321 raft_consensus.cc:2243] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.622290 15321 raft_consensus.cc:2272] T 486137446c7c411e8a8ec3d1dd300579 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.624857 15321 tablet_replica.cc:333] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.625552 15321 raft_consensus.cc:2243] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.626196 15321 raft_consensus.cc:2272] T 11c1a9d5e3dd45d7a937a9954de478cc P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.629182 15321 tablet_replica.cc:333] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.629851 15321 raft_consensus.cc:2243] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.630352 15321 raft_consensus.cc:2272] T c2cd1155e69c4429b642e17940dde1e6 P 98881185daee4f13b69385e36026216c [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.632911 15321 tablet_replica.cc:333] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.633630 15321 raft_consensus.cc:2243] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.634800 15321 raft_consensus.cc:2272] T 8806363158d645279801d4633a1c7d74 P 98881185daee4f13b69385e36026216c [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.637338 15321 tablet_replica.cc:333] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.638063 15321 raft_consensus.cc:2243] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.639163 15321 raft_consensus.cc:2272] T 859be0294f7f4761b91b80c75b983562 P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.641994 15321 tablet_replica.cc:333] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.642669 15321 raft_consensus.cc:2243] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.643389 15321 raft_consensus.cc:2272] T 4a96ace5bf484a4eb2288cc869f95f80 P 98881185daee4f13b69385e36026216c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.646242 15321 tablet_replica.cc:333] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c: stopping tablet replica
I20260709 13:09:21.646826 15321 raft_consensus.cc:2243] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.647945 15321 raft_consensus.cc:2272] T 9bf604205a574ee6a5fba699476010ee P 98881185daee4f13b69385e36026216c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.848711 17148 debug-util.cc:398] Leaking SignalData structure 0x7b080037c340 after lost signal to thread 15324
W20260709 13:09:22.849844 17148 debug-util.cc:398] Leaking SignalData structure 0x7b08002b61c0 after lost signal to thread 16402
W20260709 13:09:22.880514 15321 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17148)
I20260709 13:09:23.743484 15321 tablet_server.cc:196] TabletServer@127.14.246.68:0 shutdown complete.
I20260709 13:09:23.813918 15321 master.cc:562] Master@127.14.246.126:40851 shutting down...
W20260709 13:09:23.847358 16416 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:23.847635 16416 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:23.847838 16416 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:09:23.851095 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:23.851634 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:23.851959 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P e0b8327892f143ffba83cd5a4c97d808: stopping tablet replica
I20260709 13:09:24.019265 15321 master.cc:584] Master@127.14.246.126:40851 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (211965 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:24.138526 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:38585
I20260709 13:09:24.139690 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.145156 23074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.145471 23075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.147100 23077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.150624 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:24.153769 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.153959 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.154155 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602564154123 us; error 0 us; skew 500 ppm
I20260709 13:09:24.154680 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.157078 15321 webserver.cc:533] Webserver started at http://127.14.246.126:41097/ using document root <none> and password file <none>
I20260709 13:09:24.157553 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.157734 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:24.158022 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:24.159318 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "e871ff198e1c459ba6940bae570a0172"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.163702 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:09:24.166920 23082 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.167618 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:24.167919 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "e871ff198e1c459ba6940bae570a0172"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.168211 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.197430 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.198640 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.237788 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:38585
I20260709 13:09:24.237888 23133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:38585 every 8 connection(s)
I20260709 13:09:24.242024 23134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:24.252938 23134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: Bootstrap starting.
I20260709 13:09:24.257630 23134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:24.261910 23134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: No bootstrap required, opened a new log
I20260709 13:09:24.264041 23134 raft_consensus.cc:359] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER }
I20260709 13:09:24.264518 23134 raft_consensus.cc:385] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:24.264752 23134 raft_consensus.cc:740] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e871ff198e1c459ba6940bae570a0172, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.265381 23134 consensus_queue.cc:260] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER }
I20260709 13:09:24.265877 23134 raft_consensus.cc:399] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:24.266117 23134 raft_consensus.cc:493] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:24.266410 23134 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:24.270767 23134 raft_consensus.cc:515] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER }
I20260709 13:09:24.271255 23134 leader_election.cc:304] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e871ff198e1c459ba6940bae570a0172; no voters: 
I20260709 13:09:24.272372 23134 leader_election.cc:290] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:24.272675 23137 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:24.274044 23137 raft_consensus.cc:697] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 1 LEADER]: Becoming Leader. State: Replica: e871ff198e1c459ba6940bae570a0172, State: Running, Role: LEADER
I20260709 13:09:24.274732 23137 consensus_queue.cc:237] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER }
I20260709 13:09:24.275319 23134 sys_catalog.cc:565] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:24.281178 23138 sys_catalog.cc:455] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e871ff198e1c459ba6940bae570a0172" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER } }
I20260709 13:09:24.281421 23139 sys_catalog.cc:455] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e871ff198e1c459ba6940bae570a0172. Latest consensus state: current_term: 1 leader_uuid: "e871ff198e1c459ba6940bae570a0172" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e871ff198e1c459ba6940bae570a0172" member_type: VOTER } }
I20260709 13:09:24.281919 23138 sys_catalog.cc:458] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:24.282023 23139 sys_catalog.cc:458] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:24.284060 23146 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:24.289654 23146 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:24.290761 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:24.298280 23146 catalog_manager.cc:1383] Generated new cluster ID: ac393a439adc435ca4ff0c8366c39378
I20260709 13:09:24.298556 23146 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:24.327041 23146 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:24.328405 23146 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:24.341053 23146 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: Generated new TSK 0
I20260709 13:09:24.341625 23146 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:24.357563 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.364020 23155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.365532 23156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.367717 15321 server_base.cc:1061] running on GCE node
W20260709 13:09:24.368125 23158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.370270 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.370460 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.370577 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602564370566 us; error 0 us; skew 500 ppm
I20260709 13:09:24.371054 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.373304 15321 webserver.cc:533] Webserver started at http://127.14.246.65:36959/ using document root <none> and password file <none>
I20260709 13:09:24.373747 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.373900 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:24.374102 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:24.375207 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "d4e47dfe9e4043b28804f74ca6320c78"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.379650 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:24.383023 23163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.383775 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:24.384106 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "d4e47dfe9e4043b28804f74ca6320c78"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.384409 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.422919 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.424129 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.425618 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:24.427990 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:24.428222 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.428459 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:24.428646 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.470124 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:43229
I20260709 13:09:24.470280 23225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:43229 every 8 connection(s)
I20260709 13:09:24.475289 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.482367 23230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.483330 23231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.487387 23233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.488345 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:24.488584 23226 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38585
I20260709 13:09:24.489076 23226 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:24.489871 23226 heartbeater.cc:507] Master 127.14.246.126:38585 requested a full tablet report, sending...
I20260709 13:09:24.490640 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.490906 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.491098 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602564491083 us; error 0 us; skew 500 ppm
I20260709 13:09:24.491719 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.492045 23099 ts_manager.cc:194] Registered new tserver with Master: d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:24.494099 23099 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38474
I20260709 13:09:24.494489 15321 webserver.cc:533] Webserver started at http://127.14.246.66:44357/ using document root <none> and password file <none>
I20260709 13:09:24.495015 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.495213 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:24.495532 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:24.496853 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "11d20799306e481286363a5ec8b35c0a"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.501129 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:09:24.504333 23238 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.505134 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:24.505427 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "11d20799306e481286363a5ec8b35c0a"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.505710 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.519271 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.520452 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.521943 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:24.524080 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:24.524299 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.524533 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:24.524701 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.565253 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:41655
I20260709 13:09:24.565376 23300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:41655 every 8 connection(s)
I20260709 13:09:24.570322 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.577761 23304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.579708 23305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.580873 23307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.581199 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:24.582173 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.582437 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.582645 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602564582627 us; error 0 us; skew 500 ppm
I20260709 13:09:24.583393 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.583647 23301 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38585
I20260709 13:09:24.584100 23301 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:24.585139 23301 heartbeater.cc:507] Master 127.14.246.126:38585 requested a full tablet report, sending...
I20260709 13:09:24.586362 15321 webserver.cc:533] Webserver started at http://127.14.246.67:42693/ using document root <none> and password file <none>
I20260709 13:09:24.587042 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.587273 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:24.587486 23099 ts_manager.cc:194] Registered new tserver with Master: 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:24.587594 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:24.589259 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.589469 23099 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38488
I20260709 13:09:24.594425 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:24.597833 23312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.598582 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:24.598884 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.599148 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.625499 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.626739 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.628247 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:24.630473 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:24.630679 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.630949 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:24.631109 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.671931 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:39801
I20260709 13:09:24.672040 23374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:39801 every 8 connection(s)
I20260709 13:09:24.676900 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:24.683573 23378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:24.686554 23379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.690219 23375 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38585
I20260709 13:09:24.690759 23375 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:24.691124 15321 server_base.cc:1061] running on GCE node
W20260709 13:09:24.691732 23381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:24.691736 23375 heartbeater.cc:507] Master 127.14.246.126:38585 requested a full tablet report, sending...
I20260709 13:09:24.692858 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:24.693146 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:24.693385 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602564693366 us; error 0 us; skew 500 ppm
I20260709 13:09:24.694092 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:24.694108 23099 ts_manager.cc:194] Registered new tserver with Master: 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:24.695955 23099 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38502
I20260709 13:09:24.696933 15321 webserver.cc:533] Webserver started at http://127.14.246.68:38497/ using document root <none> and password file <none>
I20260709 13:09:24.697556 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:24.697762 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:24.698048 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:24.699158 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-3-root/instance:
uuid: "d522b0c35d264310bd559b320098c16e"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.703809 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:09:24.707017 23386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.707834 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:24.708124 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
uuid: "d522b0c35d264310bd559b320098c16e"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:24.708429 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:24.728104 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:24.729388 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:24.730859 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:24.733124 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:24.733361 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.733608 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:24.733805 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:24.776362 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.68:35951
I20260709 13:09:24.776479 23448 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.68:35951 every 8 connection(s)
I20260709 13:09:24.789924 23449 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38585
I20260709 13:09:24.790306 23449 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:24.791201 23449 heartbeater.cc:507] Master 127.14.246.126:38585 requested a full tablet report, sending...
I20260709 13:09:24.793071 23099 ts_manager.cc:194] Registered new tserver with Master: d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:24.794183 15321 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014713743s
I20260709 13:09:24.794603 23099 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38514
I20260709 13:09:24.819949 23099 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38530:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:25.083992 23191 tablet_service.cc:1511] Processing CreateTablet for tablet 53b5776737c44f0399308aa71ba91184 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:25.085461 23191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b5776737c44f0399308aa71ba91184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.087080 23339 tablet_service.cc:1511] Processing CreateTablet for tablet 4d07f94d31084ca4bec1714d2cd152fd (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:25.087535 23190 tablet_service.cc:1511] Processing CreateTablet for tablet f6c678249de84b02a478517fcded93af (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:25.088218 23414 tablet_service.cc:1511] Processing CreateTablet for tablet 53b5776737c44f0399308aa71ba91184 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:25.089772 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b5776737c44f0399308aa71ba91184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.090018 23189 tablet_service.cc:1511] Processing CreateTablet for tablet 4d07f94d31084ca4bec1714d2cd152fd (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:25.090018 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 8aef9e8c7d8e4e56965d01215b5f0768 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:25.091528 23413 tablet_service.cc:1511] Processing CreateTablet for tablet 4d07f94d31084ca4bec1714d2cd152fd (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:25.092031 23190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c678249de84b02a478517fcded93af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.093011 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d07f94d31084ca4bec1714d2cd152fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.092852 23409 tablet_service.cc:1511] Processing CreateTablet for tablet f7455f72bcbd4d8cb403b4f335ff13ff (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:25.093293 23336 tablet_service.cc:1511] Processing CreateTablet for tablet f033a61414134e12ae93c9445436d714 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:25.095211 23410 tablet_service.cc:1511] Processing CreateTablet for tablet f033a61414134e12ae93c9445436d714 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:25.095831 23335 tablet_service.cc:1511] Processing CreateTablet for tablet f7455f72bcbd4d8cb403b4f335ff13ff (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:25.100991 23185 tablet_service.cc:1511] Processing CreateTablet for tablet f83e8fdc5de04a6fb00f47aa53ebbed7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:25.103772 23186 tablet_service.cc:1511] Processing CreateTablet for tablet f033a61414134e12ae93c9445436d714 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:25.106468 23340 tablet_service.cc:1511] Processing CreateTablet for tablet f6c678249de84b02a478517fcded93af (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:25.109192 23408 tablet_service.cc:1511] Processing CreateTablet for tablet 3c011e03361b480dae81285f6f09ef6a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:25.110440 23184 tablet_service.cc:1511] Processing CreateTablet for tablet 3c011e03361b480dae81285f6f09ef6a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:25.113410 23407 tablet_service.cc:1511] Processing CreateTablet for tablet b896a6b74a8d4fc5bb8edddae5e03d75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:25.115944 23183 tablet_service.cc:1511] Processing CreateTablet for tablet b896a6b74a8d4fc5bb8edddae5e03d75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:25.121613 23406 tablet_service.cc:1511] Processing CreateTablet for tablet 20f9f863d03148f0b2feb977248ef1f6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:25.099268 23412 tablet_service.cc:1511] Processing CreateTablet for tablet 8aef9e8c7d8e4e56965d01215b5f0768 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:25.099332 23188 tablet_service.cc:1511] Processing CreateTablet for tablet 911cc153131d47afb20dbc71912f94b3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:25.096743 23410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f033a61414134e12ae93c9445436d714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.126528 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c011e03361b480dae81285f6f09ef6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.130193 23182 tablet_service.cc:1511] Processing CreateTablet for tablet 75e295bcfea248c8a36d4b46b0c6f55a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:25.098052 23411 tablet_service.cc:1511] Processing CreateTablet for tablet 1f465bb48c534740ae364e2ffd6d61b6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:25.133576 23411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f465bb48c534740ae364e2ffd6d61b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.134034 23405 tablet_service.cc:1511] Processing CreateTablet for tablet ea08dc522141433e9b0d27a794aacdb0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:25.135504 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7455f72bcbd4d8cb403b4f335ff13ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.092027 23337 tablet_service.cc:1511] Processing CreateTablet for tablet 911cc153131d47afb20dbc71912f94b3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:25.137012 23412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aef9e8c7d8e4e56965d01215b5f0768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.098065 23187 tablet_service.cc:1511] Processing CreateTablet for tablet 1f465bb48c534740ae364e2ffd6d61b6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:25.140193 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f9f863d03148f0b2feb977248ef1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.141069 23407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b896a6b74a8d4fc5bb8edddae5e03d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.144030 23334 tablet_service.cc:1511] Processing CreateTablet for tablet f83e8fdc5de04a6fb00f47aa53ebbed7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:25.145319 23332 tablet_service.cc:1511] Processing CreateTablet for tablet 20f9f863d03148f0b2feb977248ef1f6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:25.146370 23333 tablet_service.cc:1511] Processing CreateTablet for tablet b896a6b74a8d4fc5bb8edddae5e03d75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:25.088660 23339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d07f94d31084ca4bec1714d2cd152fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.148757 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7455f72bcbd4d8cb403b4f335ff13ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.148651 23331 tablet_service.cc:1511] Processing CreateTablet for tablet 75e295bcfea248c8a36d4b46b0c6f55a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:25.149732 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b896a6b74a8d4fc5bb8edddae5e03d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.150436 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911cc153131d47afb20dbc71912f94b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.151157 23334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83e8fdc5de04a6fb00f47aa53ebbed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.156193 23331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e295bcfea248c8a36d4b46b0c6f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.160532 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f9f863d03148f0b2feb977248ef1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.097214 23189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d07f94d31084ca4bec1714d2cd152fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.165613 23187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f465bb48c534740ae364e2ffd6d61b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.166280 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911cc153131d47afb20dbc71912f94b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.172660 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea08dc522141433e9b0d27a794aacdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.177269 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f033a61414134e12ae93c9445436d714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.181180 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e295bcfea248c8a36d4b46b0c6f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.185310 23185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83e8fdc5de04a6fb00f47aa53ebbed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.189105 23183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b896a6b74a8d4fc5bb8edddae5e03d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.204893 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c678249de84b02a478517fcded93af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.208218 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c011e03361b480dae81285f6f09ef6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.221097 23336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f033a61414134e12ae93c9445436d714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.245271 23191 tablet_service.cc:1511] Processing CreateTablet for tablet e81908a1bb6847ce8ffb498f00f3d1cb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:25.247360 23191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81908a1bb6847ce8ffb498f00f3d1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.249696 23190 tablet_service.cc:1511] Processing CreateTablet for tablet ea08dc522141433e9b0d27a794aacdb0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:25.255488 23409 tablet_service.cc:1511] Processing CreateTablet for tablet edd2ca63fc294d39be8e4f0973531faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:25.272226 23335 tablet_service.cc:1511] Processing CreateTablet for tablet e81908a1bb6847ce8ffb498f00f3d1cb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:25.275807 23337 tablet_service.cc:1511] Processing CreateTablet for tablet edd2ca63fc294d39be8e4f0973531faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:25.307188 23259 tablet_service.cc:1511] Processing CreateTablet for tablet 3c011e03361b480dae81285f6f09ef6a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:25.308564 23259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c011e03361b480dae81285f6f09ef6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.281425 23340 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf352d9d7274a9fbbde27bf171e5a3e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:25.285315 23468 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:25.286677 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:25.295693 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 53b5776737c44f0399308aa71ba91184 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:25.297452 23265 tablet_service.cc:1511] Processing CreateTablet for tablet f6c678249de84b02a478517fcded93af (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:25.299194 23264 tablet_service.cc:1511] Processing CreateTablet for tablet 8aef9e8c7d8e4e56965d01215b5f0768 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:25.300935 23263 tablet_service.cc:1511] Processing CreateTablet for tablet 911cc153131d47afb20dbc71912f94b3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:25.302692 23262 tablet_service.cc:1511] Processing CreateTablet for tablet 1f465bb48c534740ae364e2ffd6d61b6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:25.261845 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2ca63fc294d39be8e4f0973531faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.304435 23261 tablet_service.cc:1511] Processing CreateTablet for tablet f7455f72bcbd4d8cb403b4f335ff13ff (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:25.309895 23260 tablet_service.cc:1511] Processing CreateTablet for tablet f83e8fdc5de04a6fb00f47aa53ebbed7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:25.319487 23258 tablet_service.cc:1511] Processing CreateTablet for tablet 20f9f863d03148f0b2feb977248ef1f6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:25.314149 23190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea08dc522141433e9b0d27a794aacdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.280865 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aef9e8c7d8e4e56965d01215b5f0768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.320792 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911cc153131d47afb20dbc71912f94b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.326851 23257 tablet_service.cc:1511] Processing CreateTablet for tablet 75e295bcfea248c8a36d4b46b0c6f55a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:25.327957 23469 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:25.315148 23410 tablet_service.cc:1511] Processing CreateTablet for tablet e81908a1bb6847ce8ffb498f00f3d1cb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:25.333120 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81908a1bb6847ce8ffb498f00f3d1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.336930 23470 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:25.337546 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53b5776737c44f0399308aa71ba91184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.346154 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf352d9d7274a9fbbde27bf171e5a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.350993 23414 tablet_service.cc:1511] Processing CreateTablet for tablet daf723b2744f41baae3607813b1f7741 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:25.366556 23331 tablet_service.cc:1511] Processing CreateTablet for tablet daf723b2744f41baae3607813b1f7741 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:25.367880 23188 tablet_service.cc:1511] Processing CreateTablet for tablet daf723b2744f41baae3607813b1f7741 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:25.369060 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f465bb48c534740ae364e2ffd6d61b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.370393 23408 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccc079d27d04f62bf9dc344d9bdb606 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:25.371750 23182 tablet_service.cc:1511] Processing CreateTablet for tablet 22bfe0a296bd470997118a3f31d9b0de (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:25.373095 23257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e295bcfea248c8a36d4b46b0c6f55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.373656 23332 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccc079d27d04f62bf9dc344d9bdb606 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:25.374842 23258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f9f863d03148f0b2feb977248ef1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.379959 23470 tablet_bootstrap.cc:654] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.381160 23261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7455f72bcbd4d8cb403b4f335ff13ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.381816 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c678249de84b02a478517fcded93af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.382407 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf723b2744f41baae3607813b1f7741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.382925 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aef9e8c7d8e4e56965d01215b5f0768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.381783 23187 tablet_service.cc:1511] Processing CreateTablet for tablet f828fc0c2eb24ed09da6ab517095131d (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:25.384311 23334 tablet_service.cc:1511] Processing CreateTablet for tablet f828fc0c2eb24ed09da6ab517095131d (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:25.367949 23331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf723b2744f41baae3607813b1f7741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.405093 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2ca63fc294d39be8e4f0973531faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.411856 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccc079d27d04f62bf9dc344d9bdb606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.369053 23184 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf352d9d7274a9fbbde27bf171e5a3e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:25.414280 23410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81908a1bb6847ce8ffb498f00f3d1cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.415369 23405 tablet_service.cc:1511] Processing CreateTablet for tablet 5f56852691524f04b8d536bd41ae154a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:25.416690 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f56852691524f04b8d536bd41ae154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.381074 23413 tablet_service.cc:1511] Processing CreateTablet for tablet 22bfe0a296bd470997118a3f31d9b0de (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:25.393069 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bfe0a296bd470997118a3f31d9b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.418864 23185 tablet_service.cc:1511] Processing CreateTablet for tablet 5f56852691524f04b8d536bd41ae154a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:25.386596 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83e8fdc5de04a6fb00f47aa53ebbed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.396091 23333 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9304058a34b12bfa74024fb2c7221 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:25.420213 23185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f56852691524f04b8d536bd41ae154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.417244 23334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828fc0c2eb24ed09da6ab517095131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.430624 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccc079d27d04f62bf9dc344d9bdb606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.433053 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9304058a34b12bfa74024fb2c7221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.437106 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bfe0a296bd470997118a3f31d9b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.440929 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf352d9d7274a9fbbde27bf171e5a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.446355 23186 tablet_service.cc:1511] Processing CreateTablet for tablet 58075f57a8b740fb8e4e030ce9f9fef3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:25.447463 23468 tablet_bootstrap.cc:654] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.447640 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58075f57a8b740fb8e4e030ce9f9fef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.449679 23189 tablet_service.cc:1511] Processing CreateTablet for tablet 33887f114a444f56904e9b07cebf538a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:25.450951 23189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33887f114a444f56904e9b07cebf538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.453137 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daf723b2744f41baae3607813b1f7741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.458792 23411 tablet_service.cc:1511] Processing CreateTablet for tablet 33887f114a444f56904e9b07cebf538a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:25.460132 23411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33887f114a444f56904e9b07cebf538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.425007 23469 tablet_bootstrap.cc:654] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.465197 23265 tablet_service.cc:1511] Processing CreateTablet for tablet ea08dc522141433e9b0d27a794aacdb0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:25.466778 23407 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9304058a34b12bfa74024fb2c7221 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:25.467420 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea08dc522141433e9b0d27a794aacdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.467999 23407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9304058a34b12bfa74024fb2c7221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.471519 23406 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca5c2967b64eccacaac1741e66ae52 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:25.473757 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca5c2967b64eccacaac1741e66ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.476054 23470 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:25.485183 23470 ts_tablet_manager.cc:1403] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.149s	user 0.000s	sys 0.013s
I20260709 13:09:25.386633 23339 tablet_service.cc:1511] Processing CreateTablet for tablet 33887f114a444f56904e9b07cebf538a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:25.482965 23262 tablet_service.cc:1511] Processing CreateTablet for tablet edd2ca63fc294d39be8e4f0973531faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:25.490820 23331 tablet_service.cc:1511] Processing CreateTablet for tablet a038d7dba05a4ceab3770a6926c3b41f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:25.490883 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd2ca63fc294d39be8e4f0973531faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.492137 23331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a038d7dba05a4ceab3770a6926c3b41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.458803 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 5b06cf1e83964a088fa4cafd6bc76780 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.493882 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b06cf1e83964a088fa4cafd6bc76780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.494504 23259 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf352d9d7274a9fbbde27bf171e5a3e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:25.495729 23259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf352d9d7274a9fbbde27bf171e5a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.496920 23226 heartbeater.cc:499] Master 127.14.246.126:38585 was elected leader, sending a full tablet report...
I20260709 13:09:25.509811 23412 tablet_service.cc:1511] Processing CreateTablet for tablet a038d7dba05a4ceab3770a6926c3b41f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:25.511956 23472 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:25.521132 23188 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca5c2967b64eccacaac1741e66ae52 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:25.522586 23339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33887f114a444f56904e9b07cebf538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.525247 23412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a038d7dba05a4ceab3770a6926c3b41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.529007 23187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828fc0c2eb24ed09da6ab517095131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.529722 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca5c2967b64eccacaac1741e66ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.530665 23336 tablet_service.cc:1511] Processing CreateTablet for tablet 58075f57a8b740fb8e4e030ce9f9fef3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:25.532217 23336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58075f57a8b740fb8e4e030ce9f9fef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.488330 23470 raft_consensus.cc:359] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:25.534900 23470 raft_consensus.cc:385] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.535300 23470 raft_consensus.cc:740] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.543998 23470 consensus_queue.cc:260] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:25.592382 23301 heartbeater.cc:499] Master 127.14.246.126:38585 was elected leader, sending a full tablet report...
I20260709 13:09:25.597100 23191 tablet_service.cc:1511] Processing CreateTablet for tablet c40f00e82080462d9460eb9c85f4992b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.599378 23258 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccc079d27d04f62bf9dc344d9bdb606 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:25.600673 23258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccc079d27d04f62bf9dc344d9bdb606. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.601817 23191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40f00e82080462d9460eb9c85f4992b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.601936 23335 tablet_service.cc:1511] Processing CreateTablet for tablet 26551318e3d9433c84c94b167b4cfd8c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.603518 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26551318e3d9433c84c94b167b4cfd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.607511 23262 tablet_service.cc:1511] Processing CreateTablet for tablet f828fc0c2eb24ed09da6ab517095131d (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:25.609375 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828fc0c2eb24ed09da6ab517095131d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.617449 23258 tablet_service.cc:1511] Processing CreateTablet for tablet 5f56852691524f04b8d536bd41ae154a (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:25.618906 23258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f56852691524f04b8d536bd41ae154a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.623229 23257 tablet_service.cc:1511] Processing CreateTablet for tablet 00f9304058a34b12bfa74024fb2c7221 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:25.625098 23472 tablet_bootstrap.cc:654] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.629585 23183 tablet_service.cc:1511] Processing CreateTablet for tablet a038d7dba05a4ceab3770a6926c3b41f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:25.698113 23183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a038d7dba05a4ceab3770a6926c3b41f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.698696 23375 heartbeater.cc:499] Master 127.14.246.126:38585 was elected leader, sending a full tablet report...
I20260709 13:09:25.633076 23334 tablet_service.cc:1511] Processing CreateTablet for tablet c40f00e82080462d9460eb9c85f4992b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.702210 23334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40f00e82080462d9460eb9c85f4992b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.702948 23470 ts_tablet_manager.cc:1434] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.217s	user 0.045s	sys 0.056s
I20260709 13:09:25.634940 23258 tablet_service.cc:1511] Processing CreateTablet for tablet 58075f57a8b740fb8e4e030ce9f9fef3 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:25.643067 23263 tablet_service.cc:1511] Processing CreateTablet for tablet 6cca5c2967b64eccacaac1741e66ae52 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:25.704021 23470 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:25.643429 23186 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.644482 23265 tablet_service.cc:1511] Processing CreateTablet for tablet 5b06cf1e83964a088fa4cafd6bc76780 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.660231 23191 tablet_service.cc:1511] Processing CreateTablet for tablet 26551318e3d9433c84c94b167b4cfd8c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.662617 23262 tablet_service.cc:1511] Processing CreateTablet for tablet c40f00e82080462d9460eb9c85f4992b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:25.670014 23468 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:25.709417 23468 ts_tablet_manager.cc:1403] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.425s	user 0.021s	sys 0.031s
I20260709 13:09:25.712101 23409 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.712401 23468 raft_consensus.cc:359] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.713207 23468 raft_consensus.cc:385] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.713598 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.690605 23340 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8397ef767c4037a55c7fa9e4be6ff6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.693591 23190 tablet_service.cc:1511] Processing CreateTablet for tablet f0c89b42f5bd47bf9740e16cb5d82506 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.704691 23258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58075f57a8b740fb8e4e030ce9f9fef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.708230 23191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26551318e3d9433c84c94b167b4cfd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.681351 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 22bfe0a296bd470997118a3f31d9b0de (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:25.726220 23260 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8397ef767c4037a55c7fa9e4be6ff6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.731565 23190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c89b42f5bd47bf9740e16cb5d82506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.735325 23405 tablet_service.cc:1511] Processing CreateTablet for tablet 26551318e3d9433c84c94b167b4cfd8c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:25.713531 23468 raft_consensus.cc:740] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.682400 23469 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:25.718613 23261 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:25.737212 23469 ts_tablet_manager.cc:1403] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.410s	user 0.021s	sys 0.011s
I20260709 13:09:25.721635 23264 tablet_service.cc:1511] Processing CreateTablet for tablet f0c89b42f5bd47bf9740e16cb5d82506 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.737144 23468 consensus_queue.cc:260] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.725765 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8397ef767c4037a55c7fa9e4be6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.738648 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cca5c2967b64eccacaac1741e66ae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.740342 23469 raft_consensus.cc:359] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.740978 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b06cf1e83964a088fa4cafd6bc76780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.741191 23469 raft_consensus.cc:385] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.741526 23469 raft_consensus.cc:740] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.742417 23469 consensus_queue.cc:260] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.743780 23262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c40f00e82080462d9460eb9c85f4992b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.744863 23184 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ec35ce0e459e94385c9b04253e33 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.748994 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.760401 23340 tablet_service.cc:1511] Processing CreateTablet for tablet eecef7df2e87484d8d5374f5664d3abb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.762476 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecef7df2e87484d8d5374f5664d3abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.773566 23410 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8397ef767c4037a55c7fa9e4be6ff6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:25.780339 23257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f9304058a34b12bfa74024fb2c7221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.780690 23449 heartbeater.cc:499] Master 127.14.246.126:38585 was elected leader, sending a full tablet report...
I20260709 13:09:25.779408 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ec35ce0e459e94385c9b04253e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.783329 23408 tablet_service.cc:1511] Processing CreateTablet for tablet eecef7df2e87484d8d5374f5664d3abb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.783218 23182 tablet_service.cc:1511] Processing CreateTablet for tablet eecef7df2e87484d8d5374f5664d3abb (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:25.785316 23414 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ec35ce0e459e94385c9b04253e33 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.787082 23337 tablet_service.cc:1511] Processing CreateTablet for tablet 2f84e27c47644330886c6361f8182419 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.788380 23332 tablet_service.cc:1511] Processing CreateTablet for tablet f0c89b42f5bd47bf9740e16cb5d82506 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:25.792899 23405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26551318e3d9433c84c94b167b4cfd8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.798614 23407 tablet_service.cc:1511] Processing CreateTablet for tablet 2f84e27c47644330886c6361f8182419 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.817653 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecef7df2e87484d8d5374f5664d3abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.827877 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c89b42f5bd47bf9740e16cb5d82506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.829282 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22bfe0a296bd470997118a3f31d9b0de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.829941 23261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8ce9b3559b43c4b1aeab0a4dd28f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.800946 23413 tablet_service.cc:1511] Processing CreateTablet for tablet 5b06cf1e83964a088fa4cafd6bc76780 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:25.833869 23468 ts_tablet_manager.cc:1434] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.124s	user 0.012s	sys 0.015s
I20260709 13:09:25.834410 23189 tablet_service.cc:1511] Processing CreateTablet for tablet 556266aaafcd47fbad094135c5d321d7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.837190 23189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556266aaafcd47fbad094135c5d321d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.837601 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8397ef767c4037a55c7fa9e4be6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.839589 23259 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ec35ce0e459e94385c9b04253e33 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:25.832181 23188 tablet_service.cc:1511] Processing CreateTablet for tablet e10b23f9075c452180fc416e53df2554 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.841495 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10b23f9075c452180fc416e53df2554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.844587 23410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8397ef767c4037a55c7fa9e4be6ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.848505 23259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ec35ce0e459e94385c9b04253e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.850184 23411 tablet_service.cc:1511] Processing CreateTablet for tablet ea93c613531f490b982eb22566d2be59 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.850742 23185 tablet_service.cc:1511] Processing CreateTablet for tablet ea93c613531f490b982eb22566d2be59 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.851984 23185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea93c613531f490b982eb22566d2be59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.848531 23412 tablet_service.cc:1511] Processing CreateTablet for tablet 556266aaafcd47fbad094135c5d321d7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.854225 23339 tablet_service.cc:1511] Processing CreateTablet for tablet e10b23f9075c452180fc416e53df2554 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.855448 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eecef7df2e87484d8d5374f5664d3abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.857041 23412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556266aaafcd47fbad094135c5d321d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.861080 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ec35ce0e459e94385c9b04253e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.865060 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b06cf1e83964a088fa4cafd6bc76780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.867486 23470 tablet_bootstrap.cc:654] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.869059 23407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f84e27c47644330886c6361f8182419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.875090 23468 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:25.875694 23469 ts_tablet_manager.cc:1434] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.138s	user 0.005s	sys 0.006s
I20260709 13:09:25.876835 23469 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:25.878216 23406 tablet_service.cc:1511] Processing CreateTablet for tablet 8e889863be944540ae44f160918568a7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:25.875120 23477 raft_consensus.cc:493] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.880002 23477 raft_consensus.cc:515] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.882170 23333 tablet_service.cc:1511] Processing CreateTablet for tablet ea93c613531f490b982eb22566d2be59 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:25.883436 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea93c613531f490b982eb22566d2be59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.889354 23475 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.889860 23475 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:25.890381 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 8e889863be944540ae44f160918568a7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:25.892369 23475 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:25.907277 23477 leader_election.cc:290] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:25.908210 23411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea93c613531f490b982eb22566d2be59. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:25.929510 23376 tablet.cc:2406] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:25.931826 23266 tablet_service.cc:1511] Processing CreateTablet for tablet e10b23f9075c452180fc416e53df2554 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:25.912099 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e889863be944540ae44f160918568a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.919637 23472 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:25.961097 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e889863be944540ae44f160918568a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.970464 23263 tablet_service.cc:1511] Processing CreateTablet for tablet 556266aaafcd47fbad094135c5d321d7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:25.971815 23263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556266aaafcd47fbad094135c5d321d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.964115 23472 ts_tablet_manager.cc:1403] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.451s	user 0.017s	sys 0.013s
I20260709 13:09:25.977356 23332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c89b42f5bd47bf9740e16cb5d82506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:25.992686 23265 tablet_service.cc:1511] Processing CreateTablet for tablet 2f84e27c47644330886c6361f8182419 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:25.994549 23472 raft_consensus.cc:359] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:25.995579 23472 raft_consensus.cc:385] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:25.995942 23472 raft_consensus.cc:740] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.010674 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10b23f9075c452180fc416e53df2554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.029917 23336 tablet_service.cc:1511] Processing CreateTablet for tablet 4319f76bcdb44f55acf34e3e01b9358e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:26.030968 23469 tablet_bootstrap.cc:654] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:25.974539 23260 tablet_service.cc:1511] Processing CreateTablet for tablet 8e889863be944540ae44f160918568a7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:26.063746 23185 tablet_service.cc:1511] Processing CreateTablet for tablet 4319f76bcdb44f55acf34e3e01b9358e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:26.066154 23185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4319f76bcdb44f55acf34e3e01b9358e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:26.058017 23083 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 66129.6us
I20260709 13:09:26.067714 23339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e10b23f9075c452180fc416e53df2554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.068145 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f84e27c47644330886c6361f8182419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.023209 23472 consensus_queue.cc:260] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.113593 23264 tablet_service.cc:1511] Processing CreateTablet for tablet 4319f76bcdb44f55acf34e3e01b9358e (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:26.114565 23468 tablet_bootstrap.cc:654] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.115391 23414 tablet_service.cc:1511] Processing CreateTablet for tablet a69a923f9fc9441cb34ffc1d7f0c4104 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:26.103754 23336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4319f76bcdb44f55acf34e3e01b9358e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.116658 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a69a923f9fc9441cb34ffc1d7f0c4104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.127149 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e889863be944540ae44f160918568a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.131378 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4319f76bcdb44f55acf34e3e01b9358e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.149137 23487 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.149932 23487 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.153595 23487 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:26.155691 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f84e27c47644330886c6361f8182419. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.167861 23184 tablet_service.cc:1511] Processing CreateTablet for tablet a69a923f9fc9441cb34ffc1d7f0c4104 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:26.174240 23335 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c6b855f0d46cba85977dc9d19f611 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:26.205133 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c6b855f0d46cba85977dc9d19f611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.201900 23470 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:26.225018 23408 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c6b855f0d46cba85977dc9d19f611 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:26.226531 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c6b855f0d46cba85977dc9d19f611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.227253 23188 tablet_service.cc:1511] Processing CreateTablet for tablet ca6c6b855f0d46cba85977dc9d19f611 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:26.229313 23478 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.229586 23340 tablet_service.cc:1511] Processing CreateTablet for tablet 9a57fa440d304760aa2a0ed56ef83076 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:26.229903 23478 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.230973 23340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a57fa440d304760aa2a0ed56ef83076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.219188 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a69a923f9fc9441cb34ffc1d7f0c4104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.218977 23470 ts_tablet_manager.cc:1403] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.515s	user 0.049s	sys 0.036s
I20260709 13:09:26.264945 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca6c6b855f0d46cba85977dc9d19f611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.267197 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:26.273144 23478 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:26.278117 23468 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:26.278834 23468 ts_tablet_manager.cc:1403] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.404s	user 0.012s	sys 0.003s
I20260709 13:09:26.285678 23472 ts_tablet_manager.cc:1434] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.304s	user 0.029s	sys 0.025s
I20260709 13:09:26.286981 23472 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:26.287137 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:26.289950 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:26.291802 23313 leader_election.cc:343] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.273547 23164 leader_election.cc:343] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.296478 23165 leader_election.cc:343] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.297942 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:26.298756 23469 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:26.299328 23469 ts_tablet_manager.cc:1403] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.423s	user 0.015s	sys 0.022s
I20260709 13:09:26.299403 23165 leader_election.cc:304] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:26.300437 23477 raft_consensus.cc:2749] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.282325 23468 raft_consensus.cc:359] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.307767 23470 raft_consensus.cc:359] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:26.311578 23313 leader_election.cc:343] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.320534 23313 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:26.312983 23266 tablet_service.cc:1511] Processing CreateTablet for tablet a69a923f9fc9441cb34ffc1d7f0c4104 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:26.324672 23475 raft_consensus.cc:2749] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.339090 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a69a923f9fc9441cb34ffc1d7f0c4104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.338596 23469 raft_consensus.cc:359] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:26.345124 23469 raft_consensus.cc:385] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.345587 23469 raft_consensus.cc:740] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.346618 23469 consensus_queue.cc:260] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:26.349284 23184 tablet_service.cc:1511] Processing CreateTablet for tablet cb613826a4374135aa008dc054ae5daf (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:26.350778 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb613826a4374135aa008dc054ae5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.351507 23469 ts_tablet_manager.cc:1434] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.052s	user 0.002s	sys 0.007s
W20260709 13:09:26.353691 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:26.353735 23478 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.316061 23468 raft_consensus.cc:385] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.318547 23470 raft_consensus.cc:385] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.355954 23468 raft_consensus.cc:740] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.356632 23470 raft_consensus.cc:740] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.357267 23468 consensus_queue.cc:260] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.358359 23470 consensus_queue.cc:260] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.355942 23478 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:26.363692 23478 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:26.367028 23468 ts_tablet_manager.cc:1434] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:09:26.356094 23469 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:26.315294 23260 tablet_service.cc:1511] Processing CreateTablet for tablet 9a57fa440d304760aa2a0ed56ef83076 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:26.375310 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a57fa440d304760aa2a0ed56ef83076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.379660 23472 tablet_bootstrap.cc:654] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.386051 23470 ts_tablet_manager.cc:1434] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.002s
I20260709 13:09:26.390202 23470 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:26.395565 23468 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:26.395962 23259 tablet_service.cc:1511] Processing CreateTablet for tablet cb613826a4374135aa008dc054ae5daf (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:26.397543 23259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb613826a4374135aa008dc054ae5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.410795 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:26.412407 23239 leader_election.cc:343] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.424371 23468 tablet_bootstrap.cc:654] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.431785 23264 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbfc36a4fa54f75aadc294c28c47faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:26.435230 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbfc36a4fa54f75aadc294c28c47faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.441272 23472 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:26.442322 23470 tablet_bootstrap.cc:654] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.442988 23337 tablet_service.cc:1511] Processing CreateTablet for tablet cb613826a4374135aa008dc054ae5daf (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:26.442425 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd73e37c60d47939ed13f2464ce939c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:26.444244 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb613826a4374135aa008dc054ae5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.443619 23184 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbfc36a4fa54f75aadc294c28c47faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:26.445899 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbfc36a4fa54f75aadc294c28c47faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.447609 23472 ts_tablet_manager.cc:1403] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.004s
I20260709 13:09:26.448307 23469 tablet_bootstrap.cc:654] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.446254 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd73e37c60d47939ed13f2464ce939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.454613 23409 tablet_service.cc:1511] Processing CreateTablet for tablet 9a57fa440d304760aa2a0ed56ef83076 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:26.456560 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a57fa440d304760aa2a0ed56ef83076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.464207 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:26.464651 23188 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd73e37c60d47939ed13f2464ce939c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:26.465485 23414 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd73e37c60d47939ed13f2464ce939c (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:26.466229 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd73e37c60d47939ed13f2464ce939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.466835 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd73e37c60d47939ed13f2464ce939c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.469158 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:26.470638 23408 tablet_service.cc:1511] Processing CreateTablet for tablet 3bbfc36a4fa54f75aadc294c28c47faa (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:09:26.470913 23239 leader_election.cc:343] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.471442 23239 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:26.472389 23491 raft_consensus.cc:2749] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.473347 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:26.474001 23201 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:26.474586 23265 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9b53c11e2a49719268dc7556e5e0c0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:26.475718 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:26.476032 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9b53c11e2a49719268dc7556e5e0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.478570 23333 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9b53c11e2a49719268dc7556e5e0c0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:26.479844 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9b53c11e2a49719268dc7556e5e0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.487507 23406 tablet_service.cc:1511] Processing CreateTablet for tablet 1e9b53c11e2a49719268dc7556e5e0c0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:26.451114 23472 raft_consensus.cc:359] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:26.493109 23387 leader_election.cc:343] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.493305 23472 raft_consensus.cc:385] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.493825 23472 raft_consensus.cc:740] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.493953 23387 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:26.494799 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:26.494905 23472 consensus_queue.cc:260] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.496069 23478 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.496507 23478 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.496893 23478 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.506598 23478 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:26.495381 23387 leader_election.cc:343] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.509677 23388 leader_election.cc:343] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.510784 23388 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:26.514160 23478 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:26.514336 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e9b53c11e2a49719268dc7556e5e0c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.519549 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bbfc36a4fa54f75aadc294c28c47faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.522428 23472 ts_tablet_manager.cc:1434] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.003s
I20260709 13:09:26.522145 23182 tablet_service.cc:1511] Processing CreateTablet for tablet e45fa2e0e25b4deba3ceadbb53abac4f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:26.523469 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45fa2e0e25b4deba3ceadbb53abac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.523516 23472 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:26.525817 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:26.526479 23201 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.529578 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:26.538494 23470 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:26.553388 23470 ts_tablet_manager.cc:1403] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.009s
I20260709 13:09:26.554081 23264 tablet_service.cc:1511] Processing CreateTablet for tablet 2f632a33cc3f4e5cadaab0200db6a404 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:26.554862 23333 tablet_service.cc:1511] Processing CreateTablet for tablet ec4c4636c76b439db1396da335593209 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:26.555387 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f632a33cc3f4e5cadaab0200db6a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.556094 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4c4636c76b439db1396da335593209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.559015 23201 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:26.565699 23186 tablet_service.cc:1511] Processing CreateTablet for tablet ec4c4636c76b439db1396da335593209 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:26.566998 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4c4636c76b439db1396da335593209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.568390 23475 raft_consensus.cc:493] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.568936 23475 raft_consensus.cc:515] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.571398 23475 leader_election.cc:290] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:26.542109 23472 tablet_bootstrap.cc:654] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.534076 23478 raft_consensus.cc:2749] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.574782 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:26.574679 23470 raft_consensus.cc:359] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:26.575621 23470 raft_consensus.cc:385] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.543046 23469 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:26.542891 23337 tablet_service.cc:1511] Processing CreateTablet for tablet e45fa2e0e25b4deba3ceadbb53abac4f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:26.544893 23468 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:26.576561 23469 ts_tablet_manager.cc:1403] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.221s	user 0.016s	sys 0.004s
I20260709 13:09:26.576705 23468 ts_tablet_manager.cc:1403] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.010s
I20260709 13:09:26.579878 23469 raft_consensus.cc:359] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.549551 23260 tablet_service.cc:1511] Processing CreateTablet for tablet e45fa2e0e25b4deba3ceadbb53abac4f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:09:26.550140 23387 leader_election.cc:343] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.575956 23470 raft_consensus.cc:740] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.546396 23185 tablet_service.cc:1511] Processing CreateTablet for tablet 2f632a33cc3f4e5cadaab0200db6a404 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:26.582993 23337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45fa2e0e25b4deba3ceadbb53abac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.580595 23469 raft_consensus.cc:385] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.583714 23469 raft_consensus.cc:740] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.586817 23185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f632a33cc3f4e5cadaab0200db6a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.585028 23469 consensus_queue.cc:260] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:26.588792 23313 leader_election.cc:343] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.594666 23469 ts_tablet_manager.cc:1434] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:26.596719 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e45fa2e0e25b4deba3ceadbb53abac4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.580999 23468 raft_consensus.cc:359] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.598951 23468 raft_consensus.cc:385] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.599288 23468 raft_consensus.cc:740] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.599609 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:26.600306 23424 raft_consensus.cc:2468] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
W20260709 13:09:26.585508 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 47582.3us
I20260709 13:09:26.601828 23313 leader_election.cc:304] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:26.602263 23387 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:26.602866 23475 raft_consensus.cc:2804] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.603010 23478 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.603327 23475 raft_consensus.cc:493] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.603595 23478 raft_consensus.cc:697] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:26.603782 23475 raft_consensus.cc:3060] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.604501 23478 consensus_queue.cc:237] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.595714 23469 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:26.610870 23265 tablet_service.cc:1511] Processing CreateTablet for tablet bf9524fb52314d9493c13161ef93ac3b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:26.612298 23265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9524fb52314d9493c13161ef93ac3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.612990 23338 tablet_service.cc:1511] Processing CreateTablet for tablet bf9524fb52314d9493c13161ef93ac3b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:26.614355 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9524fb52314d9493c13161ef93ac3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.595942 23470 consensus_queue.cc:260] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:26.623055 23472 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:26.623813 23472 ts_tablet_manager.cc:1403] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.001s
I20260709 13:09:26.627928 23472 raft_consensus.cc:359] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.600102 23468 consensus_queue.cc:260] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.631991 23184 tablet_service.cc:1511] Processing CreateTablet for tablet 5a786424dfd04ed5afafe8bec218aaa7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:26.639029 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a786424dfd04ed5afafe8bec218aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.639992 23468 ts_tablet_manager.cc:1434] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.063s	user 0.002s	sys 0.004s
I20260709 13:09:26.640596 23264 tablet_service.cc:1511] Processing CreateTablet for tablet 5a786424dfd04ed5afafe8bec218aaa7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:26.642174 23264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a786424dfd04ed5afafe8bec218aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.647114 23469 tablet_bootstrap.cc:654] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.651666 23408 tablet_service.cc:1511] Processing CreateTablet for tablet 2f632a33cc3f4e5cadaab0200db6a404 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:26.653168 23408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f632a33cc3f4e5cadaab0200db6a404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.653546 23468 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:26.656595 23406 tablet_service.cc:1511] Processing CreateTablet for tablet ec4c4636c76b439db1396da335593209 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:26.656885 23475 raft_consensus.cc:515] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.658116 23406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec4c4636c76b439db1396da335593209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.658711 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 5a786424dfd04ed5afafe8bec218aaa7 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:26.659189 23475 leader_election.cc:290] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:26.636745 23472 raft_consensus.cc:385] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.661156 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a786424dfd04ed5afafe8bec218aaa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.661594 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:26.662694 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:26.666044 23424 raft_consensus.cc:3060] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.663242 23409 tablet_service.cc:1511] Processing CreateTablet for tablet bf9524fb52314d9493c13161ef93ac3b (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:09:26.666860 23313 leader_election.cc:343] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.667603 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9524fb52314d9493c13161ef93ac3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.664791 23491 raft_consensus.cc:493] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.669626 23491 raft_consensus.cc:515] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.673373 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:26.674120 23201 raft_consensus.cc:2468] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:26.674291 23470 ts_tablet_manager.cc:1434] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:09:26.675534 23470 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:26.671923 23491 leader_election.cc:290] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:26.676803 23472 raft_consensus.cc:740] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.677621 23239 leader_election.cc:304] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:26.677881 23472 consensus_queue.cc:260] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.681898 23424 raft_consensus.cc:2468] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:26.683229 23313 leader_election.cc:304] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:26.684118 23475 raft_consensus.cc:2804] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.687448 23491 raft_consensus.cc:2804] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:26.705433 23472 ts_tablet_manager.cc:1434] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.012s
I20260709 13:09:26.707008 23186 tablet_service.cc:1511] Processing CreateTablet for tablet a87fc46139f2423a9c3eac9d3761edf0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:26.707876 23259 tablet_service.cc:1511] Processing CreateTablet for tablet a87fc46139f2423a9c3eac9d3761edf0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:26.717634 23186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87fc46139f2423a9c3eac9d3761edf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.717772 23259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87fc46139f2423a9c3eac9d3761edf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.722250 23333 tablet_service.cc:1511] Processing CreateTablet for tablet fd55e8ce6f934c09ba57053aa2ac4298 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:26.722836 23182 tablet_service.cc:1511] Processing CreateTablet for tablet fd55e8ce6f934c09ba57053aa2ac4298 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:26.723578 23333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd55e8ce6f934c09ba57053aa2ac4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.724149 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd55e8ce6f934c09ba57053aa2ac4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.709510 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:26.729053 23240 leader_election.cc:343] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.702157 23491 raft_consensus.cc:493] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.730095 23470 tablet_bootstrap.cc:654] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.730201 23491 raft_consensus.cc:3060] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.737712 23414 tablet_service.cc:1511] Processing CreateTablet for tablet a87fc46139f2423a9c3eac9d3761edf0 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:26.739034 23414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a87fc46139f2423a9c3eac9d3761edf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.739785 23099 catalog_manager.cc:5697] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.701223 23475 raft_consensus.cc:697] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:26.746353 23475 consensus_queue.cc:237] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.749398 23413 tablet_service.cc:1511] Processing CreateTablet for tablet fd55e8ce6f934c09ba57053aa2ac4298 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:26.749884 23338 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.750907 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd55e8ce6f934c09ba57053aa2ac4298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.751243 23338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.753837 23508 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.754408 23508 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:26.757257 23508 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:26.757062 23266 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.758617 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.760152 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:26.757131 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:26.761827 23313 leader_election.cc:343] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.762555 23313 leader_election.cc:343] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.762938 23313 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:26.764050 23508 raft_consensus.cc:2749] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.744585 23468 tablet_bootstrap.cc:654] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.769496 23407 tablet_service.cc:1511] Processing CreateTablet for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:26.771178 23407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d45b9dd9d38431e91f7b6fd724e5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.785290 23184 tablet_service.cc:1511] Processing CreateTablet for tablet b87502ffc9004276b2e75e7916ee177f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:26.786844 23184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87502ffc9004276b2e75e7916ee177f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.794807 23335 tablet_service.cc:1511] Processing CreateTablet for tablet b87502ffc9004276b2e75e7916ee177f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:26.796240 23335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87502ffc9004276b2e75e7916ee177f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.802404 23266 tablet_service.cc:1511] Processing CreateTablet for tablet b87502ffc9004276b2e75e7916ee177f (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:26.804023 23266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87502ffc9004276b2e75e7916ee177f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.809938 23409 tablet_service.cc:1511] Processing CreateTablet for tablet 6705226baaba42b88325cfeaf478e871 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.811396 23409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705226baaba42b88325cfeaf478e871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.813241 23188 tablet_service.cc:1511] Processing CreateTablet for tablet 6705226baaba42b88325cfeaf478e871 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.814545 23188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705226baaba42b88325cfeaf478e871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.821388 23472 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:26.825865 23491 raft_consensus.cc:515] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.828645 23260 tablet_service.cc:1511] Processing CreateTablet for tablet 6705226baaba42b88325cfeaf478e871 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:26.828986 23336 tablet_service.cc:1511] Processing CreateTablet for tablet 166ec71f2f7b44dfab28c0b65463fee8 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.829582 23491 leader_election.cc:290] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:26.830255 23336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166ec71f2f7b44dfab28c0b65463fee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.830785 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:26.831487 23201 raft_consensus.cc:3060] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:26.829005 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:26.844887 23240 leader_election.cc:343] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.848321 23469 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:26.848901 23469 ts_tablet_manager.cc:1403] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.022s
I20260709 13:09:26.850225 23413 tablet_service.cc:1511] Processing CreateTablet for tablet 166ec71f2f7b44dfab28c0b65463fee8 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.851478 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166ec71f2f7b44dfab28c0b65463fee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.851965 23469 raft_consensus.cc:359] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:26.858137 23260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6705226baaba42b88325cfeaf478e871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.868134 23472 tablet_bootstrap.cc:654] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.871733 23201 raft_consensus.cc:2468] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:26.873190 23239 leader_election.cc:304] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:26.874375 23491 raft_consensus.cc:2804] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:26.874935 23491 raft_consensus.cc:697] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:26.875711 23491 consensus_queue.cc:237] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.852715 23469 raft_consensus.cc:385] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.877146 23469 raft_consensus.cc:740] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.877972 23469 consensus_queue.cc:260] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:26.880098 23468 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:26.880667 23468 ts_tablet_manager.cc:1403] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.227s	user 0.009s	sys 0.005s
I20260709 13:09:26.874370 23470 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:26.882834 23470 ts_tablet_manager.cc:1403] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.006s
I20260709 13:09:26.886088 23468 raft_consensus.cc:359] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:26.886322 23182 tablet_service.cc:1511] Processing CreateTablet for tablet 166ec71f2f7b44dfab28c0b65463fee8 (DEFAULT_TABLE table=test-workload [id=b73b1efe442b4df383a88f700b550de6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:26.886900 23468 raft_consensus.cc:385] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.887344 23468 raft_consensus.cc:740] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.887588 23469 ts_tablet_manager.cc:1434] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:09:26.888713 23469 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:26.890308 23470 raft_consensus.cc:359] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.891054 23470 raft_consensus.cc:385] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.891348 23470 raft_consensus.cc:740] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.888290 23468 consensus_queue.cc:260] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:26.893406 23509 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.893925 23509 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.894737 23468 ts_tablet_manager.cc:1434] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:26.895908 23509 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:26.896032 23468 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:26.898043 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:26.899552 23469 tablet_bootstrap.cc:654] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.900039 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:26.901206 23239 leader_election.cc:343] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:26.901943 23239 leader_election.cc:343] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:26.902379 23239 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:26.903215 23509 raft_consensus.cc:2749] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:26.905347 23469 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:26.905874 23469 ts_tablet_manager.cc:1403] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 13:09:26.908943 23469 raft_consensus.cc:359] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.909627 23469 raft_consensus.cc:385] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.909927 23469 raft_consensus.cc:740] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.887615 23182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166ec71f2f7b44dfab28c0b65463fee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:26.910827 23469 consensus_queue.cc:260] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.911543 23472 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:26.912070 23472 ts_tablet_manager.cc:1403] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.006s
I20260709 13:09:26.913426 23469 ts_tablet_manager.cc:1434] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:26.914558 23469 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:26.915386 23472 raft_consensus.cc:359] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.916090 23472 raft_consensus.cc:385] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.916388 23472 raft_consensus.cc:740] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.917332 23472 consensus_queue.cc:260] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.918177 23468 tablet_bootstrap.cc:654] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.919802 23472 ts_tablet_manager.cc:1434] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:26.921175 23472 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:26.925056 23470 consensus_queue.cc:260] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.925323 23097 catalog_manager.cc:5697] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.927210 23469 tablet_bootstrap.cc:654] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.927397 23470 ts_tablet_manager.cc:1434] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.000s
I20260709 13:09:26.933079 23472 tablet_bootstrap.cc:654] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:26.930248 23468 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:26.949390 23098 catalog_manager.cc:5697] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.971242 23468 ts_tablet_manager.cc:1403] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.075s	user 0.033s	sys 0.026s
I20260709 13:09:26.928504 23470 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:26.976603 23477 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.977572 23477 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.983489 23472 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:26.984002 23472 ts_tablet_manager.cc:1403] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.026s
I20260709 13:09:26.984320 23477 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:26.987257 23472 raft_consensus.cc:359] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.988031 23472 raft_consensus.cc:385] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.988332 23472 raft_consensus.cc:740] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.989246 23472 consensus_queue.cc:260] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:26.991690 23472 ts_tablet_manager.cc:1434] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:26.975931 23468 raft_consensus.cc:359] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.992159 23468 raft_consensus.cc:385] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:26.992650 23472 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:26.992601 23468 raft_consensus.cc:740] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.996431 23468 consensus_queue.cc:260] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:26.998986 23472 tablet_bootstrap.cc:654] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.002840 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.003806 23276 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.005769 23164 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.010500 23472 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.011056 23472 ts_tablet_manager.cc:1403] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:09:27.013634 23477 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.014380 23477 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.014197 23472 raft_consensus.cc:359] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.015133 23477 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.015326 23472 raft_consensus.cc:385] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.015834 23472 raft_consensus.cc:740] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.016760 23472 consensus_queue.cc:260] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.019263 23472 ts_tablet_manager.cc:1434] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:27.020247 23472 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.026521 23472 tablet_bootstrap.cc:654] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.033672 23468 ts_tablet_manager.cc:1434] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:09:27.042949 23468 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.057060 23477 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.059409 23477 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.060046 23469 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.060873 23469 ts_tablet_manager.cc:1403] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.147s	user 0.051s	sys 0.089s
I20260709 13:09:27.062351 23276 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.064564 23469 raft_consensus.cc:359] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.065510 23469 raft_consensus.cc:385] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.065894 23469 raft_consensus.cc:740] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.066771 23469 consensus_queue.cc:260] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.067162 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:27.067914 23275 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.069474 23469 ts_tablet_manager.cc:1434] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:27.059991 23477 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.070062 23477 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.072338 23477 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.073726 23469 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.076849 23478 raft_consensus.cc:493] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.077502 23478 raft_consensus.cc:515] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.079357 23275 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.080986 23469 tablet_bootstrap.cc:654] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.081199 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.082278 23164 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.082567 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.082439 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.083308 23274 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.083392 23477 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.086272 23477 raft_consensus.cc:697] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.087357 23477 consensus_queue.cc:237] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:27.084161 23388 leader_election.cc:343] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.089712 23387 leader_election.cc:343] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.090984 23387 leader_election.cc:304] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.092185 23505 raft_consensus.cc:2749] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.091976 23164 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.094756 23528 raft_consensus.cc:2804] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.097473 23528 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.098472 23528 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.099133 23470 tablet_bootstrap.cc:654] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.083057 23478 leader_election.cc:290] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.102553 23491 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.103950 23478 consensus_queue.cc:1048] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:27.103371 23491 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.112382 23477 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.113085 23477 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.115794 23477 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.117115 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.117842 23350 raft_consensus.cc:2468] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.119302 23165 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.124976 23098 catalog_manager.cc:5697] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.128326 23477 raft_consensus.cc:2804] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.128917 23477 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.129364 23477 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.133801 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.134155 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.137602 23491 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.141959 23491 raft_consensus.cc:493] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.142555 23491 raft_consensus.cc:515] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:27.146534 23164 leader_election.cc:343] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.147759 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.148716 23478 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.149057 23201 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:27.149436 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.149399 23478 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.151078 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.151808 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.152175 23478 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.152940 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.154140 23424 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.154438 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
W20260709 13:09:27.155730 23240 leader_election.cc:343] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.158212 23239 leader_election.cc:343] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.158615 23475 consensus_queue.cc:1048] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.158812 23239 leader_election.cc:304] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.159940 23509 raft_consensus.cc:2749] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.161418 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.162223 23528 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.153033 23491 leader_election.cc:290] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.164494 23528 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.169162 23239 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.170666 23472 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.170758 23470 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.171226 23472 ts_tablet_manager.cc:1403] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.151s	user 0.044s	sys 0.066s
I20260709 13:09:27.171589 23470 ts_tablet_manager.cc:1403] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.243s	user 0.005s	sys 0.019s
I20260709 13:09:27.173202 23468 tablet_bootstrap.cc:654] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.174436 23472 raft_consensus.cc:359] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.175171 23472 raft_consensus.cc:385] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.175468 23472 raft_consensus.cc:740] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.177481 23509 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:27.178925 23469 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.179720 23469 ts_tablet_manager.cc:1403] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.049s
I20260709 13:09:27.179844 23470 raft_consensus.cc:359] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.179733 23509 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d522b0c35d264310bd559b320098c16e)
I20260709 13:09:27.182197 23509 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.182641 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.183530 23274 raft_consensus.cc:2393] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:27.187845 23472 consensus_queue.cc:260] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.188217 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.188508 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:27.189229 23275 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.189368 23387 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.190369 23478 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.180701 23470 raft_consensus.cc:385] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.197599 23470 raft_consensus.cc:740] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.198004 23275 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.199208 23472 ts_tablet_manager.cc:1434] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:09:27.198412 23470 consensus_queue.cc:260] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.200675 23472 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.204528 23477 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.206887 23477 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.208081 23470 ts_tablet_manager.cc:1434] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:09:27.208145 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.208913 23472 tablet_bootstrap.cc:654] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.198040 23478 raft_consensus.cc:2749] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.186362 23469 raft_consensus.cc:359] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.210155 23469 raft_consensus.cc:385] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.210161 23350 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.211594 23469 raft_consensus.cc:740] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.212504 23469 consensus_queue.cc:260] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:27.213644 23164 leader_election.cc:343] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.214406 23424 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.214830 23491 raft_consensus.cc:493] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.215682 23469 ts_tablet_manager.cc:1434] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:09:27.215359 23491 raft_consensus.cc:515] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.216882 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:27.217906 23469 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.218633 23491 leader_election.cc:290] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.220602 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.216305 23470 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:27.230780 23240 leader_election.cc:343] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.235338 23164 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.243856 23477 raft_consensus.cc:2804] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:27.244033 23164 leader_election.cc:343] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.244421 23477 raft_consensus.cc:697] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.244115 23424 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.245631 23477 consensus_queue.cc:237] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.258591 23505 raft_consensus.cc:493] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.259212 23505 raft_consensus.cc:515] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.259408 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
W20260709 13:09:27.261070 23239 leader_election.cc:343] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.277261 23239 leader_election.cc:304] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.274226 23535 consensus_queue.cc:1048] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:27.276420 23505 leader_election.cc:290] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.278100 23491 raft_consensus.cc:2749] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:27.274611 23313 consensus_peers.cc:597] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:27.284168 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:27.285972 23387 leader_election.cc:343] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.286185 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:27.291451 23387 leader_election.cc:343] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.294773 23387 leader_election.cc:304] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.295199 23508 raft_consensus.cc:493] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.295704 23508 raft_consensus.cc:515] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.297674 23508 leader_election.cc:290] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.299808 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.300597 23200 raft_consensus.cc:2393] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:27.296559 23535 raft_consensus.cc:2749] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.301168 23491 consensus_queue.cc:1048] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.274746 23509 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.307049 23275 raft_consensus.cc:1240] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Rejecting Update request from peer d522b0c35d264310bd559b320098c16e for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:27.308171 23469 tablet_bootstrap.cc:654] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.308547 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.309032 23468 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.309520 23468 ts_tablet_manager.cc:1403] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.008s
I20260709 13:09:27.304662 23350 raft_consensus.cc:2468] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.311738 23509 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.311729 23165 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:27.313993 23470 tablet_bootstrap.cc:654] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.313868 23313 leader_election.cc:304] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.315104 23475 raft_consensus.cc:3060] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.315328 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:27.311610 23097 catalog_manager.cc:5697] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.319566 23477 raft_consensus.cc:2804] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.319775 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.320297 23477 raft_consensus.cc:697] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.321295 23239 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.321575 23477 consensus_queue.cc:237] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.323077 23509 raft_consensus.cc:2749] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.325096 23478 consensus_queue.cc:1059] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.326763 23535 raft_consensus.cc:3055] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:27.327131 23535 raft_consensus.cc:740] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:27.328048 23472 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.328688 23472 ts_tablet_manager.cc:1403] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.019s
I20260709 13:09:27.331439 23535 consensus_queue.cc:260] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.332647 23535 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.333612 23475 raft_consensus.cc:2749] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.343530 23542 consensus_queue.cc:1048] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:27.345885 23472 raft_consensus.cc:359] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.346575 23472 raft_consensus.cc:385] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.346876 23472 raft_consensus.cc:740] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.341696 23468 raft_consensus.cc:359] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.348825 23468 raft_consensus.cc:385] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.349157 23468 raft_consensus.cc:740] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.347751 23472 consensus_queue.cc:260] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.359793 23472 ts_tablet_manager.cc:1434] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.031s	user 0.002s	sys 0.004s
W20260709 13:09:27.360270 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:27.360734 23472 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.361403 23468 consensus_queue.cc:260] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.366947 23468 ts_tablet_manager.cc:1434] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 13:09:27.368966 23469 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.369452 23469 ts_tablet_manager.cc:1403] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.152s	user 0.028s	sys 0.012s
I20260709 13:09:27.374688 23469 raft_consensus.cc:359] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.375357 23469 raft_consensus.cc:385] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.375614 23469 raft_consensus.cc:740] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.376247 23469 consensus_queue.cc:260] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.379122 23469 ts_tablet_manager.cc:1434] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:27.380750 23470 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.381316 23470 ts_tablet_manager.cc:1403] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.001s
I20260709 13:09:27.381558 23468 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.384516 23470 raft_consensus.cc:359] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.385499 23470 raft_consensus.cc:385] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.390192 23469 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.386049 23470 raft_consensus.cc:740] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.392705 23470 consensus_queue.cc:260] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.394236 23535 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.394791 23535 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.388476 23096 catalog_manager.cc:5697] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.398241 23535 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.399741 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.401041 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:27.401278 23387 leader_election.cc:343] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.402690 23388 leader_election.cc:343] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.403290 23470 ts_tablet_manager.cc:1434] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:27.403192 23388 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.404376 23535 raft_consensus.cc:2749] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.407446 23469 tablet_bootstrap.cc:654] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.408217 23472 tablet_bootstrap.cc:654] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.409515 23470 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:27.420109 23470 tablet_bootstrap.cc:654] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.440112 23468 tablet_bootstrap.cc:654] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.454406 23491 raft_consensus.cc:493] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.454995 23491 raft_consensus.cc:515] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.457197 23491 leader_election.cc:290] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.458526 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.458712 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.459267 23350 raft_consensus.cc:2468] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:27.459766 23470 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.460295 23470 ts_tablet_manager.cc:1403] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.005s
W20260709 13:09:27.460606 23239 leader_election.cc:343] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.461529 23240 leader_election.cc:304] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.462877 23469 tablet_bootstrap.cc:492] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.462996 23491 raft_consensus.cc:2804] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.463569 23469 ts_tablet_manager.cc:1403] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.031s
I20260709 13:09:27.463559 23491 raft_consensus.cc:493] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.463478 23470 raft_consensus.cc:359] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.464440 23491 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.469774 23472 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.470273 23472 ts_tablet_manager.cc:1403] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.003s
I20260709 13:09:27.472590 23468 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.473179 23468 ts_tablet_manager.cc:1403] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.009s
I20260709 13:09:27.475633 23469 raft_consensus.cc:359] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.476424 23469 raft_consensus.cc:385] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.476198 23468 raft_consensus.cc:359] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.476804 23469 raft_consensus.cc:740] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.464473 23470 raft_consensus.cc:385] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.477480 23470 raft_consensus.cc:740] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.477068 23491 raft_consensus.cc:515] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.477605 23469 consensus_queue.cc:260] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.478509 23470 consensus_queue.cc:260] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.477066 23468 raft_consensus.cc:385] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.479666 23491 leader_election.cc:290] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.479890 23468 raft_consensus.cc:740] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.481019 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.480873 23468 consensus_queue.cc:260] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.481559 23422 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.481871 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.482465 23350 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.483780 23470 ts_tablet_manager.cc:1434] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:09:27.488373 23422 raft_consensus.cc:2468] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:27.493746 23239 leader_election.cc:304] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:27.490881 23468 ts_tablet_manager.cc:1434] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:27.490818 23472 raft_consensus.cc:359] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.484938 23470 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:27.497026 23468 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.495877 23472 raft_consensus.cc:385] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.498096 23472 raft_consensus.cc:740] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.498908 23472 consensus_queue.cc:260] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.500308 23350 raft_consensus.cc:2468] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:27.494629 23491 raft_consensus.cc:2804] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.501515 23491 raft_consensus.cc:697] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:27.503643 23491 consensus_queue.cc:237] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.502744 23469 ts_tablet_manager.cc:1434] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:09:27.506687 23470 tablet_bootstrap.cc:654] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.500984 23472 ts_tablet_manager.cc:1434] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:09:27.507853 23475 raft_consensus.cc:493] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.508515 23475 raft_consensus.cc:515] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.509136 23469 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.504206 23468 tablet_bootstrap.cc:654] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.511265 23475 leader_election.cc:290] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.513094 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.513265 23472 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.513361 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.513942 23200 raft_consensus.cc:2468] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:27.514281 23422 raft_consensus.cc:2468] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:27.515252 23313 leader_election.cc:304] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.516106 23475 raft_consensus.cc:2804] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.516520 23475 raft_consensus.cc:493] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.516933 23475 raft_consensus.cc:3060] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.521209 23469 tablet_bootstrap.cc:654] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.521760 23472 tablet_bootstrap.cc:654] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.528148 23475 raft_consensus.cc:515] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.530754 23470 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.531422 23470 ts_tablet_manager.cc:1403] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 13:09:27.532969 23468 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.534211 23468 ts_tablet_manager.cc:1403] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.008s
I20260709 13:09:27.534874 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.535550 23422 raft_consensus.cc:3060] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.537197 23468 raft_consensus.cc:359] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.537949 23468 raft_consensus.cc:385] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.538132 23472 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.538295 23468 raft_consensus.cc:740] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.538906 23472 ts_tablet_manager.cc:1403] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:09:27.541201 23469 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.534909 23470 raft_consensus.cc:359] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.541759 23470 raft_consensus.cc:385] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.539567 23468 consensus_queue.cc:260] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.542589 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d07f94d31084ca4bec1714d2cd152fd" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:27.543243 23200 raft_consensus.cc:3060] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.543395 23554 raft_consensus.cc:493] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.544093 23554 raft_consensus.cc:515] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.547756 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.541716 23469 ts_tablet_manager.cc:1403] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:09:27.548480 23424 raft_consensus.cc:2468] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:27.549520 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.550058 23239 leader_election.cc:304] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:27.551564 23469 raft_consensus.cc:359] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.552301 23469 raft_consensus.cc:385] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.552577 23469 raft_consensus.cc:740] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.548481 23468 ts_tablet_manager.cc:1434] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:27.554282 23468 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.555505 23542 raft_consensus.cc:2804] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.556077 23542 raft_consensus.cc:493] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.556496 23542 raft_consensus.cc:3060] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.557070 23469 consensus_queue.cc:260] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:27.560657 23239 leader_election.cc:343] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.562345 23477 consensus_queue.cc:1048] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.563019 23554 leader_election.cc:290] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.563895 23475 leader_election.cc:290] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.555188 23200 raft_consensus.cc:2468] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:27.565862 23313 leader_election.cc:304] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.566797 23475 raft_consensus.cc:2804] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.568230 23475 raft_consensus.cc:697] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:27.542371 23470 raft_consensus.cc:740] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.568665 23469 ts_tablet_manager.cc:1434] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:09:27.569480 23470 consensus_queue.cc:260] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.573350 23470 ts_tablet_manager.cc:1434] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:09:27.570624 23542 raft_consensus.cc:515] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.574631 23469 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.573787 23422 raft_consensus.cc:2468] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:27.579681 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.580025 23542 leader_election.cc:290] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.580343 23424 raft_consensus.cc:3060] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.580706 23470 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:27.584062 23469 tablet_bootstrap.cc:654] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.575294 23472 raft_consensus.cc:359] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.569363 23475 consensus_queue.cc:237] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.585637 23468 tablet_bootstrap.cc:654] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.585533 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea08dc522141433e9b0d27a794aacdb0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:27.587941 23239 leader_election.cc:343] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.584951 23472 raft_consensus.cc:385] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.588894 23472 raft_consensus.cc:740] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.589666 23472 consensus_queue.cc:260] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.591807 23472 ts_tablet_manager.cc:1434] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:09:27.592900 23472 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.593304 23470 tablet_bootstrap.cc:654] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.594290 23424 raft_consensus.cc:2468] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:27.597790 23239 leader_election.cc:304] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.599436 23542 raft_consensus.cc:2804] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.599926 23528 consensus_queue.cc:1048] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.600085 23542 raft_consensus.cc:697] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:27.601887 23542 consensus_queue.cc:237] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.606637 23472 tablet_bootstrap.cc:654] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.611925 23468 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.612419 23468 ts_tablet_manager.cc:1403] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.003s
I20260709 13:09:27.613591 23097 catalog_manager.cc:5697] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.615532 23468 raft_consensus.cc:359] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.616514 23468 raft_consensus.cc:385] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.602702 23470 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.618398 23468 raft_consensus.cc:740] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.618865 23470 ts_tablet_manager.cc:1403] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:09:27.619216 23468 consensus_queue.cc:260] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.618083 23469 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.620504 23469 ts_tablet_manager.cc:1403] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.008s
I20260709 13:09:27.623504 23469 raft_consensus.cc:359] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.624221 23469 raft_consensus.cc:385] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.624550 23469 raft_consensus.cc:740] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.624373 23470 raft_consensus.cc:359] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.625168 23470 raft_consensus.cc:385] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.626196 23477 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.626770 23477 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.625437 23470 raft_consensus.cc:740] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.630196 23470 consensus_queue.cc:260] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.632241 23477 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.632798 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.633479 23350 raft_consensus.cc:2468] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.634600 23468 ts_tablet_manager.cc:1434] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260709 13:09:27.634392 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.635630 23468 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:27.636345 23164 leader_election.cc:343] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.635756 23096 catalog_manager.cc:5697] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.637048 23469 consensus_queue.cc:260] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.637687 23096 catalog_manager.cc:5697] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.639460 23469 ts_tablet_manager.cc:1434] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:09:27.639883 23165 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:27.640508 23469 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.641003 23477 raft_consensus.cc:2804] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.641376 23477 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.642010 23477 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.641274 23542 raft_consensus.cc:493] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.649040 23542 raft_consensus.cc:515] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.651099 23542 leader_election.cc:290] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:27.651937 23470 ts_tablet_manager.cc:1434] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:09:27.652518 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.652927 23470 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:27.654124 23239 leader_election.cc:343] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.654173 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.655485 23472 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.655977 23472 ts_tablet_manager.cc:1403] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.006s
W20260709 13:09:27.656387 23239 leader_election.cc:343] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.656874 23239 leader_election.cc:304] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.658452 23472 raft_consensus.cc:359] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.659003 23472 raft_consensus.cc:385] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.659204 23470 tablet_bootstrap.cc:654] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.659271 23472 raft_consensus.cc:740] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.660169 23472 consensus_queue.cc:260] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.660998 23491 raft_consensus.cc:2749] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.661187 23477 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.662303 23472 ts_tablet_manager.cc:1434] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:27.663311 23472 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.664038 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
W20260709 13:09:27.665953 23164 leader_election.cc:343] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.666457 23528 consensus_queue.cc:1048] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.670933 23477 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.671170 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.671862 23350 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.672936 23477 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.672976 23468 tablet_bootstrap.cc:654] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.673583 23477 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.677254 23469 tablet_bootstrap.cc:654] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.678445 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.681181 23275 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.679927 23350 raft_consensus.cc:2468] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.682300 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.682987 23349 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.684074 23165 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:27.684723 23164 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.686272 23528 consensus_queue.cc:1048] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.687739 23472 tablet_bootstrap.cc:654] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.687965 23528 raft_consensus.cc:2804] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.688512 23528 raft_consensus.cc:697] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.689384 23528 consensus_queue.cc:237] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.697196 23574 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.697801 23574 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.698200 23574 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.702339 23470 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.695797 23477 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.703006 23470 ts_tablet_manager.cc:1403] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.002s
I20260709 13:09:27.711601 23468 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.712059 23468 ts_tablet_manager.cc:1403] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.006s
I20260709 13:09:27.714255 23542 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.714802 23542 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.715099 23468 raft_consensus.cc:359] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.715827 23468 raft_consensus.cc:385] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.716040 23469 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.716136 23468 raft_consensus.cc:740] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.716868 23469 ts_tablet_manager.cc:1403] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.004s
I20260709 13:09:27.717206 23468 consensus_queue.cc:260] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.719401 23468 ts_tablet_manager.cc:1434] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:27.720293 23468 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.721540 23469 raft_consensus.cc:359] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.724934 23469 raft_consensus.cc:385] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.724117 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.724200 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.725312 23469 raft_consensus.cc:740] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.725770 23349 raft_consensus.cc:2393] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:27.726045 23469 consensus_queue.cc:260] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.727221 23240 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.728113 23491 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.728174 23469 ts_tablet_manager.cc:1434] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:27.729277 23469 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.729974 23468 tablet_bootstrap.cc:654] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.725780 23472 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.733366 23472 ts_tablet_manager.cc:1403] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.002s
I20260709 13:09:27.735754 23469 tablet_bootstrap.cc:654] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.735631 23472 raft_consensus.cc:359] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.736178 23472 raft_consensus.cc:385] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.736354 23472 raft_consensus.cc:740] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.736966 23542 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.739254 23574 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.741600 23491 raft_consensus.cc:2749] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.741107 23097 catalog_manager.cc:5697] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:27.742069 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:27.742913 23276 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.744946 23472 consensus_queue.cc:260] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.745692 23468 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.746218 23468 ts_tablet_manager.cc:1403] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 13:09:27.749429 23468 raft_consensus.cc:359] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.750114 23468 raft_consensus.cc:385] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.750379 23468 raft_consensus.cc:740] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.750981 23468 consensus_queue.cc:260] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.753033 23468 ts_tablet_manager.cc:1434] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:27.753639 23472 ts_tablet_manager.cc:1434] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:09:27.753949 23468 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.754274 23276 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.754635 23472 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.755483 23164 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.756290 23477 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.756804 23477 raft_consensus.cc:697] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.757685 23477 consensus_queue.cc:237] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:27.762223 23528 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.762769 23528 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.764536 23468 tablet_bootstrap.cc:654] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.765159 23470 raft_consensus.cc:359] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.765690 23470 raft_consensus.cc:385] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.765961 23528 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.766069 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.766776 23349 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.765980 23470 raft_consensus.cc:740] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.768131 23165 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.768517 23470 consensus_queue.cc:260] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.769330 23528 raft_consensus.cc:2804] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.769918 23528 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.770469 23528 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.772603 23535 raft_consensus.cc:493] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.772969 23573 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.773298 23535 raft_consensus.cc:515] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.776362 23535 leader_election.cc:290] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.773526 23573 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.778255 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:27.778842 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.777094 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.779552 23423 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
W20260709 13:09:27.780656 23388 leader_election.cc:343] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:27.781945 23387 leader_election.cc:343] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.782368 23387 leader_election.cc:304] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:27.782948 23573 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.783463 23535 raft_consensus.cc:2749] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.784121 23470 ts_tablet_manager.cc:1434] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.081s	user 0.006s	sys 0.002s
I20260709 13:09:27.782333 23468 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:27.784683 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.785367 23468 ts_tablet_manager.cc:1403] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:09:27.785513 23350 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.787997 23165 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.788219 23468 raft_consensus.cc:359] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.788957 23468 raft_consensus.cc:385] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.789232 23573 raft_consensus.cc:2804] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.789417 23472 tablet_bootstrap.cc:654] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.789685 23573 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.790098 23573 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.790040 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.790802 23423 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.796626 23470 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:27.789227 23468 raft_consensus.cc:740] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.799412 23574 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:27.799639 23468 consensus_queue.cc:260] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.802163 23468 ts_tablet_manager.cc:1434] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:27.803097 23468 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:27.800019 23574 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.804853 23528 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.805109 23574 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.806198 23470 tablet_bootstrap.cc:654] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.806994 23528 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.807202 23574 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.813345 23472 tablet_bootstrap.cc:492] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.813946 23472 ts_tablet_manager.cc:1403] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.003s
I20260709 13:09:27.815604 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.816504 23350 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.817469 23472 raft_consensus.cc:359] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.818111 23472 raft_consensus.cc:385] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.818439 23472 raft_consensus.cc:740] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.819139 23472 consensus_queue.cc:260] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.822409 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
W20260709 13:09:27.824084 23164 leader_election.cc:343] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.825310 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.825987 23349 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.825892 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.827339 23468 tablet_bootstrap.cc:654] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.828670 23472 ts_tablet_manager.cc:1434] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:27.830214 23472 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:27.837050 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.836962 23573 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.837929 23348 raft_consensus.cc:2468] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:27.838872 23472 tablet_bootstrap.cc:654] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.839589 23165 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.840091 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.840736 23348 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.841028 23477 raft_consensus.cc:2804] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:27.841454 23477 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.841838 23477 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.849464 23477 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.852787 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:27.858345 23347 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.860926 23469 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.861018 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.861557 23469 ts_tablet_manager.cc:1403] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.025s
I20260709 13:09:27.836249 23098 catalog_manager.cc:5697] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:27.873167 23164 leader_election.cc:343] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.864502 23469 raft_consensus.cc:359] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.874293 23469 raft_consensus.cc:385] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.874612 23469 raft_consensus.cc:740] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.877128 23469 consensus_queue.cc:260] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.878656 23491 raft_consensus.cc:493] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.879487 23469 ts_tablet_manager.cc:1434] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:09:27.879228 23491 raft_consensus.cc:515] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.859902 23477 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.884009 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:27.884559 23469 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:27.885452 23347 raft_consensus.cc:2468] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.885602 23491 leader_election.cc:290] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.887022 23165 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.887606 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7455f72bcbd4d8cb403b4f335ff13ff" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:27.888312 23582 raft_consensus.cc:2804] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.888883 23582 raft_consensus.cc:697] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.889685 23582 consensus_queue.cc:237] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.890199 23477 consensus_queue.cc:1048] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.892376 23240 leader_election.cc:304] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:27.893543 23349 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.894734 23165 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.896986 23528 raft_consensus.cc:2804] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.897569 23469 tablet_bootstrap.cc:654] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.897630 23528 raft_consensus.cc:697] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.899672 23528 consensus_queue.cc:237] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.901599 23491 raft_consensus.cc:2749] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.906409 23573 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:27.828884 23423 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.922606 23535 raft_consensus.cc:493] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.923220 23535 raft_consensus.cc:515] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.925416 23535 leader_election.cc:290] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:27.927682 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:27.930322 23387 leader_election.cc:343] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.927124 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:27.930634 23470 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:27.932044 23470 ts_tablet_manager.cc:1403] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.008s
I20260709 13:09:27.934671 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:27.935388 23424 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:27.935721 23470 raft_consensus.cc:359] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.936393 23470 raft_consensus.cc:385] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.936638 23470 raft_consensus.cc:740] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.944868 23348 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
W20260709 13:09:27.945681 23387 leader_election.cc:343] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:27.946125 23387 leader_election.cc:304] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:27.946777 23535 raft_consensus.cc:2749] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:27.946794 23469 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:27.947906 23469 ts_tablet_manager.cc:1403] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.010s
I20260709 13:09:27.952219 23469 raft_consensus.cc:359] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.952907 23469 raft_consensus.cc:385] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:27.952445 23470 consensus_queue.cc:260] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:27.953181 23469 raft_consensus.cc:740] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.953787 23165 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:27.953950 23469 consensus_queue.cc:260] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:27.954614 23528 raft_consensus.cc:2804] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:27.956910 23528 raft_consensus.cc:697] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:27.957840 23470 ts_tablet_manager.cc:1434] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:09:27.961836 23469 ts_tablet_manager.cc:1434] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:27.964357 23424 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.970404 23470 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:27.957739 23528 consensus_queue.cc:237] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:27.972309 23477 consensus_queue.cc:1048] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:27.935384 23350 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:27.976590 23491 consensus_queue.cc:1048] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:27.980051 23470 tablet_bootstrap.cc:654] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:27.981487 23535 raft_consensus.cc:493] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.988435 23472 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:27.989373 23472 ts_tablet_manager.cc:1403] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.159s	user 0.036s	sys 0.048s
I20260709 13:09:27.990753 23098 catalog_manager.cc:5697] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.991927 23098 catalog_manager.cc:5697] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:27.999379 23535 raft_consensus.cc:515] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.000427 23472 raft_consensus.cc:359] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.001240 23472 raft_consensus.cc:385] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.001564 23472 raft_consensus.cc:740] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.983214 23423 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:28.003784 23535 leader_election.cc:290] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.003994 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.004360 23535 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.004691 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.007011 23491 consensus_queue.cc:1048] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.004879 23535 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.009688 23535 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:28.009797 23472 consensus_queue.cc:260] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.004796 23275 raft_consensus.cc:2468] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:28.013598 23469 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.012741 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:28.014605 23388 leader_election.cc:343] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.016970 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.017858 23349 raft_consensus.cc:2393] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:28.020164 23387 leader_election.cc:304] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.020287 23388 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:28.022641 23472 ts_tablet_manager.cc:1434] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:09:28.023955 23472 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.024081 23468 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:28.024854 23468 ts_tablet_manager.cc:1403] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.222s	user 0.053s	sys 0.045s
I20260709 13:09:28.026731 23591 raft_consensus.cc:2804] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.020756 23469 tablet_bootstrap.cc:654] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.038172 23468 raft_consensus.cc:359] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.039233 23468 raft_consensus.cc:385] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.039597 23468 raft_consensus.cc:740] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.041020 23468 consensus_queue.cc:260] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.028568 23591 raft_consensus.cc:493] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.028538 23535 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.052125 23468 ts_tablet_manager.cc:1434] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:09:28.053755 23470 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:28.054489 23470 ts_tablet_manager.cc:1403] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.010s
I20260709 13:09:28.055708 23468 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:28.059927 23472 tablet_bootstrap.cc:654] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.060500 23475 consensus_queue.cc:1048] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.045830 23591 raft_consensus.cc:3060] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.070856 23535 raft_consensus.cc:2749] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.076206 23470 raft_consensus.cc:359] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.077260 23470 raft_consensus.cc:385] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.077554 23470 raft_consensus.cc:740] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.078415 23470 consensus_queue.cc:260] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.080832 23591 raft_consensus.cc:515] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.083361 23542 consensus_queue.cc:1048] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.086714 23468 tablet_bootstrap.cc:654] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.087662 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:28.088286 23275 raft_consensus.cc:3060] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.095667 23275 raft_consensus.cc:2468] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:28.097004 23387 leader_election.cc:304] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:28.097900 23535 raft_consensus.cc:2804] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.102398 23535 raft_consensus.cc:697] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:28.103317 23535 consensus_queue.cc:237] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.105644 23591 leader_election.cc:290] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.083901 23470 ts_tablet_manager.cc:1434] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
I20260709 13:09:28.107055 23472 tablet_bootstrap.cc:492] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:28.107563 23472 ts_tablet_manager.cc:1403] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.002s
I20260709 13:09:28.107746 23470 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:28.110257 23472 raft_consensus.cc:359] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.110987 23472 raft_consensus.cc:385] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.111152 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:28.111300 23508 consensus_queue.cc:1048] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:28.112884 23388 leader_election.cc:343] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.114984 23470 tablet_bootstrap.cc:654] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.111341 23472 raft_consensus.cc:740] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.121941 23472 consensus_queue.cc:260] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.124686 23472 ts_tablet_manager.cc:1434] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:09:28.125936 23472 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.128535 23508 raft_consensus.cc:493] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.129088 23508 raft_consensus.cc:515] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.131245 23508 leader_election.cc:290] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:28.132368 23472 tablet_bootstrap.cc:654] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.133989 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.137862 23275 raft_consensus.cc:2468] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:28.134020 23469 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:28.139725 23469 ts_tablet_manager.cc:1403] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.001s
I20260709 13:09:28.137166 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:28.146258 23422 raft_consensus.cc:2468] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:28.147946 23313 leader_election.cc:304] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:28.149636 23508 raft_consensus.cc:2804] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.150142 23508 raft_consensus.cc:493] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.150563 23508 raft_consensus.cc:3060] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.138257 23099 catalog_manager.cc:5697] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.164202 23469 raft_consensus.cc:359] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.171669 23469 raft_consensus.cc:385] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.172093 23469 raft_consensus.cc:740] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.173034 23469 consensus_queue.cc:260] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.176522 23469 ts_tablet_manager.cc:1434] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
W20260709 13:09:28.181600 23239 consensus_peers.cc:597] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.182509 23528 raft_consensus.cc:493] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.182895 23469 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.183023 23528 raft_consensus.cc:515] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.185213 23528 leader_election.cc:290] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:28.187120 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:28.188669 23165 leader_election.cc:343] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.195932 23469 tablet_bootstrap.cc:654] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.197842 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:28.198040 23491 raft_consensus.cc:493] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.198556 23422 raft_consensus.cc:2468] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:28.198508 23491 raft_consensus.cc:515] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.203344 23164 leader_election.cc:304] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.204238 23477 raft_consensus.cc:2804] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.204625 23477 raft_consensus.cc:493] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.205020 23477 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.213496 23470 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:28.213927 23470 ts_tablet_manager.cc:1403] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.107s	user 0.040s	sys 0.028s
I20260709 13:09:28.215901 23491 leader_election.cc:290] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.217067 23472 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:28.217566 23472 ts_tablet_manager.cc:1403] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.010s
I20260709 13:09:28.222127 23275 raft_consensus.cc:3060] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.227936 23470 raft_consensus.cc:359] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.228559 23470 raft_consensus.cc:385] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.228809 23470 raft_consensus.cc:740] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.229509 23470 consensus_queue.cc:260] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.230400 23535 raft_consensus.cc:493] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.230916 23535 raft_consensus.cc:515] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.231528 23470 ts_tablet_manager.cc:1434] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:09:28.233605 23535 leader_election.cc:290] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:28.235939 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:28.232689 23472 raft_consensus.cc:359] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.236812 23472 raft_consensus.cc:385] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.237129 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.237196 23472 raft_consensus.cc:740] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.237401 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.237967 23276 raft_consensus.cc:2468] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:28.238113 23350 raft_consensus.cc:2468] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:28.239248 23528 consensus_queue.cc:1048] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.239987 23477 raft_consensus.cc:515] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.240504 23240 leader_election.cc:304] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:28.242071 23491 raft_consensus.cc:2804] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.242267 23470 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:28.244100 23098 catalog_manager.cc:5697] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.247017 23477 leader_election.cc:290] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:28.245709 23472 consensus_queue.cc:260] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.250680 23472 ts_tablet_manager.cc:1434] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:09:28.251994 23472 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.254654 23469 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:28.255137 23469 ts_tablet_manager.cc:1403] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.005s
I20260709 13:09:28.257875 23469 raft_consensus.cc:359] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.258528 23469 raft_consensus.cc:385] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.258809 23469 raft_consensus.cc:740] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.259485 23469 consensus_queue.cc:260] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.242486 23491 raft_consensus.cc:493] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.249785 23508 raft_consensus.cc:515] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.265151 23468 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:28.265651 23468 ts_tablet_manager.cc:1403] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.213s	user 0.039s	sys 0.013s
I20260709 13:09:28.267251 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:28.268095 23276 raft_consensus.cc:3060] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.262492 23554 raft_consensus.cc:493] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.269475 23554 raft_consensus.cc:515] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.270525 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:28.271076 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:28.260279 23387 leader_election.cc:343] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.271718 23554 leader_election.cc:290] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.271905 23349 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.272223 23387 leader_election.cc:304] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:28.273375 23602 raft_consensus.cc:2804] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.273799 23602 raft_consensus.cc:493] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.268546 23468 raft_consensus.cc:359] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.274746 23468 raft_consensus.cc:385] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.275098 23468 raft_consensus.cc:740] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.275785 23468 consensus_queue.cc:260] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.276839 23472 tablet_bootstrap.cc:654] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.278589 23469 ts_tablet_manager.cc:1434] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:28.273980 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf352d9d7274a9fbbde27bf171e5a3e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.279867 23469 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.283663 23468 ts_tablet_manager.cc:1434] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:09:28.284505 23468 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:28.274582 23491 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.274196 23602 raft_consensus.cc:3060] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.294911 23468 tablet_bootstrap.cc:654] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:28.296373 23240 leader_election.cc:343] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.307241 23477 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:28.310362 23239 leader_election.cc:343] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.316258 23528 consensus_queue.cc:1048] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.318899 23273 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.319729 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf352d9d7274a9fbbde27bf171e5a3e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:28.320493 23200 raft_consensus.cc:2468] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:28.323719 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:28.324478 23422 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.325294 23239 leader_election.cc:304] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.328945 23477 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.309701 23470 tablet_bootstrap.cc:654] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.333886 23422 raft_consensus.cc:2468] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:28.345113 23469 tablet_bootstrap.cc:654] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.354338 23528 consensus_queue.cc:1048] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.336683 23508 leader_election.cc:290] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:28.367539 23491 raft_consensus.cc:515] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.345564 23349 raft_consensus.cc:2468] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:28.373795 23470 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
W20260709 13:09:28.378949 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:28.380888 23276 raft_consensus.cc:2468] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:28.383221 23470 ts_tablet_manager.cc:1403] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.006s
I20260709 13:09:28.380995 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aef9e8c7d8e4e56965d01215b5f0768" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:28.371408 23164 leader_election.cc:304] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:28.368269 23602 raft_consensus.cc:515] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.385005 23491 leader_election.cc:290] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.389899 23610 raft_consensus.cc:2804] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.388953 23574 raft_consensus.cc:2804] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.386879 23422 raft_consensus.cc:3060] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.390585 23610 raft_consensus.cc:493] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.391744 23574 raft_consensus.cc:697] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:28.396147 23610 raft_consensus.cc:3060] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.399541 23468 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:28.400108 23468 ts_tablet_manager.cc:1403] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.012s
I20260709 13:09:28.404575 23468 raft_consensus.cc:359] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.405345 23468 raft_consensus.cc:385] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.405707 23468 raft_consensus.cc:740] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.405429 23574 consensus_queue.cc:237] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.406502 23468 consensus_queue.cc:260] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.409129 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:28.410593 23387 leader_election.cc:343] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.411880 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f56852691524f04b8d536bd41ae154a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:28.411885 23610 raft_consensus.cc:515] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.412789 23276 raft_consensus.cc:3060] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.416113 23491 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.417546 23468 ts_tablet_manager.cc:1434] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:09:28.418869 23468 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:28.420403 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:28.421226 23469 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:28.422075 23469 ts_tablet_manager.cc:1403] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.008s
I20260709 13:09:28.416688 23491 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.425776 23469 raft_consensus.cc:359] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.426620 23469 raft_consensus.cc:385] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.426810 23491 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.427857 23470 raft_consensus.cc:359] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.426882 23469 raft_consensus.cc:740] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.421195 23346 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.397349 23313 leader_election.cc:304] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:28.428628 23470 raft_consensus.cc:385] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.431829 23535 raft_consensus.cc:493] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.433318 23469 consensus_queue.cc:260] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.433368 23470 raft_consensus.cc:740] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.416879 23602 leader_election.cc:290] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:28.441927 23469 ts_tablet_manager.cc:1434] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:28.447791 23276 raft_consensus.cc:2468] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:28.439013 23508 raft_consensus.cc:2804] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.450016 23508 raft_consensus.cc:697] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:28.450922 23508 consensus_queue.cc:237] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.435281 23535 raft_consensus.cc:515] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.430195 23610 leader_election.cc:290] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.466152 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:28.467284 23535 leader_election.cc:290] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.468360 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.471832 23574 raft_consensus.cc:493] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.472465 23574 raft_consensus.cc:515] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
W20260709 13:09:28.473870 23388 leader_election.cc:343] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.474098 23387 leader_election.cc:304] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:28.474943 23472 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:28.475580 23472 ts_tablet_manager.cc:1403] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.224s	user 0.018s	sys 0.004s
I20260709 13:09:28.476044 23470 consensus_queue.cc:260] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.480283 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf352d9d7274a9fbbde27bf171e5a3e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:28.480933 23348 raft_consensus.cc:3060] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.487039 23422 raft_consensus.cc:2468] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:28.477805 23535 raft_consensus.cc:2804] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.488305 23535 raft_consensus.cc:697] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:28.475003 23574 leader_election.cc:290] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.496686 23470 ts_tablet_manager.cc:1434] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.001s
I20260709 13:09:28.497589 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.498342 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf352d9d7274a9fbbde27bf171e5a3e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:28.499264 23200 raft_consensus.cc:3060] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.509559 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:28.513288 23165 leader_election.cc:343] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.514156 23573 consensus_queue.cc:1048] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:28.489225 23535 consensus_queue.cc:237] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.515865 23573 consensus_queue.cc:1048] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.524144 23472 raft_consensus.cc:359] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.525274 23472 raft_consensus.cc:385] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.525658 23472 raft_consensus.cc:740] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.526908 23472 consensus_queue.cc:260] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.539932 23468 tablet_bootstrap.cc:654] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.521312 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.624047 23472 ts_tablet_manager.cc:1434] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.148s	user 0.008s	sys 0.000s
I20260709 13:09:28.625460 23573 raft_consensus.cc:493] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.626165 23573 raft_consensus.cc:515] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.625339 23472 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.638209 23573 leader_election.cc:290] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.679644 23472 tablet_bootstrap.cc:654] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.673847 23573 consensus_queue.cc:1048] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:28.681921 23468 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:28.682508 23468 ts_tablet_manager.cc:1403] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.264s	user 0.010s	sys 0.004s
W20260709 13:09:28.794636 23239 leader_election.cc:343] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.795634 23574 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d522b0c35d264310bd559b320098c16e)
I20260709 13:09:28.796535 23574 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.799590 23574 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:28.833230 23273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:28.834939 23164 leader_election.cc:343] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.835426 23164 leader_election.cc:304] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.836252 23574 raft_consensus.cc:2749] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.840008 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:28.841369 23164 leader_election.cc:343] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.622114 23276 raft_consensus.cc:2468] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:28.850818 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:28.852408 23239 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:28.853688 23491 raft_consensus.cc:2749] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:28.854626 23469 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.860002 23469 tablet_bootstrap.cc:654] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.860140 23200 raft_consensus.cc:2468] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:28.861357 23239 leader_election.cc:304] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:28.862246 23491 raft_consensus.cc:2804] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.862780 23491 raft_consensus.cc:697] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:28.863648 23491 consensus_queue.cc:237] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.864845 23469 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:28.865334 23469 ts_tablet_manager.cc:1403] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:28.866216 23346 raft_consensus.cc:2468] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:28.867848 23469 raft_consensus.cc:359] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.868559 23469 raft_consensus.cc:385] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.868840 23469 raft_consensus.cc:740] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.869690 23468 raft_consensus.cc:359] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.869549 23469 consensus_queue.cc:260] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.870404 23468 raft_consensus.cc:385] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.870864 23468 raft_consensus.cc:740] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.871523 23468 consensus_queue.cc:260] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.871896 23469 ts_tablet_manager.cc:1434] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:28.873344 23535 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.873750 23468 ts_tablet_manager.cc:1434] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.191s	user 0.010s	sys 0.001s
I20260709 13:09:28.873847 23535 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.875466 23535 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:28.875757 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:28.876399 23420 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:28.877575 23164 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:28.878355 23574 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:28.878702 23574 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d522b0c35d264310bd559b320098c16e)
I20260709 13:09:28.879081 23574 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.883144 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:28.884269 23469 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.884949 23528 consensus_queue.cc:1048] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.888399 23528 consensus_queue.cc:1048] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.890847 23469 tablet_bootstrap.cc:654] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.892438 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.894114 23270 raft_consensus.cc:2393] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 2: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:28.898890 23472 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:28.899398 23472 ts_tablet_manager.cc:1403] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.274s	user 0.021s	sys 0.004s
I20260709 13:09:28.580132 23348 raft_consensus.cc:2468] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:28.902887 23491 raft_consensus.cc:493] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.903002 23472 raft_consensus.cc:359] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.903405 23491 raft_consensus.cc:515] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.903782 23472 raft_consensus.cc:385] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.904167 23472 raft_consensus.cc:740] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.904277 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.904974 23271 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:28.905561 23491 leader_election.cc:290] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:28.904978 23472 consensus_queue.cc:260] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.908308 23472 ts_tablet_manager.cc:1434] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:28.909359 23472 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.912863 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.915488 23240 leader_election.cc:304] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:28.916493 23611 raft_consensus.cc:2804] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:28.917037 23611 raft_consensus.cc:697] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:28.917825 23469 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:28.918530 23469 ts_tablet_manager.cc:1403] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.001s
I20260709 13:09:28.917894 23611 consensus_queue.cc:237] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:28.921665 23469 raft_consensus.cc:359] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.922633 23469 raft_consensus.cc:385] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.923008 23469 raft_consensus.cc:740] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.928509 23472 tablet_bootstrap.cc:654] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.930575 23387 leader_election.cc:304] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.923910 23469 consensus_queue.cc:260] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:28.935104 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:28.937103 23472 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:28.937806 23472 ts_tablet_manager.cc:1403] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
W20260709 13:09:28.938304 23165 leader_election.cc:343] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.938783 23165 leader_election.cc:304] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
W20260709 13:09:28.939949 23388 consensus_peers.cc:597] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:28.940755 23602 raft_consensus.cc:493] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:28.941051 23239 leader_election.cc:343] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.940402 23096 catalog_manager.cc:5697] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.941275 23602 raft_consensus.cc:515] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.942245 23469 ts_tablet_manager.cc:1434] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:09:28.943254 23469 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:28.943411 23602 leader_election.cc:290] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:28.943964 23602 raft_consensus.cc:2804] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:28.944283 23602 raft_consensus.cc:493] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.944640 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.944621 23602 raft_consensus.cc:3060] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:28.945936 23388 leader_election.cc:343] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.950332 23573 raft_consensus.cc:2749] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.951993 23469 tablet_bootstrap.cc:654] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.953096 23591 consensus_queue.cc:1048] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:28.955170 23472 raft_consensus.cc:359] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.955996 23472 raft_consensus.cc:385] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:28.956305 23472 raft_consensus.cc:740] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.957109 23472 consensus_queue.cc:260] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.953249 23387 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:28.959640 23472 ts_tablet_manager.cc:1434] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:28.960469 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:28.960997 23472 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:28.961978 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:28.963690 23574 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:28.965806 23574 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:28.969899 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:28.970969 23271 raft_consensus.cc:2393] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 2: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:28.971602 23470 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:28.974069 23468 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:28.977943 23387 leader_election.cc:343] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.978457 23387 leader_election.cc:304] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:28.964694 23200 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:28.979451 23472 tablet_bootstrap.cc:654] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:28.973981 23199 raft_consensus.cc:3060] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:28.985234 23602 raft_consensus.cc:515] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:28.988476 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:28.989837 23388 leader_election.cc:343] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:28.990926 23240 leader_election.cc:343] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:28.991425 23240 leader_election.cc:304] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:28.992548 23611 raft_consensus.cc:2749] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.995491 23098 catalog_manager.cc:5697] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:28.997018 23535 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:28.997496 23535 raft_consensus.cc:493] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.997020 23591 raft_consensus.cc:2749] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:28.997953 23535 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.002523 23469 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.003104 23469 ts_tablet_manager.cc:1403] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.018s
I20260709 13:09:29.006621 23469 raft_consensus.cc:359] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.007408 23469 raft_consensus.cc:385] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.007704 23469 raft_consensus.cc:740] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.008450 23469 consensus_queue.cc:260] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.008700 23608 consensus_queue.cc:1048] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.010368 23469 ts_tablet_manager.cc:1434] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:29.010620 23611 raft_consensus.cc:493] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.011500 23469 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.005471 23535 raft_consensus.cc:515] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.011153 23611 raft_consensus.cc:515] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.013370 23535 leader_election.cc:290] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.015486 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:29.015673 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:29.016299 23424 raft_consensus.cc:2368] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 for earlier term 2. Current term is 3.
I20260709 13:09:29.016425 23421 raft_consensus.cc:2468] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:29.017468 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.018843 23472 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.019083 23611 leader_election.cc:290] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.019404 23472 ts_tablet_manager.cc:1403] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.015s
I20260709 13:09:29.022570 23472 raft_consensus.cc:359] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.023229 23472 raft_consensus.cc:385] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.023490 23472 raft_consensus.cc:740] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.024145 23472 consensus_queue.cc:260] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:29.018846 23239 leader_election.cc:343] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.026324 23239 leader_election.cc:304] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.027813 23542 raft_consensus.cc:2804] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.028218 23542 raft_consensus.cc:493] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.028388 23472 ts_tablet_manager.cc:1434] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:29.028648 23542 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.029492 23472 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.035035 23469 tablet_bootstrap.cc:654] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.036680 23542 raft_consensus.cc:515] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.038074 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:29.038764 23274 raft_consensus.cc:3060] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.040596 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:29.041353 23421 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.042044 23470 tablet_bootstrap.cc:654] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.043756 23472 tablet_bootstrap.cc:654] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.053218 23542 leader_election.cc:290] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.051983 23274 raft_consensus.cc:2468] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:29.055320 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:29.056943 23239 leader_election.cc:343] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.061861 23468 tablet_bootstrap.cc:654] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.049239 23602 leader_election.cc:290] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:29.078004 23469 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.078959 23469 ts_tablet_manager.cc:1403] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.012s
I20260709 13:09:29.082777 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:29.083663 23271 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.083992 23574 consensus_queue.cc:1048] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.063675 23421 raft_consensus.cc:2468] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:29.087522 23239 leader_election.cc:304] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.088675 23542 raft_consensus.cc:2804] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.082780 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53b5776737c44f0399308aa71ba91184" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:29.089274 23542 raft_consensus.cc:697] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:29.089443 23200 raft_consensus.cc:3060] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.090155 23542 consensus_queue.cc:237] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.091733 23469 raft_consensus.cc:359] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.092742 23469 raft_consensus.cc:385] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.096975 23469 raft_consensus.cc:740] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.106498 23469 consensus_queue.cc:260] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.114041 23164 leader_election.cc:400] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Vote denied by peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951) with higher term. Message: Invalid argument: T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 for earlier term 2. Current term is 3.
I20260709 13:09:29.120074 23164 leader_election.cc:403] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:29.119980 23097 catalog_manager.cc:5697] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.121825 23574 consensus_queue.cc:1048] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.124640 23387 leader_election.cc:304] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:29.128654 23602 consensus_queue.cc:1048] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.130021 23602 raft_consensus.cc:2804] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.130462 23602 raft_consensus.cc:697] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:29.131347 23602 consensus_queue.cc:237] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.117388 23271 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 3.
I20260709 13:09:29.141260 23645 raft_consensus.cc:493] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.141935 23645 raft_consensus.cc:515] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.147087 23200 raft_consensus.cc:2468] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 3.
I20260709 13:09:29.148936 23640 raft_consensus.cc:2749] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951) with higher term. Message: Invalid argument: T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 for earlier term 2. Current term is 3.
I20260709 13:09:29.151098 23469 ts_tablet_manager.cc:1434] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.003s
I20260709 13:09:29.152376 23469 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.162262 23470 tablet_bootstrap.cc:492] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:29.162839 23470 ts_tablet_manager.cc:1403] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.191s	user 0.027s	sys 0.014s
I20260709 13:09:29.144665 23645 leader_election.cc:290] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.170411 23633 consensus_queue.cc:1048] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:29.174409 23470 raft_consensus.cc:359] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.175179 23470 raft_consensus.cc:385] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.175470 23470 raft_consensus.cc:740] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.176098 23472 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.176191 23470 consensus_queue.cc:260] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.177771 23472 ts_tablet_manager.cc:1403] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.149s	user 0.018s	sys 0.034s
I20260709 13:09:29.183054 23472 raft_consensus.cc:359] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.184013 23472 raft_consensus.cc:385] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.184362 23472 raft_consensus.cc:740] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.185233 23472 consensus_queue.cc:260] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.185560 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.185693 23387 leader_election.cc:304] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:29.186704 23387 consensus_peers.cc:597] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.190403 23468 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:29.190654 23472 ts_tablet_manager.cc:1434] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:29.190985 23468 ts_tablet_manager.cc:1403] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.217s	user 0.011s	sys 0.005s
I20260709 13:09:29.192399 23472 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.190121 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.202430 23270 raft_consensus.cc:2468] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:29.190323 23645 raft_consensus.cc:2804] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.204344 23645 raft_consensus.cc:697] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:29.204931 23099 catalog_manager.cc:5697] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.205452 23645 consensus_queue.cc:237] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.207116 23099 catalog_manager.cc:5697] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:29.208082 23387 leader_election.cc:343] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.210837 23469 tablet_bootstrap.cc:654] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.216925 23470 ts_tablet_manager.cc:1434] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 13:09:29.219156 23470 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:29.227483 23468 raft_consensus.cc:359] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.229013 23468 raft_consensus.cc:385] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.234189 23468 raft_consensus.cc:740] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.240803 23472 tablet_bootstrap.cc:654] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.234551 23387 leader_election.cc:304] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.255669 23468 consensus_queue.cc:260] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.261305 23468 ts_tablet_manager.cc:1434] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:09:29.260192 23602 raft_consensus.cc:2804] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.263787 23602 raft_consensus.cc:493] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.264196 23602 raft_consensus.cc:3060] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.261075 23645 raft_consensus.cc:493] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.267777 23645 raft_consensus.cc:515] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.269517 23468 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:29.269766 23470 tablet_bootstrap.cc:654] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.274806 23469 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.275406 23469 ts_tablet_manager.cc:1403] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.015s
I20260709 13:09:29.275807 23468 tablet_bootstrap.cc:654] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.279481 23469 raft_consensus.cc:359] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.282684 23542 consensus_queue.cc:1048] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.283133 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:29.289868 23388 leader_election.cc:343] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.287063 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.285719 23645 leader_election.cc:290] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.290923 23469 raft_consensus.cc:385] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.291453 23469 raft_consensus.cc:740] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
W20260709 13:09:29.291839 23387 leader_election.cc:343] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.294049 23387 leader_election.cc:304] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.295694 23645 raft_consensus.cc:2749] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.297482 23469 consensus_queue.cc:260] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.305730 23469 ts_tablet_manager.cc:1434] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:09:29.307574 23469 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.308475 23468 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:29.302591 23602 raft_consensus.cc:515] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.301697 23472 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.309005 23468 ts_tablet_manager.cc:1403] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.005s
I20260709 13:09:29.309409 23472 ts_tablet_manager.cc:1403] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.002s
I20260709 13:09:29.311601 23099 catalog_manager.cc:5697] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.324741 23542 consensus_queue.cc:1048] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.326843 23472 raft_consensus.cc:359] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.330216 23472 raft_consensus.cc:385] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.330735 23472 raft_consensus.cc:740] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.333546 23472 consensus_queue.cc:260] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.336655 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:29.342727 23387 leader_election.cc:343] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.343588 23468 raft_consensus.cc:359] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.344285 23468 raft_consensus.cc:385] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.344575 23468 raft_consensus.cc:740] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.346303 23472 ts_tablet_manager.cc:1434] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:09:29.349062 23472 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.351226 23468 consensus_queue.cc:260] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.349148 23470 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:29.351904 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:29.350350 23602 leader_election.cc:290] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.352484 23270 raft_consensus.cc:3060] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.352706 23470 ts_tablet_manager.cc:1403] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.065s
I20260709 13:09:29.356694 23469 tablet_bootstrap.cc:654] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.355666 23468 ts_tablet_manager.cc:1434] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 13:09:29.365067 23468 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:29.363677 23470 raft_consensus.cc:359] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.367835 23470 raft_consensus.cc:385] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.368191 23470 raft_consensus.cc:740] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.369164 23470 consensus_queue.cc:260] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.371713 23470 ts_tablet_manager.cc:1434] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:29.372109 23270 raft_consensus.cc:2468] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:29.372998 23602 raft_consensus.cc:493] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.373579 23602 raft_consensus.cc:515] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.374671 23468 tablet_bootstrap.cc:654] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.377705 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.378438 23200 raft_consensus.cc:2468] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:29.376473 23602 leader_election.cc:290] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.376447 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:29.380206 23387 leader_election.cc:304] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:29.380980 23388 leader_election.cc:343] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.362308 23472 tablet_bootstrap.cc:654] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.382257 23602 raft_consensus.cc:2804] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.382779 23602 raft_consensus.cc:493] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.383204 23602 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.385120 23387 leader_election.cc:304] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.386099 23645 raft_consensus.cc:2804] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.386626 23645 raft_consensus.cc:697] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:29.387471 23645 consensus_queue.cc:237] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.387382 23098 catalog_manager.cc:5697] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.393918 23470 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:29.389365 23098 catalog_manager.cc:5697] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.407411 23470 tablet_bootstrap.cc:654] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.411056 23535 raft_consensus.cc:493] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.411569 23535 raft_consensus.cc:515] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.413635 23535 leader_election.cc:290] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.416428 23542 consensus_queue.cc:1048] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.423434 23542 raft_consensus.cc:493] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.423930 23542 raft_consensus.cc:515] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.424011 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.426076 23542 leader_election.cc:290] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:29.427296 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.428020 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8397ef767c4037a55c7fa9e4be6ff6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:29.428753 23535 raft_consensus.cc:493] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.429279 23535 raft_consensus.cc:515] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.431226 23535 leader_election.cc:290] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.432929 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.432967 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:29.434734 23387 leader_election.cc:343] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:29.435439 23387 leader_election.cc:343] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:29.436061 23387 leader_election.cc:343] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:29.436303 23239 leader_election.cc:343] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.436462 23387 leader_election.cc:304] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.437347 23535 raft_consensus.cc:2749] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.437276 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8397ef767c4037a55c7fa9e4be6ff6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:29.438328 23349 raft_consensus.cc:2468] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
W20260709 13:09:29.439666 23387 leader_election.cc:343] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.439612 23240 leader_election.cc:304] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d522b0c35d264310bd559b320098c16e
I20260709 13:09:29.440845 23542 raft_consensus.cc:2804] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.441215 23542 raft_consensus.cc:493] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.441538 23542 raft_consensus.cc:3060] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.446693 23387 leader_election.cc:304] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.447646 23645 raft_consensus.cc:2749] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.449476 23508 raft_consensus.cc:493] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.450238 23508 raft_consensus.cc:515] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:29.447036 23239 consensus_peers.cc:597] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:29.453069 23602 raft_consensus.cc:515] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.458822 23508 leader_election.cc:290] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:29.449085 23469 tablet_bootstrap.cc:492] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.459903 23469 ts_tablet_manager.cc:1403] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.020s
I20260709 13:09:29.459889 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:29.461064 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:29.462512 23491 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.463027 23491 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.461223 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccc079d27d04f62bf9dc344d9bdb606" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.466084 23270 raft_consensus.cc:2393] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate d522b0c35d264310bd559b320098c16e in this term.
I20260709 13:09:29.466742 23469 raft_consensus.cc:359] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.467602 23469 raft_consensus.cc:385] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.467912 23469 raft_consensus.cc:740] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.468133 23491 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:29.467826 23099 catalog_manager.cc:5697] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:29.471558 23388 leader_election.cc:343] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.468894 23469 consensus_queue.cc:260] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.472122 23542 raft_consensus.cc:515] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.473147 23602 leader_election.cc:290] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.473507 23313 leader_election.cc:304] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:29.474083 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:29.474694 23200 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.474761 23508 raft_consensus.cc:3060] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.476125 23469 ts_tablet_manager.cc:1434] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:09:29.474228 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:29.477223 23469 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.481606 23200 raft_consensus.cc:2468] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:29.482731 23387 leader_election.cc:304] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
W20260709 13:09:29.482834 23240 leader_election.cc:343] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.492683 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8397ef767c4037a55c7fa9e4be6ff6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:29.493445 23421 raft_consensus.cc:3060] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.492233 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.501910 23508 raft_consensus.cc:2749] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.499676 23602 raft_consensus.cc:2804] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.506108 23602 raft_consensus.cc:697] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:29.507082 23602 consensus_queue.cc:237] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.508978 23421 raft_consensus.cc:2468] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:29.510021 23470 tablet_bootstrap.cc:492] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:29.513506 23470 ts_tablet_manager.cc:1403] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.141s	user 0.025s	sys 0.007s
I20260709 13:09:29.499038 23542 leader_election.cc:290] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:29.520097 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8397ef767c4037a55c7fa9e4be6ff6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:29.523751 23239 leader_election.cc:343] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.529492 23239 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.530678 23239 leader_election.cc:304] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:29.531030 23469 tablet_bootstrap.cc:654] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.531699 23611 raft_consensus.cc:2749] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.531859 23491 raft_consensus.cc:2804] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.527680 23468 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:29.533018 23468 ts_tablet_manager.cc:1403] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.168s	user 0.021s	sys 0.007s
I20260709 13:09:29.534053 23491 raft_consensus.cc:697] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:29.532605 23348 raft_consensus.cc:3060] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:29.535677 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:29.536180 23470 raft_consensus.cc:359] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.535148 23491 consensus_queue.cc:237] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.538198 23472 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.538515 23470 raft_consensus.cc:385] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.540484 23472 ts_tablet_manager.cc:1403] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.192s	user 0.024s	sys 0.037s
I20260709 13:09:29.540499 23470 raft_consensus.cc:740] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.541775 23348 raft_consensus.cc:2468] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:29.545109 23470 consensus_queue.cc:260] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.548416 23472 raft_consensus.cc:359] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.549546 23472 raft_consensus.cc:385] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.549898 23472 raft_consensus.cc:740] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.550631 23472 consensus_queue.cc:260] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.551170 23470 ts_tablet_manager.cc:1434] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:09:29.552094 23470 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:29.552572 23472 ts_tablet_manager.cc:1434] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:09:29.555358 23200 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.559166 23472 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.566205 23470 tablet_bootstrap.cc:654] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.569196 23468 raft_consensus.cc:359] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.570312 23468 raft_consensus.cc:385] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.570636 23468 raft_consensus.cc:740] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.573217 23099 catalog_manager.cc:5697] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.577157 23472 tablet_bootstrap.cc:654] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.582201 23468 consensus_queue.cc:260] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.584574 23468 ts_tablet_manager.cc:1434] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:09:29.587456 23468 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:29.590155 23491 consensus_queue.cc:1048] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.600395 23491 consensus_queue.cc:1048] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.607542 23468 tablet_bootstrap.cc:654] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.613772 23099 catalog_manager.cc:5697] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.638160 23469 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.638707 23469 ts_tablet_manager.cc:1403] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.004s
I20260709 13:09:29.639957 23470 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:29.640465 23470 ts_tablet_manager.cc:1403] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.089s	user 0.015s	sys 0.000s
I20260709 13:09:29.641567 23469 raft_consensus.cc:359] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.642282 23469 raft_consensus.cc:385] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.642551 23469 raft_consensus.cc:740] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.643216 23469 consensus_queue.cc:260] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.645115 23470 raft_consensus.cc:359] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.646090 23472 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.646677 23472 ts_tablet_manager.cc:1403] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.024s
I20260709 13:09:29.648443 23469 ts_tablet_manager.cc:1434] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:29.649412 23469 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.649610 23199 raft_consensus.cc:1275] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:29.650461 23472 raft_consensus.cc:359] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.651351 23472 raft_consensus.cc:385] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.651132 23602 consensus_queue.cc:1048] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:29.651786 23472 raft_consensus.cc:740] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.653035 23468 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:29.652627 23472 consensus_queue.cc:260] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.653532 23468 ts_tablet_manager.cc:1403] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.003s
I20260709 13:09:29.645816 23470 raft_consensus.cc:385] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.654464 23470 raft_consensus.cc:740] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.656430 23472 ts_tablet_manager.cc:1434] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:29.657588 23472 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.662729 23470 consensus_queue.cc:260] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.665359 23469 tablet_bootstrap.cc:654] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.668646 23472 tablet_bootstrap.cc:654] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.671533 23468 raft_consensus.cc:359] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.672549 23468 raft_consensus.cc:385] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.672902 23468 raft_consensus.cc:740] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.678606 23470 ts_tablet_manager.cc:1434] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:09:29.679579 23470 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:29.684279 23468 consensus_queue.cc:260] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.685871 23270 raft_consensus.cc:1275] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:29.689711 23654 consensus_queue.cc:1048] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.690335 23591 consensus_queue.cc:1048] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:29.693589 23130 debug-util.cc:398] Leaking SignalData structure 0x7b0800390760 after lost signal to thread 15324
W20260709 13:09:29.694818 23130 debug-util.cc:398] Leaking SignalData structure 0x7b08003376e0 after lost signal to thread 23133
W20260709 13:09:29.696177 23130 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3800 after lost signal to thread 23225
W20260709 13:09:29.709352 23130 debug-util.cc:398] Leaking SignalData structure 0x7b080038c800 after lost signal to thread 23300
W20260709 13:09:29.711120 23130 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3fc0 after lost signal to thread 23374
I20260709 13:09:29.711840 23468 ts_tablet_manager.cc:1434] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:09:29.712900 23468 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:29.740129 23470 tablet_bootstrap.cc:654] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.744122 23199 raft_consensus.cc:3060] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.745664 23468 tablet_bootstrap.cc:654] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.756655 23469 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.757289 23469 ts_tablet_manager.cc:1403] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.020s
I20260709 13:09:29.762091 23469 raft_consensus.cc:359] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.762832 23469 raft_consensus.cc:385] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.763139 23469 raft_consensus.cc:740] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.763885 23469 consensus_queue.cc:260] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:29.770006 23130 debug-util.cc:398] Leaking SignalData structure 0x7b0800170f80 after lost signal to thread 23448
I20260709 13:09:29.791762 23469 ts_tablet_manager.cc:1434] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 13:09:29.793406 23469 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:29.793880 23654 consensus_queue.cc:1048] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:29.797142 23491 raft_consensus.cc:493] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.797837 23491 raft_consensus.cc:515] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.801138 23491 leader_election.cc:290] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:29.803907 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:29.806421 23240 leader_election.cc:343] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.810707 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.811362 23200 raft_consensus.cc:2468] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:29.813400 23239 leader_election.cc:304] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:29.816156 23611 raft_consensus.cc:2804] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:29.816706 23611 raft_consensus.cc:493] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.817251 23611 raft_consensus.cc:3060] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.832006 23469 tablet_bootstrap.cc:654] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.839349 23654 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.848912 23654 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.851263 23654 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.852102 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:29.852311 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:29.853883 23387 leader_election.cc:343] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.851274 23472 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:29.855159 23611 raft_consensus.cc:515] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.855755 23472 ts_tablet_manager.cc:1403] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.198s	user 0.026s	sys 0.024s
W20260709 13:09:29.856907 23388 leader_election.cc:343] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.857538 23388 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.858997 23472 raft_consensus.cc:359] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.859719 23472 raft_consensus.cc:385] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.859926 23472 raft_consensus.cc:740] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.859093 23654 raft_consensus.cc:2749] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.861274 23472 consensus_queue.cc:260] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.869580 23611 leader_election.cc:290] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:29.871994 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:29.873266 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:29.874003 23200 raft_consensus.cc:3060] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.876222 23468 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:29.876832 23468 ts_tablet_manager.cc:1403] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.164s	user 0.032s	sys 0.045s
I20260709 13:09:29.864346 23645 raft_consensus.cc:493] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.878350 23645 raft_consensus.cc:515] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.880046 23468 raft_consensus.cc:359] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.880802 23468 raft_consensus.cc:385] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.881080 23468 raft_consensus.cc:740] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.871968 23470 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:29.882022 23470 ts_tablet_manager.cc:1403] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.203s	user 0.020s	sys 0.010s
I20260709 13:09:29.882843 23468 consensus_queue.cc:260] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.885600 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.886878 23469 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:29.880563 23645 leader_election.cc:290] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:29.887225 23472 ts_tablet_manager.cc:1434] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:09:29.887382 23469 ts_tablet_manager.cc:1403] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.000s
I20260709 13:09:29.889580 23574 raft_consensus.cc:493] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.890102 23574 raft_consensus.cc:515] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:29.891276 23469 raft_consensus.cc:359] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.891757 23469 raft_consensus.cc:385] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.891920 23469 raft_consensus.cc:740] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.892012 23574 leader_election.cc:290] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:29.892370 23469 consensus_queue.cc:260] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.893505 23472 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:29.893944 23469 ts_tablet_manager.cc:1434] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:29.894882 23469 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
W20260709 13:09:29.895301 23387 leader_election.cc:343] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.896111 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
W20260709 13:09:29.896569 23240 leader_election.cc:343] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.897188 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:29.898533 23654 consensus_queue.cc:1048] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:29.899026 23388 leader_election.cc:343] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.899513 23388 leader_election.cc:304] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:29.900271 23654 raft_consensus.cc:2749] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.900681 23469 tablet_bootstrap.cc:654] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.913257 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.916539 23164 leader_election.cc:304] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:29.917712 23573 raft_consensus.cc:2749] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:29.916807 23200 raft_consensus.cc:2468] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:29.918641 23470 raft_consensus.cc:359] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.919342 23470 raft_consensus.cc:385] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:29.919625 23470 raft_consensus.cc:740] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:29.920709 23470 consensus_queue.cc:260] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.921975 23468 ts_tablet_manager.cc:1434] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:09:29.922789 23239 leader_election.cc:304] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:29.925987 23468 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:29.928875 23200 raft_consensus.cc:3060] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.930188 23348 raft_consensus.cc:3060] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.933339 23611 raft_consensus.cc:2804] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:29.933943 23611 raft_consensus.cc:697] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:29.934755 23611 consensus_queue.cc:237] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.940079 23508 raft_consensus.cc:493] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.940594 23508 raft_consensus.cc:515] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:29.945873 23470 ts_tablet_manager.cc:1434] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.001s
I20260709 13:09:29.947642 23470 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:29.948726 23508 leader_election.cc:290] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:29.949702 23472 tablet_bootstrap.cc:654] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.959903 23468 tablet_bootstrap.cc:654] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.959947 23491 raft_consensus.cc:493] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.960685 23491 raft_consensus.cc:515] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:29.965400 23654 consensus_queue.cc:1048] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.967053 23645 consensus_queue.cc:1048] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:29.969267 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:29.977854 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:29.978159 23313 leader_election.cc:343] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:29.983410 23240 leader_election.cc:343] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:29.984165 23508 raft_consensus.cc:493] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.984812 23508 raft_consensus.cc:515] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:29.985417 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:29.986223 23421 raft_consensus.cc:2468] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:29.989975 23470 tablet_bootstrap.cc:654] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:29.994133 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:29.994915 23198 raft_consensus.cc:2468] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:29.994300 23200 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:29.971407 23491 leader_election.cc:290] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.001467 23542 consensus_queue.cc:1048] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.002585 23610 raft_consensus.cc:493] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.002979 23542 consensus_queue.cc:1048] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.003233 23610 raft_consensus.cc:515] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.006103 23610 leader_election.cc:290] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.003585 23239 leader_election.cc:304] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.020965 23469 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.021793 23469 ts_tablet_manager.cc:1403] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.127s	user 0.041s	sys 0.031s
I20260709 13:09:30.022425 23470 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:30.023190 23470 ts_tablet_manager.cc:1403] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.004s
I20260709 13:09:30.026120 23469 raft_consensus.cc:359] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.027077 23470 raft_consensus.cc:359] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.027910 23469 raft_consensus.cc:385] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.028680 23469 raft_consensus.cc:740] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.029786 23469 consensus_queue.cc:260] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.033609 23469 ts_tablet_manager.cc:1434] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:09:30.035643 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.028214 23470 raft_consensus.cc:385] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.036293 23470 raft_consensus.cc:740] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.038194 23469 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.011891 23491 raft_consensus.cc:2804] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.044574 23470 consensus_queue.cc:260] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:30.049448 23239 leader_election.cc:343] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.062469 23470 ts_tablet_manager.cc:1434] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:09:30.063949 23470 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:30.050251 23491 raft_consensus.cc:493] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.069530 23491 raft_consensus.cc:3060] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.076378 23469 tablet_bootstrap.cc:654] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.069010 23602 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.084064 23470 tablet_bootstrap.cc:654] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.086850 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.069267 23508 leader_election.cc:290] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.090922 23349 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.097869 23239 leader_election.cc:343] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.098456 23239 leader_election.cc:304] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:30.100823 23535 consensus_queue.cc:1048] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.102325 23097 catalog_manager.cc:5697] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.087427 23602 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.105319 23701 raft_consensus.cc:2749] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.105528 23602 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.106976 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:30.113160 23387 leader_election.cc:343] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.114238 23602 raft_consensus.cc:493] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.114933 23602 raft_consensus.cc:515] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.116736 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.119848 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:30.121479 23388 leader_election.cc:343] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.121995 23388 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.124514 23491 raft_consensus.cc:515] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.125041 23645 raft_consensus.cc:2749] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:30.126808 23387 leader_election.cc:343] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.127925 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:30.128726 23201 raft_consensus.cc:3060] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.131925 23602 leader_election.cc:290] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.127175 23491 leader_election.cc:290] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.144042 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.150780 23699 raft_consensus.cc:493] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d522b0c35d264310bd559b320098c16e)
W20260709 13:09:30.145635 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 115536us
I20260709 13:09:30.154103 23699 raft_consensus.cc:515] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.159076 23468 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:30.159619 23468 ts_tablet_manager.cc:1403] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.234s	user 0.018s	sys 0.012s
I20260709 13:09:30.161531 23313 leader_election.cc:304] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
W20260709 13:09:30.162055 23388 leader_election.cc:343] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.163383 23388 leader_election.cc:304] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.164428 23472 tablet_bootstrap.cc:492] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:30.164534 23535 raft_consensus.cc:2749] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.165339 23472 ts_tablet_manager.cc:1403] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.272s	user 0.017s	sys 0.003s
I20260709 13:09:30.168637 23706 raft_consensus.cc:2804] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.169186 23706 raft_consensus.cc:493] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.183907 23472 raft_consensus.cc:359] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.186632 23472 raft_consensus.cc:385] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.187018 23472 raft_consensus.cc:740] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
W20260709 13:09:30.185263 23705 log.cc:927] Time spent T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:09:30.188234 23699 leader_election.cc:290] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.184929 23706 raft_consensus.cc:3060] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.188526 23472 consensus_queue.cc:260] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.187394 23468 raft_consensus.cc:359] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.190467 23468 raft_consensus.cc:385] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.192724 23201 raft_consensus.cc:2468] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:30.194056 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.194562 23472 ts_tablet_manager.cc:1434] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:09:30.194442 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.197477 23611 raft_consensus.cc:493] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.190737 23468 raft_consensus.cc:740] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.197994 23611 raft_consensus.cc:515] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.198959 23468 consensus_queue.cc:260] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.200132 23611 leader_election.cc:290] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.202333 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.203063 23424 raft_consensus.cc:2468] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:30.205029 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.206095 23239 leader_election.cc:304] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:30.206772 23542 raft_consensus.cc:2804] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:30.206887 23239 leader_election.cc:343] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.207300 23542 raft_consensus.cc:697] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:30.207674 23239 leader_election.cc:304] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.208200 23542 consensus_queue.cc:237] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.210602 23611 raft_consensus.cc:2804] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.211014 23611 raft_consensus.cc:493] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.212592 23472 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:30.221109 23611 raft_consensus.cc:3060] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.232070 23699 raft_consensus.cc:493] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.237947 23699 raft_consensus.cc:515] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.240185 23699 leader_election.cc:290] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.241077 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:30.235075 23468 ts_tablet_manager.cc:1434] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.001s
I20260709 13:09:30.246204 23468 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:30.263923 23468 tablet_bootstrap.cc:654] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.265452 23640 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.266049 23640 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.271633 23313 leader_election.cc:304] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
W20260709 13:09:30.273175 23240 leader_election.cc:343] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.276377 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.278179 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.278381 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.279376 23270 raft_consensus.cc:2468] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:30.281322 23706 raft_consensus.cc:515] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.283354 23706 leader_election.cc:290] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.286314 23472 tablet_bootstrap.cc:654] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.287482 23702 raft_consensus.cc:2749] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.290861 23611 raft_consensus.cc:515] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.296811 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd2ca63fc294d39be8e4f0973531faa" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.297917 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.298751 23421 raft_consensus.cc:3060] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.301357 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.302250 23270 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:30.302881 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.305470 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.306136 23424 raft_consensus.cc:3060] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.307039 23165 leader_election.cc:343] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.308001 23164 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.309213 23574 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.309628 23574 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.309928 23470 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:30.309994 23574 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.268604 23640 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.311908 23470 ts_tablet_manager.cc:1403] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.248s	user 0.017s	sys 0.006s
I20260709 13:09:30.316093 23469 tablet_bootstrap.cc:492] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.313836 23424 raft_consensus.cc:2468] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:30.316601 23469 ts_tablet_manager.cc:1403] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.281s	user 0.016s	sys 0.027s
I20260709 13:09:30.319125 23469 raft_consensus.cc:359] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.319811 23469 raft_consensus.cc:385] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.320107 23469 raft_consensus.cc:740] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.322614 23574 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.325147 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f9304058a34b12bfa74024fb2c7221" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:30.325870 23270 raft_consensus.cc:3060] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.326082 23313 leader_election.cc:304] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:30.326506 23470 raft_consensus.cc:359] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.327165 23470 raft_consensus.cc:385] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.327369 23611 leader_election.cc:290] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.327445 23470 raft_consensus.cc:740] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.328251 23470 consensus_queue.cc:260] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.331746 23702 raft_consensus.cc:2804] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.331970 23468 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
W20260709 13:09:30.332185 23313 leader_election.cc:343] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d522b0c35d264310bd559b320098c16e (127.14.246.68:35951): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.332278 23702 raft_consensus.cc:493] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.332760 23468 ts_tablet_manager.cc:1403] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.004s
I20260709 13:09:30.332939 23702 raft_consensus.cc:3060] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.333427 23313 leader_election.cc:304] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:30.334508 23706 raft_consensus.cc:2749] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:30.336459 23469 consensus_queue.cc:260] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.336241 23468 raft_consensus.cc:359] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.341431 23468 raft_consensus.cc:385] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.341764 23468 raft_consensus.cc:740] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.342555 23468 consensus_queue.cc:260] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.344239 23468 ts_tablet_manager.cc:1434] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:30.344167 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:30.345000 23271 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.344730 23702 raft_consensus.cc:515] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.346839 23472 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:30.347137 23702 leader_election.cc:290] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.347743 23472 ts_tablet_manager.cc:1403] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.007s
I20260709 13:09:30.348992 23470 ts_tablet_manager.cc:1434] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:09:30.350118 23470 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:30.338759 23469 ts_tablet_manager.cc:1434] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:09:30.339522 23313 leader_election.cc:304] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:30.352505 23702 raft_consensus.cc:2804] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.353183 23702 raft_consensus.cc:697] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:30.353997 23702 consensus_queue.cc:237] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.340440 23574 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.356279 23469 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.357391 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:30.358646 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:30.359246 23274 raft_consensus.cc:3060] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.359687 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b06cf1e83964a088fa4cafd6bc76780" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.360282 23419 raft_consensus.cc:3060] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.362025 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:30.365284 23271 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
W20260709 13:09:30.370325 23239 leader_election.cc:343] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.365787 23469 tablet_bootstrap.cc:654] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:30.366724 23240 consensus_peers.cc:597] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:30.366813 23165 leader_election.cc:343] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.371503 23542 consensus_queue.cc:1048] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:30.351704 23472 raft_consensus.cc:359] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.377043 23468 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:30.377151 23472 raft_consensus.cc:385] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.390098 23472 raft_consensus.cc:740] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.383771 23098 catalog_manager.cc:5697] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.373508 23164 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.390766 23472 consensus_queue.cc:260] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.401252 23574 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.401966 23574 raft_consensus.cc:697] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:30.402817 23574 consensus_queue.cc:237] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.382071 23274 raft_consensus.cc:2468] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:30.415071 23470 tablet_bootstrap.cc:654] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.414700 23313 leader_election.cc:304] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:30.420537 23706 raft_consensus.cc:2804] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.389832 23421 raft_consensus.cc:2468] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:30.421115 23706 raft_consensus.cc:697] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:30.377365 23270 raft_consensus.cc:2468] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:30.431630 23469 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.393086 23419 raft_consensus.cc:2468] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:30.448203 23469 ts_tablet_manager.cc:1403] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.092s	user 0.029s	sys 0.010s
I20260709 13:09:30.450474 23470 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:30.450982 23470 ts_tablet_manager.cc:1403] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.002s
I20260709 13:09:30.452504 23468 tablet_bootstrap.cc:654] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.422952 23239 leader_election.cc:304] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.422346 23706 consensus_queue.cc:237] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.429812 23699 raft_consensus.cc:493] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.456269 23469 raft_consensus.cc:359] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.457201 23469 raft_consensus.cc:385] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.457561 23469 raft_consensus.cc:740] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.456840 23699 raft_consensus.cc:515] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.458724 23470 raft_consensus.cc:359] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.459407 23470 raft_consensus.cc:385] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.458482 23469 consensus_queue.cc:260] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.459584 23699 leader_election.cc:290] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:30.459651 23470 raft_consensus.cc:740] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.460628 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.466125 23470 consensus_queue.cc:260] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.468535 23470 ts_tablet_manager.cc:1434] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:09:30.469869 23469 ts_tablet_manager.cc:1434] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:30.472506 23611 raft_consensus.cc:2804] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.473330 23611 raft_consensus.cc:697] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:30.473753 23470 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:30.474221 23611 consensus_queue.cc:237] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.475647 23096 catalog_manager.cc:5697] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:30.477205 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 54353.9us
I20260709 13:09:30.469973 23099 catalog_manager.cc:5697] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.482407 23469 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.483505 23470 tablet_bootstrap.cc:654] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.488636 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58075f57a8b740fb8e4e030ce9f9fef3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.489881 23201 raft_consensus.cc:2393] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:30.491690 23313 leader_election.cc:304] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.492533 23706 raft_consensus.cc:3060] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.493743 23468 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:30.494339 23468 ts_tablet_manager.cc:1403] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.006s
I20260709 13:09:30.443579 23472 ts_tablet_manager.cc:1434] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:09:30.497367 23472 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:30.501531 23702 raft_consensus.cc:493] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.502096 23702 raft_consensus.cc:515] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.504217 23702 leader_election.cc:290] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.506371 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.507091 23421 raft_consensus.cc:2468] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:30.503942 23468 raft_consensus.cc:359] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.507987 23468 raft_consensus.cc:385] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.508121 23313 leader_election.cc:304] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:30.511415 23702 raft_consensus.cc:2804] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.512015 23702 raft_consensus.cc:493] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.512384 23702 raft_consensus.cc:3060] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.509058 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.511337 23706 raft_consensus.cc:2749] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.519698 23468 raft_consensus.cc:740] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.520452 23468 consensus_queue.cc:260] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.510253 23469 tablet_bootstrap.cc:654] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:30.534278 23313 leader_election.cc:343] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.537714 23468 ts_tablet_manager.cc:1434] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:09:30.538736 23468 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:30.541168 23472 tablet_bootstrap.cc:654] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.542353 23470 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:30.542896 23470 ts_tablet_manager.cc:1403] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.004s
I20260709 13:09:30.544378 23468 tablet_bootstrap.cc:654] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.554169 23470 raft_consensus.cc:359] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.558293 23470 raft_consensus.cc:385] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.558743 23470 raft_consensus.cc:740] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.562270 23470 consensus_queue.cc:260] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.555756 23702 raft_consensus.cc:515] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.558053 23654 raft_consensus.cc:493] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.567885 23654 raft_consensus.cc:515] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.571413 23719 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.571870 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.572733 23270 raft_consensus.cc:2468] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:30.572268 23719 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.571497 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:30.575184 23388 leader_election.cc:343] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.575767 23654 leader_election.cc:290] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.583071 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.584941 23387 leader_election.cc:304] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.586727 23654 raft_consensus.cc:2804] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.587103 23469 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.587618 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:30.587661 23165 leader_election.cc:343] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.588019 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.587649 23469 ts_tablet_manager.cc:1403] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.001s
I20260709 13:09:30.588707 23419 raft_consensus.cc:3060] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.587186 23654 raft_consensus.cc:493] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.590237 23654 raft_consensus.cc:3060] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.591858 23313 leader_election.cc:343] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.591650 23469 raft_consensus.cc:359] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.592429 23469 raft_consensus.cc:385] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.592736 23469 raft_consensus.cc:740] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.593482 23469 consensus_queue.cc:260] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.595839 23469 ts_tablet_manager.cc:1434] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:30.597525 23469 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.597792 23719 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.583148 23702 leader_election.cc:290] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.599992 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.600708 23419 raft_consensus.cc:2468] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:30.600842 23421 raft_consensus.cc:2468] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:30.604223 23469 tablet_bootstrap.cc:654] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.602253 23313 leader_election.cc:304] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.606287 23706 raft_consensus.cc:2804] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.606792 23706 raft_consensus.cc:697] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:30.606978 23470 ts_tablet_manager.cc:1434] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 13:09:30.606900 23699 raft_consensus.cc:493] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.608235 23470 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:30.607697 23699 raft_consensus.cc:515] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.607645 23706 consensus_queue.cc:237] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.610121 23699 leader_election.cc:290] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:30.612681 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.616472 23472 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:30.617044 23472 ts_tablet_manager.cc:1403] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.011s
I20260709 13:09:30.617880 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.618928 23164 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.584012 23099 catalog_manager.cc:5697] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.619941 23574 raft_consensus.cc:2804] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.620383 23574 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.620736 23574 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.620720 23313 leader_election.cc:304] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.622082 23706 raft_consensus.cc:2749] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.623638 23654 raft_consensus.cc:515] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.625999 23472 raft_consensus.cc:359] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.626721 23472 raft_consensus.cc:385] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.627027 23472 raft_consensus.cc:740] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.627031 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:30.627365 23098 catalog_manager.cc:5697] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:30.628682 23388 leader_election.cc:343] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.629726 23468 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:30.633946 23468 ts_tablet_manager.cc:1403] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.095s	user 0.018s	sys 0.002s
I20260709 13:09:30.635861 23574 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.637252 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:30.639482 23270 raft_consensus.cc:3060] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.639700 23574 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.641113 23611 consensus_queue.cc:1048] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.642838 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.643500 23421 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.645934 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:30.647331 23469 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
W20260709 13:09:30.647845 23165 leader_election.cc:343] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.648878 23469 ts_tablet_manager.cc:1403] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 13:09:30.649120 23468 raft_consensus.cc:359] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.650125 23468 raft_consensus.cc:385] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.650425 23468 raft_consensus.cc:740] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.651274 23468 consensus_queue.cc:260] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.651860 23421 raft_consensus.cc:2468] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:30.652434 23469 raft_consensus.cc:359] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.663028 23469 raft_consensus.cc:385] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.662849 23611 consensus_queue.cc:1048] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.663432 23469 raft_consensus.cc:740] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.664148 23469 consensus_queue.cc:260] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.630096 23472 consensus_queue.cc:260] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.666503 23469 ts_tablet_manager.cc:1434] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:09:30.667462 23469 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.667632 23472 ts_tablet_manager.cc:1434] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:09:30.668676 23472 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:30.673883 23602 raft_consensus.cc:493] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.674443 23602 raft_consensus.cc:515] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.675371 23469 tablet_bootstrap.cc:654] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.657570 23270 raft_consensus.cc:2468] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:30.658663 23468 ts_tablet_manager.cc:1434] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:30.677552 23164 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.678190 23602 leader_election.cc:290] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:30.679517 23468 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:30.684664 23719 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.685468 23719 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.678949 23574 raft_consensus.cc:2804] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.688422 23719 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.694025 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.695050 23274 raft_consensus.cc:2468] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 0.
I20260709 13:09:30.702533 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.703838 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.705268 23470 tablet_bootstrap.cc:654] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:30.707984 23165 leader_election.cc:343] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.693336 23574 raft_consensus.cc:697] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:30.681362 23654 leader_election.cc:290] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:30.721197 23574 consensus_queue.cc:237] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.725301 23345 raft_consensus.cc:3060] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.711228 23387 leader_election.cc:343] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.724462 23472 tablet_bootstrap.cc:654] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.730487 23468 tablet_bootstrap.cc:654] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.712431 23099 catalog_manager.cc:5697] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:30.738603 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.739370 23421 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:30.740442 23387 leader_election.cc:304] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.742626 23387 leader_election.cc:304] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.744859 23654 raft_consensus.cc:2804] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.745376 23602 raft_consensus.cc:2804] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.747455 23602 raft_consensus.cc:493] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.747854 23602 raft_consensus.cc:3060] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.752315 23164 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:30.753774 23640 raft_consensus.cc:2804] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.754201 23640 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.754598 23640 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.755906 23469 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.756492 23469 ts_tablet_manager.cc:1403] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.089s	user 0.030s	sys 0.033s
I20260709 13:09:30.761580 23469 raft_consensus.cc:359] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.762338 23469 raft_consensus.cc:385] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.762650 23469 raft_consensus.cc:740] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.765729 23470 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:30.765232 23469 consensus_queue.cc:260] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.775292 23602 raft_consensus.cc:515] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.767428 23573 raft_consensus.cc:493] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.782052 23573 raft_consensus.cc:515] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.784348 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:30.785887 23387 leader_election.cc:343] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.789779 23573 leader_election.cc:290] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:30.769708 23472 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:30.790934 23472 ts_tablet_manager.cc:1403] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.122s	user 0.006s	sys 0.014s
I20260709 13:09:30.791975 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:30.793376 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556266aaafcd47fbad094135c5d321d7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.794277 23419 raft_consensus.cc:2393] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:30.795591 23098 catalog_manager.cc:5697] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.792964 23469 ts_tablet_manager.cc:1434] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:09:30.796586 23164 leader_election.cc:304] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:30.797684 23469 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.799800 23574 raft_consensus.cc:3060] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.802476 23472 raft_consensus.cc:359] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.808451 23472 raft_consensus.cc:385] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.808915 23472 raft_consensus.cc:740] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.809846 23472 consensus_queue.cc:260] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.812129 23472 ts_tablet_manager.cc:1434] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:09:30.815802 23611 raft_consensus.cc:493] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.816308 23611 raft_consensus.cc:515] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.817631 23472 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:30.818486 23611 leader_election.cc:290] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.819494 23469 tablet_bootstrap.cc:654] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.820760 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:30.820822 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:30.822899 23421 raft_consensus.cc:2468] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:30.824502 23239 leader_election.cc:304] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:30.766315 23470 ts_tablet_manager.cc:1403] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.158s	user 0.011s	sys 0.001s
I20260709 13:09:30.825212 23602 leader_election.cc:290] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:30.825466 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8ce9b3559b43c4b1aeab0a4dd28f75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:30.826205 23274 raft_consensus.cc:3060] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.826251 23712 raft_consensus.cc:2804] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:30.826853 23712 raft_consensus.cc:493] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.827203 23712 raft_consensus.cc:3060] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.827996 23470 raft_consensus.cc:359] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:30.825670 23239 leader_election.cc:343] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.828743 23470 raft_consensus.cc:385] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.839504 23470 raft_consensus.cc:740] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.829005 23640 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.839987 23469 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.831694 23468 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:30.847820 23469 ts_tablet_manager.cc:1403] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 13:09:30.847954 23468 ts_tablet_manager.cc:1403] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.004s
W20260709 13:09:30.841233 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:30.840291 23470 consensus_queue.cc:260] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.836076 23712 raft_consensus.cc:515] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.851827 23712 leader_election.cc:290] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.836490 23654 raft_consensus.cc:697] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:30.853044 23654 consensus_queue.cc:237] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.854707 23468 raft_consensus.cc:359] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.855526 23468 raft_consensus.cc:385] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.856216 23468 raft_consensus.cc:740] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.857055 23468 consensus_queue.cc:260] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.858417 23470 ts_tablet_manager.cc:1434] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 13:09:30.835870 23472 tablet_bootstrap.cc:654] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.847064 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:30.859092 23348 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:30.860689 23165 consensus_peers.cc:597] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.862383 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.862895 23468 ts_tablet_manager.cc:1434] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:30.862998 23419 raft_consensus.cc:3060] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.864060 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:30.865249 23640 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:30.865346 23469 raft_consensus.cc:359] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.865825 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:30.866140 23469 raft_consensus.cc:385] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.830049 23574 raft_consensus.cc:2749] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:30.866613 23421 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.838528 23274 raft_consensus.cc:2468] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:30.869127 23468 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:30.869292 23239 leader_election.cc:343] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.873108 23387 leader_election.cc:304] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.875394 23738 raft_consensus.cc:2804] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.875986 23738 raft_consensus.cc:697] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:30.876904 23738 consensus_queue.cc:237] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.880357 23348 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:30.866555 23469 raft_consensus.cc:740] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.881987 23468 tablet_bootstrap.cc:654] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.882339 23419 raft_consensus.cc:2468] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:30.889045 23421 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:30.889063 23469 consensus_queue.cc:260] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:30.891027 23164 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:30.891872 23574 raft_consensus.cc:2804] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.892612 23574 raft_consensus.cc:697] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:30.893151 23469 ts_tablet_manager.cc:1434] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:09:30.893528 23574 consensus_queue.cc:237] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.894263 23469 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:30.894608 23239 leader_election.cc:304] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:30.895471 23712 raft_consensus.cc:2804] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.896863 23712 raft_consensus.cc:697] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:30.898321 23712 consensus_queue.cc:237] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.913959 23470 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:30.922308 23472 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:30.922935 23472 ts_tablet_manager.cc:1403] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.005s
I20260709 13:09:30.924955 23468 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:30.925480 23468 ts_tablet_manager.cc:1403] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.004s
I20260709 13:09:30.926074 23469 tablet_bootstrap.cc:654] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.929193 23468 raft_consensus.cc:359] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.930294 23468 raft_consensus.cc:385] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.930678 23468 raft_consensus.cc:740] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.932893 23468 consensus_queue.cc:260] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:30.940822 23472 raft_consensus.cc:359] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.971402 23472 raft_consensus.cc:385] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.971696 23468 ts_tablet_manager.cc:1434] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:09:30.971746 23472 raft_consensus.cc:740] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.972831 23472 consensus_queue.cc:260] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:30.975183 23472 ts_tablet_manager.cc:1434] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.052s	user 0.013s	sys 0.003s
I20260709 13:09:30.972599 23096 catalog_manager.cc:5697] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.975699 23468 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:30.977785 23654 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.978332 23654 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:30.980543 23472 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:30.980732 23654 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:30.982797 23470 tablet_bootstrap.cc:654] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.980343 23706 consensus_queue.cc:1048] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:30.981968 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:30.985648 23387 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.982290 23098 catalog_manager.cc:5697] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:30.983471 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:30.988102 23702 consensus_queue.cc:1048] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:30.990935 23469 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:30.991451 23469 ts_tablet_manager.cc:1403] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.016s
W20260709 13:09:30.995059 23388 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:30.995604 23388 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.004788 23611 consensus_queue.cc:1048] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.002241 23738 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.010499 23469 raft_consensus.cc:359] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.011371 23699 consensus_queue.cc:1048] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.014056 23469 raft_consensus.cc:385] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.014495 23469 raft_consensus.cc:740] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.014791 23468 tablet_bootstrap.cc:654] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.015399 23469 consensus_queue.cc:260] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.018257 23469 ts_tablet_manager.cc:1434] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.004s
I20260709 13:09:31.019333 23469 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.021457 23099 catalog_manager.cc:5697] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.045887 23469 tablet_bootstrap.cc:654] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.030860 23654 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.004573 23574 consensus_queue.cc:1048] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 13:09:31.059494 23702 consensus_queue.cc:1048] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.060995 23712 consensus_queue.cc:1048] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.062866 23472 tablet_bootstrap.cc:654] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.053341 23654 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:31.071410 23746 log.cc:927] Time spent T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:09:31.073072 23542 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.081758 23542 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.084472 23542 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.093030 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.096163 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:31.097790 23239 leader_election.cc:343] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.121237 23200 raft_consensus.cc:3060] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:31.122572 23240 leader_election.cc:343] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.123092 23240 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.124553 23468 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:31.125110 23468 ts_tablet_manager.cc:1403] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.024s
I20260709 13:09:31.132421 23712 raft_consensus.cc:2749] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.143975 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:31.150554 23387 leader_election.cc:343] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.154242 23654 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:31.157158 23472 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:31.157680 23470 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:31.157778 23472 ts_tablet_manager.cc:1403] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.182s	user 0.008s	sys 0.015s
I20260709 13:09:31.158273 23470 ts_tablet_manager.cc:1403] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.022s
I20260709 13:09:31.161324 23470 raft_consensus.cc:359] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.164212 23470 raft_consensus.cc:385] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.164546 23470 raft_consensus.cc:740] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.165488 23469 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.165972 23469 ts_tablet_manager.cc:1403] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.015s
I20260709 13:09:31.166694 23472 raft_consensus.cc:359] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.167289 23472 raft_consensus.cc:385] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.167514 23472 raft_consensus.cc:740] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.168047 23472 consensus_queue.cc:260] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.175474 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.176242 23469 raft_consensus.cc:359] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.178222 23469 raft_consensus.cc:385] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.178504 23469 raft_consensus.cc:740] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.183527 23470 consensus_queue.cc:260] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:31.188266 23387 leader_election.cc:343] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.188727 23387 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.192080 23468 raft_consensus.cc:359] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.193169 23468 raft_consensus.cc:385] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.194813 23472 ts_tablet_manager.cc:1434] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:09:31.196287 23472 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:31.199263 23602 raft_consensus.cc:2749] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:31.185159 23240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 62624.8us
I20260709 13:09:31.193557 23468 raft_consensus.cc:740] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.227344 23468 consensus_queue.cc:260] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.208413 23611 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.212579 23469 consensus_queue.cc:260] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.235594 23574 raft_consensus.cc:493] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.238303 23469 ts_tablet_manager.cc:1434] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260709 13:09:31.238948 23472 tablet_bootstrap.cc:654] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.239328 23469 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.243517 23699 consensus_queue.cc:1048] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:31.246603 23165 consensus_peers.cc:597] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.246556 23699 consensus_queue.cc:1048] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:31.250754 23640 raft_consensus.cc:493] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.255964 23640 raft_consensus.cc:515] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.259150 23640 leader_election.cc:290] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:31.253300 23611 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.262903 23611 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.265216 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.270920 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.271821 23468 ts_tablet_manager.cc:1434] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.000s
I20260709 13:09:31.273901 23164 leader_election.cc:304] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:31.275657 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:31.277544 23239 leader_election.cc:343] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.278093 23468 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:31.279842 23470 ts_tablet_manager.cc:1434] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.000s
I20260709 13:09:31.280752 23470 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:31.294828 23469 tablet_bootstrap.cc:654] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.236349 23574 raft_consensus.cc:515] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.281731 23640 raft_consensus.cc:2749] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:31.318877 23738 raft_consensus.cc:493] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.320163 23654 raft_consensus.cc:493] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.354888 23197 raft_consensus.cc:3060] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.355649 23574 leader_election.cc:290] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:31.350459 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.346418 23654 raft_consensus.cc:515] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.377368 23654 leader_election.cc:290] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.378620 23272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.345873 23738 raft_consensus.cc:515] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.381727 23738 leader_election.cc:290] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.382886 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ec35ce0e459e94385c9b04253e33" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.383683 23419 raft_consensus.cc:2393] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:31.386433 23469 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.386816 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:31.388278 23388 leader_election.cc:343] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.386997 23469 ts_tablet_manager.cc:1403] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.008s
I20260709 13:09:31.392246 23164 leader_election.cc:304] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:31.391472 23469 raft_consensus.cc:359] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.394415 23469 raft_consensus.cc:385] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.394665 23469 raft_consensus.cc:740] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.396245 23767 consensus_queue.cc:1048] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.396737 23472 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:31.397284 23472 ts_tablet_manager.cc:1403] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.041s
I20260709 13:09:31.399089 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.400594 23766 consensus_queue.cc:1048] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.401291 23469 consensus_queue.cc:260] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.403303 23469 ts_tablet_manager.cc:1434] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:09:31.404202 23469 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.405987 23468 tablet_bootstrap.cc:654] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.406755 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.410336 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:31.412047 23387 leader_election.cc:343] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.412525 23387 leader_election.cc:304] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:31.412712 23472 raft_consensus.cc:359] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.413434 23472 raft_consensus.cc:385] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.413722 23472 raft_consensus.cc:740] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
W20260709 13:09:31.414124 23387 leader_election.cc:343] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.414276 23591 raft_consensus.cc:2749] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.414395 23472 consensus_queue.cc:260] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.414824 23602 consensus_queue.cc:1048] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.416567 23472 ts_tablet_manager.cc:1434] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.003s
W20260709 13:09:31.416921 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 54588.9us
I20260709 13:09:31.420503 23472 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:31.419632 23469 tablet_bootstrap.cc:654] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:31.423887 23240 leader_election.cc:343] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.424461 23240 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.384670 23470 tablet_bootstrap.cc:654] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.426584 23542 raft_consensus.cc:2749] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.431366 23472 tablet_bootstrap.cc:654] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.434697 23719 consensus_queue.cc:1048] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.440063 23469 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.440579 23469 ts_tablet_manager.cc:1403] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.001s
I20260709 13:09:31.443583 23654 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.443632 23469 raft_consensus.cc:359] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.444348 23654 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.444550 23469 raft_consensus.cc:385] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.446763 23654 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.446250 23469 raft_consensus.cc:740] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.447742 23469 consensus_queue.cc:260] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.450070 23469 ts_tablet_manager.cc:1434] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:31.450981 23469 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.451663 23472 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:31.452140 23472 ts_tablet_manager.cc:1403] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.032s	user 0.003s	sys 0.008s
I20260709 13:09:31.454861 23472 raft_consensus.cc:359] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.455617 23472 raft_consensus.cc:385] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.456619 23469 tablet_bootstrap.cc:654] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.455868 23472 raft_consensus.cc:740] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.457679 23472 consensus_queue.cc:260] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:31.461328 23165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 110255us
I20260709 13:09:31.462170 23472 ts_tablet_manager.cc:1434] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
W20260709 13:09:31.423889 23388 leader_election.cc:343] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.470500 23472 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:31.471150 23388 leader_election.cc:304] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:31.472199 23738 raft_consensus.cc:2749] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.466730 23469 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.467788 23640 consensus_queue.cc:1048] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:31.473732 23469 ts_tablet_manager.cc:1403] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
W20260709 13:09:31.476080 23388 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 52233.8us
I20260709 13:09:31.477124 23469 raft_consensus.cc:359] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.478010 23469 raft_consensus.cc:385] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.478283 23469 raft_consensus.cc:740] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.478382 23472 tablet_bootstrap.cc:654] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.478936 23469 consensus_queue.cc:260] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.481657 23469 ts_tablet_manager.cc:1434] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:31.483381 23469 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.485030 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:31.487197 23388 consensus_peers.cc:597] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:31.489075 23388 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.491168 23469 tablet_bootstrap.cc:654] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.498142 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.502734 23774 raft_consensus.cc:493] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.503265 23774 raft_consensus.cc:515] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.506431 23611 consensus_queue.cc:1048] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.506839 23774 leader_election.cc:290] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.508627 23201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:31.509992 23313 leader_election.cc:343] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.510344 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.512130 23574 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.512902 23472 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:31.512857 23574 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.516597 23574 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.516705 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.513770 23472 ts_tablet_manager.cc:1403] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.002s
I20260709 13:09:31.518607 23654 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.517494 23274 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:31.528666 23469 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.512625 23419 raft_consensus.cc:2468] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:31.525259 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.529400 23164 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:31.529217 23469 ts_tablet_manager.cc:1403] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.008s
I20260709 13:09:31.525285 23654 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.530913 23574 raft_consensus.cc:2804] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.532807 23574 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.533782 23654 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:31.532366 23165 leader_election.cc:343] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.534024 23574 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.537371 23654 consensus_queue.cc:1048] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:31.539189 23469 raft_consensus.cc:359] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.540011 23469 raft_consensus.cc:385] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.540314 23469 raft_consensus.cc:740] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.541049 23469 consensus_queue.cc:260] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.543480 23313 leader_election.cc:304] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.544245 23774 raft_consensus.cc:2804] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.544618 23774 raft_consensus.cc:493] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.544987 23774 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.547446 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.550153 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.553860 23774 raft_consensus.cc:515] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.555490 23469 ts_tablet_manager.cc:1434] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:31.556553 23469 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.559617 23491 raft_consensus.cc:493] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.560143 23491 raft_consensus.cc:515] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.560681 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:31.561319 23423 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.561430 23774 leader_election.cc:290] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.562728 23491 leader_election.cc:290] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:31.566250 23469 tablet_bootstrap.cc:654] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.567494 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:31.569023 23313 leader_election.cc:343] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.569741 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.570245 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.570585 23419 raft_consensus.cc:2468] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:31.571961 23239 leader_election.cc:304] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:31.570277 23423 raft_consensus.cc:2468] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:31.574048 23771 raft_consensus.cc:2804] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.574446 23771 raft_consensus.cc:493] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.574752 23771 raft_consensus.cc:3060] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.495595 23096 catalog_manager.cc:5697] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 1 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:31.577253 23240 leader_election.cc:343] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.579226 23313 leader_election.cc:304] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.580030 23774 raft_consensus.cc:2804] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.586984 23654 raft_consensus.cc:493] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.587527 23654 raft_consensus.cc:515] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.580521 23774 raft_consensus.cc:697] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:31.589416 23774 consensus_queue.cc:237] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.589692 23654 leader_election.cc:290] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.590772 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:31.591982 23387 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.592418 23387 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.593356 23738 raft_consensus.cc:2749] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:31.594626 23388 leader_election.cc:343] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.607874 23767 raft_consensus.cc:2749] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.594411 23472 raft_consensus.cc:359] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.612274 23472 raft_consensus.cc:385] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.612560 23472 raft_consensus.cc:740] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.614928 23472 consensus_queue.cc:260] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.617108 23472 ts_tablet_manager.cc:1434] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.001s
I20260709 13:09:31.618069 23472 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
W20260709 13:09:31.593843 23387 consensus_peers.cc:597] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:31.621829 23470 tablet_bootstrap.cc:492] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
W20260709 13:09:31.622601 23387 leader_election.cc:343] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.628882 23472 tablet_bootstrap.cc:654] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:31.632453 23387 leader_election.cc:343] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.632979 23387 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.633744 23738 raft_consensus.cc:2749] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.624486 23574 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.637641 23574 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.625998 23771 raft_consensus.cc:515] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.626824 23468 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:31.641495 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:31.640127 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:31.644752 23738 raft_consensus.cc:493] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.651638 23270 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:31.651923 23165 leader_election.cc:343] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.652624 23738 raft_consensus.cc:515] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.658749 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.658990 23738 leader_election.cc:290] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
W20260709 13:09:31.660073 23388 leader_election.cc:343] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.639724 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:31.676127 23270 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:31.679808 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:31.685109 23387 leader_election.cc:343] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.685941 23387 leader_election.cc:304] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:31.686731 23738 raft_consensus.cc:2749] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.688930 23164 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
W20260709 13:09:31.689625 23387 leader_election.cc:343] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.690104 23574 raft_consensus.cc:2804] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.690091 23387 leader_election.cc:304] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:31.690673 23574 raft_consensus.cc:697] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:31.691116 23738 raft_consensus.cc:2749] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.691462 23574 consensus_queue.cc:237] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.640069 23469 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.704537 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:31.705423 23469 ts_tablet_manager.cc:1403] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.019s
I20260709 13:09:31.706000 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
W20260709 13:09:31.725700 23240 leader_election.cc:343] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.725670 23421 raft_consensus.cc:3060] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.727854 23469 raft_consensus.cc:359] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.728567 23469 raft_consensus.cc:385] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.729439 23469 raft_consensus.cc:740] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.730110 23469 consensus_queue.cc:260] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.733202 23469 ts_tablet_manager.cc:1434] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:31.734108 23469 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.739815 23469 tablet_bootstrap.cc:654] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.758123 23469 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:31.758622 23469 ts_tablet_manager.cc:1403] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:09:31.759362 23421 raft_consensus.cc:2468] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:31.760947 23239 leader_election.cc:304] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:31.762974 23542 raft_consensus.cc:2804] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.763496 23542 raft_consensus.cc:697] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:31.712656 23097 catalog_manager.cc:5697] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.702086 23468 ts_tablet_manager.cc:1403] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.428s	user 0.012s	sys 0.012s
I20260709 13:09:31.764402 23542 consensus_queue.cc:237] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.701572 23470 ts_tablet_manager.cc:1403] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.421s	user 0.022s	sys 0.000s
I20260709 13:09:31.767593 23468 raft_consensus.cc:359] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.768260 23468 raft_consensus.cc:385] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.768527 23468 raft_consensus.cc:740] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.769222 23470 raft_consensus.cc:359] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.769328 23468 consensus_queue.cc:260] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.704746 23771 leader_election.cc:290] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:31.724314 23472 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:31.769973 23470 raft_consensus.cc:385] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.772455 23470 raft_consensus.cc:740] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.769321 23469 raft_consensus.cc:359] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.772135 23472 ts_tablet_manager.cc:1403] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.030s
I20260709 13:09:31.773762 23469 raft_consensus.cc:385] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.774220 23469 raft_consensus.cc:740] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.774858 23469 consensus_queue.cc:260] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.776268 23472 raft_consensus.cc:359] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.777300 23472 raft_consensus.cc:385] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.777300 23469 ts_tablet_manager.cc:1434] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:09:31.773319 23470 consensus_queue.cc:260] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.778158 23472 raft_consensus.cc:740] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.778534 23469 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:31.779281 23472 consensus_queue.cc:260] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.780534 23771 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.782207 23771 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:31.784240 23771 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:31.785334 23469 tablet_bootstrap.cc:654] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.785813 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.772612 23468 ts_tablet_manager.cc:1434] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:31.788635 23468 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:31.794015 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.781404 23470 ts_tablet_manager.cc:1434] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:31.796272 23470 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:31.796933 23239 leader_election.cc:343] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.790166 23472 ts_tablet_manager.cc:1434] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:09:31.798359 23472 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:31.805418 23096 catalog_manager.cc:5697] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.806435 23472 tablet_bootstrap.cc:654] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:31.792797 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 67887us
I20260709 13:09:31.814112 23468 tablet_bootstrap.cc:654] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.799685 23469 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
W20260709 13:09:31.800066 23240 leader_election.cc:343] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.824810 23240 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.825013 23469 ts_tablet_manager.cc:1403] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.003s
I20260709 13:09:31.827203 23771 raft_consensus.cc:2749] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.828612 23542 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.829118 23542 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.831032 23542 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.833838 23095 catalog_manager.cc:5697] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:31.844547 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.836627 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.846414 23422 raft_consensus.cc:2468] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
W20260709 13:09:31.851022 23239 leader_election.cc:343] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.851692 23239 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.853178 23491 raft_consensus.cc:2804] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.853721 23491 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.854053 23491 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.860565 23491 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.868032 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:31.868821 23422 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.868878 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:31.870642 23239 leader_election.cc:343] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.880012 23491 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.883705 23602 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.884281 23602 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.886931 23602 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.888962 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.890504 23611 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.890961 23388 leader_election.cc:343] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.891037 23611 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.893672 23611 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.896427 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:31.900125 23239 leader_election.cc:343] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.902346 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:31.903285 23421 raft_consensus.cc:2468] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:31.906093 23239 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:31.907013 23611 raft_consensus.cc:2804] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.907552 23611 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.907915 23611 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.917774 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:31.918718 23611 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.921553 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:31.922194 23424 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.933215 23424 raft_consensus.cc:2468] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:31.935670 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:31.936810 23239 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:31.937799 23239 leader_election.cc:343] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.938448 23491 raft_consensus.cc:2804] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.938993 23491 raft_consensus.cc:697] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:31.938694 23469 raft_consensus.cc:359] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.939997 23469 raft_consensus.cc:385] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.939831 23491 consensus_queue.cc:237] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.940483 23469 raft_consensus.cc:740] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.941632 23469 consensus_queue.cc:260] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:31.946333 23542 raft_consensus.cc:493] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.935372 23611 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:31.959071 23602 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:31.960842 23387 leader_election.cc:343] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.982566 23469 ts_tablet_manager.cc:1434] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.001s
I20260709 13:09:31.960161 23738 raft_consensus.cc:493] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.970297 23774 raft_consensus.cc:493] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.970007 23542 raft_consensus.cc:515] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:31.991576 23602 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:31.956982 23097 catalog_manager.cc:5697] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:31.992964 23387 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.001756 23470 tablet_bootstrap.cc:654] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.997714 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.004745 23424 raft_consensus.cc:2468] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:31.997947 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.000900 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:31.994027 23774 raft_consensus.cc:515] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.008917 23774 leader_election.cc:290] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.001729 23469 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:32.010751 23239 leader_election.cc:304] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:32.011492 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 50683us
I20260709 13:09:32.015332 23611 raft_consensus.cc:2804] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.015786 23611 raft_consensus.cc:493] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.016172 23611 raft_consensus.cc:3060] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.993608 23738 raft_consensus.cc:515] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.023418 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:32.023525 23738 leader_election.cc:290] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:32.024667 23388 leader_election.cc:343] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.027827 23349 raft_consensus.cc:2468] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.012562 23591 raft_consensus.cc:2749] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.030990 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.031704 23424 raft_consensus.cc:2468] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 0.
I20260709 13:09:32.033622 23313 leader_election.cc:304] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:32.034516 23313 consensus_peers.cc:597] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.035008 23702 raft_consensus.cc:2804] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.996074 23542 leader_election.cc:290] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.035593 23702 raft_consensus.cc:493] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.036087 23702 raft_consensus.cc:3060] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.039192 23602 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.054214 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:32.058413 23387 leader_election.cc:343] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.055601 23702 raft_consensus.cc:515] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.060268 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:32.062198 23702 leader_election.cc:290] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:32.064397 23387 leader_election.cc:343] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.065088 23387 leader_election.cc:304] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.062896 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:31.962147 23422 raft_consensus.cc:2468] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:32.067616 23591 raft_consensus.cc:2749] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.069772 23200 raft_consensus.cc:3060] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.070873 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.071756 23472 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.075600 23472 ts_tablet_manager.cc:1403] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.277s	user 0.068s	sys 0.134s
I20260709 13:09:32.081338 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:32.081979 23421 raft_consensus.cc:3060] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.082195 23472 raft_consensus.cc:359] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.083707 23574 consensus_queue.cc:1048] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.084066 23472 raft_consensus.cc:385] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.084437 23472 raft_consensus.cc:740] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.085315 23472 consensus_queue.cc:260] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.091104 23468 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:32.091620 23468 ts_tablet_manager.cc:1403] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.303s	user 0.047s	sys 0.059s
I20260709 13:09:32.091674 23472 ts_tablet_manager.cc:1434] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:32.093779 23472 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
W20260709 13:09:32.097419 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.098670 23239 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.098927 23468 raft_consensus.cc:359] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
W20260709 13:09:32.096939 23387 leader_election.cc:343] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.099483 23542 raft_consensus.cc:2804] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.099823 23387 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.100179 23542 raft_consensus.cc:697] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:32.101300 23611 raft_consensus.cc:515] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.101213 23542 consensus_queue.cc:237] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.099606 23468 raft_consensus.cc:385] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.102408 23591 raft_consensus.cc:2749] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.106709 23468 raft_consensus.cc:740] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.113859 23270 raft_consensus.cc:2393] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:32.114957 23468 consensus_queue.cc:260] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.112237 23421 raft_consensus.cc:2468] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:32.118049 23313 leader_election.cc:304] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a
I20260709 13:09:32.125245 23470 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:32.125700 23470 ts_tablet_manager.cc:1403] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.330s	user 0.018s	sys 0.009s
I20260709 13:09:32.119447 23706 raft_consensus.cc:2804] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.128575 23611 leader_election.cc:290] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.129858 23706 raft_consensus.cc:697] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:32.131640 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:32.135324 23468 ts_tablet_manager.cc:1434] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.002s
I20260709 13:09:32.135871 23472 tablet_bootstrap.cc:654] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.136198 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a57fa440d304760aa2a0ed56ef83076" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:32.141191 23468 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:32.141074 23706 consensus_queue.cc:237] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.144543 23469 tablet_bootstrap.cc:654] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.151783 23468 tablet_bootstrap.cc:654] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.159876 23774 consensus_queue.cc:1048] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.173112 23469 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:32.183486 23469 ts_tablet_manager.cc:1403] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.182s	user 0.024s	sys 0.010s
I20260709 13:09:32.184907 23421 raft_consensus.cc:2393] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 1: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:32.189493 23239 leader_election.cc:304] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:32.190363 23611 raft_consensus.cc:2749] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.186883 23470 raft_consensus.cc:359] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.192858 23469 raft_consensus.cc:359] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.193450 23470 raft_consensus.cc:385] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.193809 23470 raft_consensus.cc:740] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.195170 23469 raft_consensus.cc:385] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.195554 23469 raft_consensus.cc:740] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.196275 23469 consensus_queue.cc:260] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.194486 23470 consensus_queue.cc:260] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.203320 23469 ts_tablet_manager.cc:1434] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:09:32.204071 23469 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: Bootstrap starting.
I20260709 13:09:32.210371 23470 ts_tablet_manager.cc:1434] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:09:32.211485 23470 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:32.217015 23802 log.cc:927] Time spent T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:09:32.231294 23099 catalog_manager.cc:5697] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.233943 23472 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.234463 23472 ts_tablet_manager.cc:1403] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.141s	user 0.013s	sys 0.014s
I20260709 13:09:32.239720 23468 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:32.242980 23468 ts_tablet_manager.cc:1403] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.107s	user 0.004s	sys 0.018s
I20260709 13:09:32.243196 23469 tablet_bootstrap.cc:654] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:32.244453 23165 consensus_peers.cc:597] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.235304 23097 catalog_manager.cc:5697] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.249723 23472 raft_consensus.cc:359] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.250527 23472 raft_consensus.cc:385] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.250864 23472 raft_consensus.cc:740] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.251806 23472 consensus_queue.cc:260] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.254046 23472 ts_tablet_manager.cc:1434] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 13:09:32.255342 23472 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.255440 23468 raft_consensus.cc:359] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.256163 23468 raft_consensus.cc:385] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.256438 23468 raft_consensus.cc:740] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.263495 23611 consensus_queue.cc:1048] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.266566 23468 consensus_queue.cc:260] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.248137 23470 tablet_bootstrap.cc:654] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.274520 23472 tablet_bootstrap.cc:654] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.289809 23472 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.290349 23472 ts_tablet_manager.cc:1403] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.000s
I20260709 13:09:32.290709 23468 ts_tablet_manager.cc:1434] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.003s
I20260709 13:09:32.291767 23468 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:32.293612 23472 raft_consensus.cc:359] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.294618 23472 raft_consensus.cc:385] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.295028 23472 raft_consensus.cc:740] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.295904 23472 consensus_queue.cc:260] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.297135 23574 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.297611 23574 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.299041 23472 ts_tablet_manager.cc:1434] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:32.299433 23574 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:32.300197 23472 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.301318 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:32.301955 23270 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:32.303165 23164 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:32.303901 23574 raft_consensus.cc:2804] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.304230 23574 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.304523 23574 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.307716 23472 tablet_bootstrap.cc:654] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.319252 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.319950 23348 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:32.321475 23591 raft_consensus.cc:493] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.322022 23591 raft_consensus.cc:515] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.324093 23591 leader_election.cc:290] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:32.325017 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.325623 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:32.326370 23387 leader_election.cc:343] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.327033 23387 leader_election.cc:343] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.327407 23387 leader_election.cc:304] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.328074 23591 raft_consensus.cc:2749] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.340960 23470 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:32.359421 23470 ts_tablet_manager.cc:1403] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.148s	user 0.006s	sys 0.007s
W20260709 13:09:32.345846 23240 consensus_peers.cc:597] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.349460 23469 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: No bootstrap required, opened a new log
I20260709 13:09:32.363953 23469 ts_tablet_manager.cc:1403] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.021s
I20260709 13:09:32.367254 23469 raft_consensus.cc:359] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.368007 23469 raft_consensus.cc:385] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.369422 23468 tablet_bootstrap.cc:654] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.368481 23469 raft_consensus.cc:740] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.372592 23469 consensus_queue.cc:260] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.377389 23470 raft_consensus.cc:359] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.378146 23470 raft_consensus.cc:385] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.378471 23470 raft_consensus.cc:740] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.355638 23472 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.379565 23472 ts_tablet_manager.cc:1403] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.005s
I20260709 13:09:32.379338 23470 consensus_queue.cc:260] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.381918 23470 ts_tablet_manager.cc:1434] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:09:32.382959 23470 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:32.383365 23469 ts_tablet_manager.cc:1434] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:32.337209 23574 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.389286 23472 raft_consensus.cc:359] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.387120 23468 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:32.390049 23472 raft_consensus.cc:385] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.390652 23472 raft_consensus.cc:740] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.391721 23470 tablet_bootstrap.cc:654] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.391750 23472 consensus_queue.cc:260] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.392403 23468 ts_tablet_manager.cc:1403] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.101s	user 0.008s	sys 0.004s
I20260709 13:09:32.394316 23472 ts_tablet_manager.cc:1434] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:09:32.395290 23472 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.403246 23472 tablet_bootstrap.cc:654] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.410838 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:32.411736 23270 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.412173 23574 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:32.417104 23611 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.417790 23611 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.420557 23611 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:32.422655 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:32.424403 23239 leader_election.cc:343] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.428200 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:32.428880 23348 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.415622 23468 raft_consensus.cc:359] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.429103 23270 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:32.429435 23468 raft_consensus.cc:385] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.431444 23164 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:32.432408 23719 raft_consensus.cc:2804] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.432910 23719 raft_consensus.cc:697] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:32.433728 23719 consensus_queue.cc:237] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.434613 23468 raft_consensus.cc:740] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.438342 23200 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.444593 23348 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:32.450788 23468 consensus_queue.cc:260] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.453143 23472 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.454147 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.457188 23472 ts_tablet_manager.cc:1403] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.059s	user 0.025s	sys 0.005s
I20260709 13:09:32.460412 23472 raft_consensus.cc:359] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.462385 23468 ts_tablet_manager.cc:1434] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 13:09:32.461222 23472 raft_consensus.cc:385] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.464749 23472 raft_consensus.cc:740] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.465440 23472 consensus_queue.cc:260] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.467780 23472 ts_tablet_manager.cc:1434] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:32.468864 23472 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.476886 23097 catalog_manager.cc:5697] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.481841 23611 raft_consensus.cc:493] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.482545 23611 raft_consensus.cc:515] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.487085 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.490665 23421 raft_consensus.cc:2468] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.491495 23472 tablet_bootstrap.cc:654] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.492336 23239 leader_election.cc:304] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:32.485725 23611 leader_election.cc:290] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.494598 23542 raft_consensus.cc:2804] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.495105 23542 raft_consensus.cc:493] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.495529 23542 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.504068 23472 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.504601 23472 ts_tablet_manager.cc:1403] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.007s
I20260709 13:09:32.506075 23491 raft_consensus.cc:493] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.506556 23491 raft_consensus.cc:515] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.507308 23472 raft_consensus.cc:359] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.507965 23472 raft_consensus.cc:385] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.508209 23472 raft_consensus.cc:740] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.508450 23491 leader_election.cc:290] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.508841 23472 consensus_queue.cc:260] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.511893 23472 ts_tablet_manager.cc:1434] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:32.513450 23472 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.519338 23719 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.519881 23719 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.521912 23719 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:32.522593 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.523320 23421 raft_consensus.cc:2468] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.523801 23472 tablet_bootstrap.cc:654] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.527994 23199 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.530865 23239 leader_election.cc:304] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:32.532198 23491 raft_consensus.cc:2804] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.532548 23491 raft_consensus.cc:493] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.532876 23491 raft_consensus.cc:3060] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.536425 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.537322 23424 raft_consensus.cc:2393] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 1: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:32.537997 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.540112 23472 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.540594 23472 ts_tablet_manager.cc:1403] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 13:09:32.543370 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:32.543294 23472 raft_consensus.cc:359] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.543991 23472 raft_consensus.cc:385] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.544258 23472 raft_consensus.cc:740] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.545102 23472 consensus_queue.cc:260] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
W20260709 13:09:32.545257 23239 leader_election.cc:343] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.546980 23239 consensus_peers.cc:597] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:32.547688 23766 consensus_queue.cc:1048] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.549541 23738 raft_consensus.cc:493] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.550243 23738 raft_consensus.cc:515] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.551345 23472 ts_tablet_manager.cc:1434] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:09:32.547554 23164 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:32.552899 23491 raft_consensus.cc:515] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:32.565165 23240 leader_election.cc:343] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.565634 23472 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
I20260709 13:09:32.566110 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:32.565904 23240 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.567792 23766 raft_consensus.cc:2749] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.553833 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:32.569877 23387 leader_election.cc:343] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.572464 23387 leader_election.cc:343] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.572974 23387 leader_election.cc:304] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.559912 23738 leader_election.cc:290] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:32.577126 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:32.577745 23424 raft_consensus.cc:3060] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.577129 23602 raft_consensus.cc:2749] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.581810 23766 consensus_queue.cc:1048] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.582269 23719 raft_consensus.cc:2749] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.585242 23468 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:32.585165 23491 leader_election.cc:290] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.573434 23542 raft_consensus.cc:515] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.593946 23542 leader_election.cc:290] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.606834 23472 tablet_bootstrap.cc:654] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.596626 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
W20260709 13:09:32.639408 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 44600.9us
I20260709 13:09:32.602205 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.644381 23542 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.644953 23542 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.647944 23542 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
W20260709 13:09:32.649974 23239 leader_election.cc:343] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.644215 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:32.651054 23423 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.651561 23470 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:32.652040 23470 ts_tablet_manager.cc:1403] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.269s	user 0.063s	sys 0.093s
I20260709 13:09:32.655161 23196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.656816 23424 raft_consensus.cc:2468] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:32.658041 23423 raft_consensus.cc:2468] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
W20260709 13:09:32.664067 23239 leader_election.cc:343] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.679239 23468 tablet_bootstrap.cc:654] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.660373 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:32.681202 23239 leader_election.cc:304] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.682478 23542 raft_consensus.cc:2804] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.683108 23542 raft_consensus.cc:697] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:32.683454 23239 leader_election.cc:304] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:32.684171 23491 raft_consensus.cc:2804] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.684660 23491 raft_consensus.cc:697] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:32.686117 23491 consensus_queue.cc:237] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.683837 23542 consensus_queue.cc:237] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.705072 23470 raft_consensus.cc:359] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.706094 23470 raft_consensus.cc:385] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.706419 23470 raft_consensus.cc:740] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.708729 23470 consensus_queue.cc:260] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.716603 23738 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.717509 23738 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.714303 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.721189 23738 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.703729 23774 consensus_queue.cc:1048] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:09:32.722838 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:32.726294 23387 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.728647 23470 ts_tablet_manager.cc:1434] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 13:09:32.730268 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.731377 23470 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:32.715821 23240 leader_election.cc:343] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.737116 23240 leader_election.cc:343] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:32.738015 23240 leader_election.cc:343] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.741250 23240 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.750249 23766 raft_consensus.cc:2749] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:32.753189 23388 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.753849 23388 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.755932 23602 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.759966 23472 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.760565 23472 ts_tablet_manager.cc:1403] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.195s	user 0.020s	sys 0.019s
I20260709 13:09:32.764283 23472 raft_consensus.cc:359] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.767019 23472 raft_consensus.cc:385] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.767388 23472 raft_consensus.cc:740] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.768440 23591 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.768229 23472 consensus_queue.cc:260] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.769012 23591 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.770593 23349 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.770823 23472 ts_tablet_manager.cc:1434] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:32.771744 23591 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.774111 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.821983 23472 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: Bootstrap starting.
W20260709 13:09:32.822751 23387 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.782287 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.791108 23766 raft_consensus.cc:493] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.793401 23834 consensus_queue.cc:1048] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:32.824523 23766 raft_consensus.cc:515] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.806421 23470 tablet_bootstrap.cc:654] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.807369 23468 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:32.818265 23097 catalog_manager.cc:5697] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.827922 23766 leader_election.cc:290] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:32.829133 23388 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.826282 23542 raft_consensus.cc:493] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.830286 23542 raft_consensus.cc:515] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.832180 23542 leader_election.cc:290] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:32.826349 23468 ts_tablet_manager.cc:1403] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.363s	user 0.011s	sys 0.005s
I20260709 13:09:32.835175 23468 raft_consensus.cc:359] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.835906 23468 raft_consensus.cc:385] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.836220 23468 raft_consensus.cc:740] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.829619 23388 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.838068 23591 raft_consensus.cc:2749] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.836925 23468 consensus_queue.cc:260] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.843786 23542 raft_consensus.cc:493] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.844314 23542 raft_consensus.cc:515] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:32.857542 23468 ts_tablet_manager.cc:1434] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:32.858584 23468 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:32.860958 23542 leader_election.cc:290] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:32.867385 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:32.879635 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:32.872030 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:32.889499 23239 leader_election.cc:343] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.894695 23468 tablet_bootstrap.cc:654] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.904944 23470 tablet_bootstrap.cc:492] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:32.905478 23470 ts_tablet_manager.cc:1403] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.174s	user 0.013s	sys 0.012s
I20260709 13:09:32.911290 23472 tablet_bootstrap.cc:654] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:32.911720 23240 leader_election.cc:343] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.917321 23706 consensus_queue.cc:1048] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:32.902891 23832 log.cc:927] Time spent T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:09:32.921200 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.921870 23422 raft_consensus.cc:2468] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.923144 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.923743 23422 raft_consensus.cc:2468] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.925038 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:32.925622 23422 raft_consensus.cc:2468] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:32.930730 23099 catalog_manager.cc:5697] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:32.933525 23240 leader_election.cc:343] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.936436 23472 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: No bootstrap required, opened a new log
I20260709 13:09:32.951821 23472 ts_tablet_manager.cc:1403] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.003s
I20260709 13:09:32.958926 23470 raft_consensus.cc:359] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.959959 23470 raft_consensus.cc:385] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.960310 23470 raft_consensus.cc:740] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.961061 23470 consensus_queue.cc:260] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:32.959679 23239 leader_election.cc:304] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:32.970717 23611 raft_consensus.cc:2804] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.968466 23472 raft_consensus.cc:359] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.970739 23239 leader_election.cc:304] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:32.972908 23239 leader_election.cc:304] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:32.974424 23837 raft_consensus.cc:2804] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.974910 23837 raft_consensus.cc:493] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.971647 23472 raft_consensus.cc:385] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.971182 23611 raft_consensus.cc:493] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.980319 23611 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.976562 23470 ts_tablet_manager.cc:1434] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:09:32.976370 23472 raft_consensus.cc:740] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.977487 23837 raft_consensus.cc:3060] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.975746 23766 raft_consensus.cc:2804] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.976147 23719 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.990587 23719 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:32.986802 23472 consensus_queue.cc:260] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:32.989964 23766 raft_consensus.cc:493] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.995244 23766 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.998139 23719 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.000303 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:33.001873 23165 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.003898 23348 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.007630 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.008388 23419 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:33.011570 23766 raft_consensus.cc:515] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.013500 23164 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.015431 23470 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.016711 23775 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.017338 23775 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.017789 23775 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.025341 23472 ts_tablet_manager.cc:1434] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:09:33.030062 23837 raft_consensus.cc:515] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.038107 23574 consensus_queue.cc:1048] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.038170 23837 leader_election.cc:290] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:33.055768 23611 raft_consensus.cc:515] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.061702 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:33.061868 23574 consensus_queue.cc:1048] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:33.063585 23240 leader_election.cc:343] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.068655 23766 leader_election.cc:290] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.074970 23775 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.076411 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:33.077802 23468 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.084897 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.097591 23419 raft_consensus.cc:3060] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.088757 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:33.100487 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:33.101986 23240 leader_election.cc:343] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:33.102811 23165 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.093818 23611 leader_election.cc:290] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.095124 23470 tablet_bootstrap.cc:654] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.105151 23775 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.094888 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.108140 23774 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:33.108266 23423 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.108672 23774 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.113979 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:33.117292 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.119786 23833 raft_consensus.cc:493] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.106590 23419 raft_consensus.cc:2468] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:33.106614 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.120293 23833 raft_consensus.cc:515] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.120941 23422 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.121291 23774 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:33.122882 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.123703 23421 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.107493 23468 ts_tablet_manager.cc:1403] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.249s	user 0.036s	sys 0.014s
W20260709 13:09:33.112673 23239 leader_election.cc:343] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:33.188254 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 75614.8us
I20260709 13:09:33.202512 23468 raft_consensus.cc:359] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.203560 23468 raft_consensus.cc:385] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.203889 23468 raft_consensus.cc:740] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.204716 23468 consensus_queue.cc:260] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.205286 23833 leader_election.cc:290] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:33.207000 23468 ts_tablet_manager.cc:1434] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.081s	user 0.002s	sys 0.006s
I20260709 13:09:33.213800 23239 leader_election.cc:304] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.220610 23591 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.221172 23591 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.222247 23470 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.222692 23313 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.222923 23421 raft_consensus.cc:2468] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:33.223176 23591 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:33.224255 23825 raft_consensus.cc:2749] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:33.222759 23470 ts_tablet_manager.cc:1403] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.011s
I20260709 13:09:33.227102 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.227507 23468 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:33.234391 23239 consensus_peers.cc:597] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.228574 23423 raft_consensus.cc:2468] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:33.240399 23239 leader_election.cc:304] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.239899 23468 tablet_bootstrap.cc:654] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.244979 23611 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.245460 23611 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.244262 23833 raft_consensus.cc:2804] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.249581 23833 raft_consensus.cc:697] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:33.234923 23837 raft_consensus.cc:2804] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.250514 23611 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.250627 23837 raft_consensus.cc:697] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:33.250541 23833 consensus_queue.cc:237] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.251523 23422 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.251619 23837 consensus_queue.cc:237] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.252993 23164 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.254304 23775 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.255018 23775 raft_consensus.cc:697] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
W20260709 13:09:33.233105 23388 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.257225 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.236668 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:33.261875 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:33.263001 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:33.267741 23239 leader_election.cc:304] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.268347 23611 raft_consensus.cc:2804] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.267647 23491 consensus_queue.cc:1048] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:33.269380 23470 raft_consensus.cc:359] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:33.269760 23239 leader_election.cc:343] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.270063 23470 raft_consensus.cc:385] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:33.265829 23240 leader_election.cc:343] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.265435 23775 consensus_queue.cc:237] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.270447 23470 raft_consensus.cc:740] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
W20260709 13:09:33.273777 23387 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.276170 23470 consensus_queue.cc:260] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.276912 23387 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.277848 23602 raft_consensus.cc:2749] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.276194 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:33.281102 23470 ts_tablet_manager.cc:1434] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:09:33.282446 23470 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
W20260709 13:09:33.288725 23239 leader_election.cc:343] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.289047 23766 consensus_queue.cc:1048] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.289294 23239 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.292495 23837 raft_consensus.cc:2749] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:33.298400 23240 consensus_peers.cc:597] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.299783 23470 tablet_bootstrap.cc:654] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.299912 23774 raft_consensus.cc:493] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.300503 23774 raft_consensus.cc:515] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.303082 23774 leader_election.cc:290] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.304646 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.304884 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f84e27c47644330886c6361f8182419" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.306806 23313 leader_election.cc:304] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:33.307866 23774 raft_consensus.cc:2749] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.295646 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.315017 23423 raft_consensus.cc:2468] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 0.
I20260709 13:09:33.318624 23239 leader_election.cc:304] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.319732 23834 raft_consensus.cc:2804] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.320236 23834 raft_consensus.cc:493] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.320657 23834 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.332552 23097 catalog_manager.cc:5697] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.340437 23468 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.341187 23468 ts_tablet_manager.cc:1403] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.012s
I20260709 13:09:33.343982 23468 raft_consensus.cc:359] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.344586 23468 raft_consensus.cc:385] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.344859 23468 raft_consensus.cc:740] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.345549 23468 consensus_queue.cc:260] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.347836 23468 ts_tablet_manager.cc:1434] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:33.349578 23468 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.359874 23468 tablet_bootstrap.cc:654] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.370093 23611 raft_consensus.cc:697] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:33.370960 23611 consensus_queue.cc:237] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.375758 23834 raft_consensus.cc:515] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.384676 23834 leader_election.cc:290] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:33.382251 23468 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.385703 23468 ts_tablet_manager.cc:1403] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.009s
I20260709 13:09:33.388252 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.389026 23423 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.394229 23470 tablet_bootstrap.cc:492] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.394814 23470 ts_tablet_manager.cc:1403] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.113s	user 0.018s	sys 0.031s
I20260709 13:09:33.396955 23423 raft_consensus.cc:2468] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:33.388666 23468 raft_consensus.cc:359] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.398135 23468 raft_consensus.cc:385] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.398468 23468 raft_consensus.cc:740] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.400218 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:33.400632 23468 consensus_queue.cc:260] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.406137 23470 raft_consensus.cc:359] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.408739 23470 raft_consensus.cc:385] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.409117 23470 raft_consensus.cc:740] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.409705 23349 raft_consensus.cc:3060] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.409849 23470 consensus_queue.cc:260] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.412184 23470 ts_tablet_manager.cc:1434] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.006s
I20260709 13:09:33.413997 23470 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.419591 23468 ts_tablet_manager.cc:1434] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:33.420674 23468 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.421277 23825 raft_consensus.cc:493] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.421829 23825 raft_consensus.cc:515] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.424094 23825 leader_election.cc:290] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.427887 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.429971 23470 tablet_bootstrap.cc:654] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.406896 23239 leader_election.cc:304] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:33.433362 23491 raft_consensus.cc:2804] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.433899 23491 raft_consensus.cc:697] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
W20260709 13:09:33.435742 23239 leader_election.cc:343] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.437069 23574 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.445256 23574 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.434703 23491 consensus_queue.cc:237] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.447345 23574 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.456307 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.456615 23468 tablet_bootstrap.cc:654] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.457149 23274 raft_consensus.cc:2468] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:33.469528 23164 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:33.477422 23099 catalog_manager.cc:5697] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.480223 23099 catalog_manager.cc:5697] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.482077 23099 catalog_manager.cc:5697] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.483186 23470 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.483731 23470 ts_tablet_manager.cc:1403] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.016s
I20260709 13:09:33.477924 23775 raft_consensus.cc:2804] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.490386 23775 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.490470 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e889863be944540ae44f160918568a7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.490857 23775 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.492921 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.503576 23470 raft_consensus.cc:359] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.504240 23470 raft_consensus.cc:385] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.504720 23470 raft_consensus.cc:740] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.497490 23719 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.507894 23313 leader_election.cc:304] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:33.509245 23719 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.505431 23470 consensus_queue.cc:260] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:33.512900 23165 leader_election.cc:343] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.513448 23470 ts_tablet_manager.cc:1434] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:09:33.515097 23470 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.511564 23706 raft_consensus.cc:2749] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.513836 23719 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:33.530596 23470 tablet_bootstrap.cc:654] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.541209 23775 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.543474 23775 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.550870 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:33.553906 23165 leader_election.cc:343] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.570771 23468 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.571310 23468 ts_tablet_manager.cc:1403] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.002s
I20260709 13:09:33.568557 23097 catalog_manager.cc:5697] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 1 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.575366 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.577906 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.579494 23468 raft_consensus.cc:359] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.580216 23468 raft_consensus.cc:385] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.580463 23468 raft_consensus.cc:740] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.582333 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:33.583009 23276 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.586546 23198 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.589581 23164 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:33.591076 23828 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.593060 23828 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.596072 23828 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.596652 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.597615 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.598193 23423 raft_consensus.cc:2468] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
W20260709 13:09:33.599181 23165 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.599738 23164 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.601732 23468 consensus_queue.cc:260] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.603242 23868 raft_consensus.cc:2804] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.603842 23868 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.604313 23868 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.611837 23468 ts_tablet_manager.cc:1434] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.001s
I20260709 13:09:33.614037 23468 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.616357 23775 raft_consensus.cc:2749] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.620378 23468 tablet_bootstrap.cc:654] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.621815 23276 raft_consensus.cc:2468] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.628434 23164 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.629216 23775 raft_consensus.cc:2804] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.629783 23775 raft_consensus.cc:697] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:33.630162 23470 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.630744 23470 ts_tablet_manager.cc:1403] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.000s
I20260709 13:09:33.631003 23775 consensus_queue.cc:237] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.633297 23470 raft_consensus.cc:359] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.633745 23468 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.639518 23470 raft_consensus.cc:385] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.639853 23470 raft_consensus.cc:740] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.639951 23468 ts_tablet_manager.cc:1403] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.005s
I20260709 13:09:33.638757 23868 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.640650 23470 consensus_queue.cc:260] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.642786 23468 raft_consensus.cc:359] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.643424 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:33.643817 23468 raft_consensus.cc:385] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.644142 23468 raft_consensus.cc:740] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
W20260709 13:09:33.644616 23165 leader_election.cc:343] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.644836 23468 consensus_queue.cc:260] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.645516 23868 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.646587 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.646847 23468 ts_tablet_manager.cc:1434] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:33.647064 23423 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.655189 23423 raft_consensus.cc:2468] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.655975 23470 ts_tablet_manager.cc:1434] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:33.658182 23164 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.659036 23775 raft_consensus.cc:2804] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.659585 23775 raft_consensus.cc:697] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:33.660411 23775 consensus_queue.cc:237] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.663100 23468 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.666095 23470 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.670715 23097 catalog_manager.cc:5697] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:33.672098 23470 tablet_bootstrap.cc:654] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.679160 23468 tablet_bootstrap.cc:654] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:33.682547 23240 consensus_peers.cc:597] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.684743 23470 tablet_bootstrap.cc:492] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.685259 23470 ts_tablet_manager.cc:1403] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:09:33.688109 23865 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.687907 23470 raft_consensus.cc:359] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.688585 23865 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:33.690014 23239 consensus_peers.cc:597] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.690847 23865 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:33.688578 23470 raft_consensus.cc:385] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.692207 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.692410 23470 raft_consensus.cc:740] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.693064 23423 raft_consensus.cc:2393] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:33.693704 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:33.693274 23470 consensus_queue.cc:260] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.695137 23313 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:33.696259 23865 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.695088 23468 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.709540 23468 ts_tablet_manager.cc:1403] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 13:09:33.711987 23468 raft_consensus.cc:359] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.711619 23099 catalog_manager.cc:5697] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.712616 23468 raft_consensus.cc:385] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.714543 23470 ts_tablet_manager.cc:1434] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:33.715497 23468 raft_consensus.cc:740] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.716313 23470 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.716215 23468 consensus_queue.cc:260] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.708544 23865 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.717736 23468 ts_tablet_manager.cc:1434] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:33.718756 23350 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.719030 23468 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.713434 23833 consensus_queue.cc:1048] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:09:33.744007 23865 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.744561 23865 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.747614 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:33.748641 23851 consensus_queue.cc:1048] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.750102 23865 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:33.750895 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.751675 23276 raft_consensus.cc:2393] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:33.752031 23470 tablet_bootstrap.cc:654] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.752918 23313 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:33.753908 23865 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.758808 23775 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.759473 23775 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.771180 23775 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.775154 23349 raft_consensus.cc:3060] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.783275 23468 tablet_bootstrap.cc:654] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.786105 23865 raft_consensus.cc:2749] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.792670 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.794188 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.795099 23276 raft_consensus.cc:2468] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
W20260709 13:09:33.795650 23240 consensus_peers.cc:597] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.796595 23164 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:33.798959 23828 raft_consensus.cc:2804] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.799423 23828 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.799801 23828 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:33.800846 23165 leader_election.cc:343] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.805539 23868 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.806128 23868 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.808351 23868 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.802009 23865 raft_consensus.cc:493] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.812904 23865 raft_consensus.cc:515] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:33.815070 23865 leader_election.cc:290] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.815652 23348 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.819103 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.819880 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:33.819890 23276 raft_consensus.cc:2468] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:33.827207 23164 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:33.828212 23775 raft_consensus.cc:2804] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.828680 23775 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.829123 23775 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.830411 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.840346 23867 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.840960 23867 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.843097 23867 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:33.843791 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:33.846283 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:33.846954 23419 raft_consensus.cc:2468] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:33.854568 23313 leader_election.cc:304] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:33.856155 23164 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:33.857897 23867 raft_consensus.cc:2804] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:33.858270 23867 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.858595 23867 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.863121 23345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:33.868778 23165 leader_election.cc:343] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:33.873414 23165 leader_election.cc:343] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.825609 23828 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.874873 23867 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.880647 23868 consensus_queue.cc:1048] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.881600 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:33.882405 23276 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.884075 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:33.884514 23867 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:33.888098 23165 leader_election.cc:343] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.878836 23828 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.879186 23865 raft_consensus.cc:2749] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:33.894922 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:33.895553 23422 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.899555 23470 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:33.903774 23719 consensus_queue.cc:1048] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.904953 23470 ts_tablet_manager.cc:1403] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.037s
I20260709 13:09:33.907616 23470 raft_consensus.cc:359] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.908238 23470 raft_consensus.cc:385] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.908512 23470 raft_consensus.cc:740] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.909098 23775 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.913784 23775 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:33.914521 23276 raft_consensus.cc:2468] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.914871 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:33.916155 23165 leader_election.cc:343] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.917239 23468 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.919977 23468 ts_tablet_manager.cc:1403] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.015s
I20260709 13:09:33.922504 23468 raft_consensus.cc:359] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.926632 23468 raft_consensus.cc:385] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:33.926954 23239 consensus_peers.cc:597] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:33.894134 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:33.914451 23470 consensus_queue.cc:260] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.926987 23468 raft_consensus.cc:740] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
W20260709 13:09:33.928444 23165 leader_election.cc:343] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:33.928462 23468 consensus_queue.cc:260] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:33.929740 23470 ts_tablet_manager.cc:1434] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:09:33.930502 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:33.931138 23274 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:33.931152 23468 ts_tablet_manager.cc:1434] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:33.932569 23468 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.930770 23470 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:33.938978 23468 tablet_bootstrap.cc:654] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.938969 23274 raft_consensus.cc:2468] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.944437 23468 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.944941 23468 ts_tablet_manager.cc:1403] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:09:33.947440 23468 raft_consensus.cc:359] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.948127 23468 raft_consensus.cc:385] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.948406 23468 raft_consensus.cc:740] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.949050 23851 consensus_queue.cc:1048] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:33.949299 23468 consensus_queue.cc:260] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:33.951706 23468 ts_tablet_manager.cc:1434] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:33.952598 23468 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.956640 23470 tablet_bootstrap.cc:654] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.958289 23468 tablet_bootstrap.cc:654] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.967309 23422 raft_consensus.cc:2468] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:33.969630 23468 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:33.961648 23164 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.970126 23468 ts_tablet_manager.cc:1403] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:09:33.970938 23164 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.971145 23775 raft_consensus.cc:2804] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.971666 23828 raft_consensus.cc:2804] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.972604 23828 raft_consensus.cc:697] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:33.972977 23775 raft_consensus.cc:697] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:33.973111 23468 raft_consensus.cc:359] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.973822 23468 raft_consensus.cc:385] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:33.973467 23828 consensus_queue.cc:237] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.974125 23468 raft_consensus.cc:740] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:33.973920 23775 consensus_queue.cc:237] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.974808 23468 consensus_queue.cc:260] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:33.977087 23468 ts_tablet_manager.cc:1434] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:33.977983 23468 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:33.979358 23164 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:33.983935 23468 tablet_bootstrap.cc:654] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:33.985052 23867 raft_consensus.cc:2804] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:33.985597 23867 raft_consensus.cc:697] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:33.986413 23867 consensus_queue.cc:237] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.004531 23574 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.005158 23574 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.007287 23574 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:34.009212 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:34.010038 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:34.010866 23421 raft_consensus.cc:2468] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
W20260709 13:09:34.012740 23165 leader_election.cc:343] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.013808 23164 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:34.015942 23719 raft_consensus.cc:2804] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.016360 23719 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.016738 23719 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.033239 23719 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.036754 23468 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:34.037487 23468 ts_tablet_manager.cc:1403] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.024s
I20260709 13:09:34.042466 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
W20260709 13:09:34.043900 23165 leader_election.cc:343] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:34.049196 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:34.050035 23422 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.051961 23468 raft_consensus.cc:359] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.053393 23468 raft_consensus.cc:385] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.053879 23468 raft_consensus.cc:740] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.042806 23719 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:34.055249 23468 consensus_queue.cc:260] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.060035 23468 ts_tablet_manager.cc:1434] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 13:09:34.062453 23468 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:34.066159 23422 raft_consensus.cc:2468] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
I20260709 13:09:34.067551 23164 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:34.068360 23719 raft_consensus.cc:2804] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:34.069079 23719 raft_consensus.cc:697] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:34.070155 23719 consensus_queue.cc:237] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.073056 23833 consensus_queue.cc:1048] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.074201 23865 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.074725 23865 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.076851 23865 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:34.077469 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:34.078300 23421 raft_consensus.cc:2393] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 1: Already voted for candidate d4e47dfe9e4043b28804f74ca6320c78 in this term.
I20260709 13:09:34.078431 23470 tablet_bootstrap.cc:492] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:34.078325 23468 tablet_bootstrap.cc:654] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.082265 23470 ts_tablet_manager.cc:1403] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.003s
I20260709 13:09:34.085038 23470 raft_consensus.cc:359] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:34.085675 23470 raft_consensus.cc:385] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.085997 23470 raft_consensus.cc:740] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.086625 23470 consensus_queue.cc:260] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:34.181326 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:34.241389 23864 raft_consensus.cc:493] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.242869 23864 raft_consensus.cc:515] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:34.246968 23864 leader_election.cc:290] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:34.249882 23898 raft_consensus.cc:493] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.250671 23470 ts_tablet_manager.cc:1434] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.159s	user 0.008s	sys 0.000s
I20260709 13:09:34.255299 23313 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:34.258186 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:34.258767 23774 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.255721 23468 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:34.266839 23470 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:34.265650 23898 raft_consensus.cc:515] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.297304 23898 leader_election.cc:290] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:34.301566 23905 raft_consensus.cc:493] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.302577 23905 raft_consensus.cc:515] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.305619 23905 leader_election.cc:290] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:34.323547 23468 ts_tablet_manager.cc:1403] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.262s	user 0.008s	sys 0.011s
I20260709 13:09:34.339332 23468 raft_consensus.cc:359] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.340382 23468 raft_consensus.cc:385] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.340848 23468 raft_consensus.cc:740] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.345999 23276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:34.350827 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:34.355646 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a87fc46139f2423a9c3eac9d3761edf0" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:34.360231 23468 consensus_queue.cc:260] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:34.362191 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:34.363662 23468 ts_tablet_manager.cc:1434] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:09:34.370241 23908 consensus_queue.cc:1048] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.380406 23908 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.381307 23908 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:34.383926 23908 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:34.394326 23470 tablet_bootstrap.cc:654] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.377162 23097 catalog_manager.cc:5697] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.403956 23775 consensus_queue.cc:1048] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:34.421577 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:34.429359 23774 raft_consensus.cc:2749] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.431191 23468 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:34.431165 23097 catalog_manager.cc:5697] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:34.450551 23719 consensus_queue.cc:1048] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.461802 23164 leader_election.cc:304] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:34.470335 23908 raft_consensus.cc:2749] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:34.472939 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:34.496994 23270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:34.497840 23270 raft_consensus.cc:2468] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
W20260709 13:09:34.500905 23165 leader_election.cc:343] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:34.501713 23165 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 59331.4us
I20260709 13:09:34.504698 23907 consensus_queue.cc:1048] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.513901 23348 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.522540 23470 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:34.523105 23470 ts_tablet_manager.cc:1403] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.271s	user 0.021s	sys 0.022s
I20260709 13:09:34.531509 23470 raft_consensus.cc:359] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.532368 23470 raft_consensus.cc:385] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.532670 23470 raft_consensus.cc:740] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.533327 23470 consensus_queue.cc:260] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.525974 23313 leader_election.cc:304] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:34.539487 23470 ts_tablet_manager.cc:1434] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:09:34.539695 23199 raft_consensus.cc:3060] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.540700 23470 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:34.548231 23470 tablet_bootstrap.cc:654] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:34.556996 23468 tablet_bootstrap.cc:654] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:34.560345 23165 consensus_peers.cc:597] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.567960 23350 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.572320 23196 raft_consensus.cc:3060] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:34.573424 23165 consensus_peers.cc:597] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:34.573552 23200 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.574023 23097 catalog_manager.cc:5697] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.591442 23164 leader_election.cc:304] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:34.610188 23468 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: No bootstrap required, opened a new log
I20260709 13:09:34.610816 23468 ts_tablet_manager.cc:1403] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.180s	user 0.017s	sys 0.000s
I20260709 13:09:34.620009 23574 consensus_queue.cc:1048] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.624469 23574 consensus_queue.cc:1048] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.624642 23164 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:34.627168 23775 raft_consensus.cc:2804] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:34.632597 23775 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.633052 23775 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.673812 23602 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.674566 23602 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.676976 23602 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:34.702000 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:34.703986 23197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:34.715492 23164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 50159.3us
I20260709 13:09:34.721417 23468 raft_consensus.cc:359] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.722188 23468 raft_consensus.cc:385] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:34.722518 23468 raft_consensus.cc:740] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:34.723277 23468 consensus_queue.cc:260] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:34.724872 23934 consensus_queue.cc:1048] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:34.770081 23901 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.770782 23901 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:34.771733 23913 log.cc:927] Time spent T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 13:09:34.784874 23865 raft_consensus.cc:2749] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:34.802232 23164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 85559.2us
I20260709 13:09:34.811868 23775 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:34.814343 23775 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:34.829342 23468 ts_tablet_manager.cc:1434] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.206s	user 0.005s	sys 0.023s
I20260709 13:09:34.829716 23901 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:34.837103 23388 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:34.848222 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 98410.1us
I20260709 13:09:34.897694 23924 consensus_queue.cc:1048] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:09:34.900270 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:34.910668 23275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:34.911507 23275 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:34.923667 23907 raft_consensus.cc:2749] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:34.920996 23165 consensus_peers.cc:597] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:34.948895 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 56709.4us
I20260709 13:09:34.997419 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:35.019270 23419 raft_consensus.cc:2468] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:35.036922 23470 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:35.037523 23470 ts_tablet_manager.cc:1403] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.497s	user 0.010s	sys 0.038s
W20260709 13:09:35.039906 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 66573.1us
I20260709 13:09:35.040509 23470 raft_consensus.cc:359] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.041370 23470 raft_consensus.cc:385] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.041656 23470 raft_consensus.cc:740] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
W20260709 13:09:35.042059 23387 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.042495 23387 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:35.042339 23470 consensus_queue.cc:260] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.045208 23470 ts_tablet_manager.cc:1434] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:35.046350 23470 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:35.049101 23199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:35.053669 23147 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:35.058311 23470 tablet_bootstrap.cc:654] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.066115 23942 raft_consensus.cc:2749] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.105253 23275 raft_consensus.cc:2468] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
W20260709 13:09:35.094012 23165 leader_election.cc:343] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.113468 23164 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
W20260709 13:09:35.139484 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 83874.3us
I20260709 13:09:35.152175 23869 raft_consensus.cc:2804] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.155134 23868 consensus_queue.cc:1048] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.160313 23869 raft_consensus.cc:697] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:35.166760 23869 consensus_queue.cc:237] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.175462 23313 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:35.177243 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 92087.4us
I20260709 13:09:35.206542 23898 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.187142 23865 raft_consensus.cc:2804] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:35.207167 23898 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:35.274724 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 56279.2us
W20260709 13:09:35.281975 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 76635.5us
I20260709 13:09:35.284803 23348 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.266403 23865 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:35.297664 23470 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:35.298384 23470 ts_tablet_manager.cc:1403] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.252s	user 0.010s	sys 0.032s
I20260709 13:09:35.293845 23865 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.316298 23898 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:35.312497 23240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 115679us
I20260709 13:09:35.332059 23865 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.355091 23865 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:35.365254 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:35.366058 23424 raft_consensus.cc:2468] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 0.
I20260709 13:09:35.367703 23470 raft_consensus.cc:359] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.368520 23470 raft_consensus.cc:385] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.370014 23470 raft_consensus.cc:740] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.373579 23470 consensus_queue.cc:260] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.375278 23164 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
W20260709 13:09:35.384407 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 50512us
I20260709 13:09:35.388200 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:35.378237 23869 raft_consensus.cc:2804] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:35.392648 23869 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.393098 23869 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.393627 23470 ts_tablet_manager.cc:1434] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.001s
I20260709 13:09:35.395071 23470 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:35.404835 23196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:35.404961 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
W20260709 13:09:35.412568 23165 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.470405 23774 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:35.470992 23774 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.479880 23313 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:35.485617 23864 raft_consensus.cc:2749] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.491355 23869 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.493630 23969 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.494180 23969 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.496187 23969 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:35.516081 23200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:35.530756 23097 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38474 (request call id 84) took 1221 ms. Trace:
I20260709 13:09:35.546216 23774 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:35.550802 23196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:35.557184 23470 tablet_bootstrap.cc:654] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.536191 23097 rpcz_store.cc:276] 0709 13:09:34.309324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.309489 (+   165us) service_pool.cc:224] Handling call
0709 13:09:35.530670 (+1221181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:34.643984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:34.644928 (+   944us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:34.645010 (+    82us) write_op.cc:435] Acquired schema lock
0709 13:09:34.645062 (+    52us) tablet.cc:662] Decoding operations
0709 13:09:34.645963 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:34.646091 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:34.646135 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:34.649955 (+  3820us) tablet.cc:701] Row locks acquired
0709 13:09:34.649999 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:09:34.655597 (+  5598us) write_op.cc:270] Start()
0709 13:09:34.670232 (+ 14635us) write_op.cc:276] Timestamp: P: 1783602574651107 usec, L: 0
0709 13:09:34.673136 (+  2904us) op_driver.cc:348] REPLICATION: starting
0709 13:09:34.751016 (+ 77880us) log.cc:844] Serialized 1316 byte log entry
0709 13:09:35.068021 (+317005us) op_driver.cc:464] REPLICATION: finished
0709 13:09:35.301247 (+233226us) write_op.cc:301] APPLY: starting
0709 13:09:35.301350 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:35.301516 (+   166us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:35.301650 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:35.302219 (+   569us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:35.302485 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:09:35.302559 (+    74us) write_op.cc:312] APPLY: finished
0709 13:09:35.302889 (+   330us) log.cc:844] Serialized 34 byte log entry
0709 13:09:35.303091 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:35.303208 (+   117us) write_op.cc:454] Released schema lock
0709 13:09:35.303275 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:35.303852 (+   577us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:35.303889 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63818,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":203738,"apply.run_cpu_time_us":2584,"apply.run_wall_time_us":10479,"num_ops":3,"prepare.queue_time_us":57234,"prepare.run_cpu_time_us":6331,"prepare.run_wall_time_us":190001,"raft.queue_time_us":162207,"raft.run_cpu_time_us":8153,"raft.run_wall_time_us":72525,"replication_time_us":394712,"thread_start_us":182209,"threads_started":4,"wal-append.queue_time_us":98330}]]}
I20260709 13:09:35.565117 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:35.569990 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:35.570312 23341 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.581844 23869 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:35.582007 23313 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:35.583036 23423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:35.583765 23423 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:35.583859 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:35.584270 23313 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:35.585708 23940 raft_consensus.cc:2749] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:35.592224 23423 raft_consensus.cc:2468] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 1.
W20260709 13:09:35.594175 23165 leader_election.cc:343] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:35.616724 23470 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:35.617311 23470 ts_tablet_manager.cc:1403] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.223s	user 0.009s	sys 0.008s
I20260709 13:09:35.619401 23164 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:35.622170 23868 raft_consensus.cc:2804] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:35.623814 23868 raft_consensus.cc:697] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:35.624709 23868 consensus_queue.cc:237] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.626091 23470 raft_consensus.cc:359] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.626825 23470 raft_consensus.cc:385] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.627116 23470 raft_consensus.cc:740] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.628192 23470 consensus_queue.cc:260] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:35.630875 23470 ts_tablet_manager.cc:1434] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:09:35.632018 23470 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:35.634136 23930 raft_consensus.cc:2749] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:35.638834 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 158326us
I20260709 13:09:35.663308 23470 tablet_bootstrap.cc:654] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.715581 23869 consensus_queue.cc:1048] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:35.718106 23348 raft_consensus.cc:1240] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Rejecting Update request from peer d4e47dfe9e4043b28804f74ca6320c78 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:35.720228 23907 consensus_queue.cc:1059] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.721226 23907 raft_consensus.cc:3055] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.721588 23907 raft_consensus.cc:740] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:35.722442 23907 consensus_queue.cc:260] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.723744 23907 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.720650 23343 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:35.724639 23978 log.cc:927] Time spent T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:09:35.748883 23869 consensus_queue.cc:1048] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:35.761889 23470 tablet_bootstrap.cc:492] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:35.762457 23470 ts_tablet_manager.cc:1403] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.131s	user 0.056s	sys 0.033s
I20260709 13:09:35.765601 23470 raft_consensus.cc:359] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:35.766438 23470 raft_consensus.cc:385] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.766750 23470 raft_consensus.cc:740] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.768358 23470 consensus_queue.cc:260] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:35.772715 23470 ts_tablet_manager.cc:1434] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:09:35.773916 23470 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:35.792876 23470 tablet_bootstrap.cc:654] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.818704 23095 catalog_manager.cc:5697] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } }
I20260709 13:09:35.839311 23470 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:35.839908 23470 ts_tablet_manager.cc:1403] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.011s
I20260709 13:09:35.843245 23470 raft_consensus.cc:359] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.847012 23470 raft_consensus.cc:385] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:35.847337 23470 raft_consensus.cc:740] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:35.848032 23470 consensus_queue.cc:260] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:35.850371 23470 ts_tablet_manager.cc:1434] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:35.851431 23470 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Bootstrap starting.
I20260709 13:09:35.876405 23774 raft_consensus.cc:493] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.877069 23774 raft_consensus.cc:515] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:35.879339 23774 leader_election.cc:290] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:35.881913 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:35.883725 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:35.886515 23313 leader_election.cc:304] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:35.889926 23774 raft_consensus.cc:2749] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:35.923710 23470 tablet_bootstrap.cc:654] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:35.934175 23097 catalog_manager.cc:5697] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.006758 23470 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: No bootstrap required, opened a new log
I20260709 13:09:36.007313 23470 ts_tablet_manager.cc:1403] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.017s
I20260709 13:09:36.010259 23470 raft_consensus.cc:359] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.010949 23470 raft_consensus.cc:385] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:36.011209 23470 raft_consensus.cc:740] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Initialized, Role: FOLLOWER
I20260709 13:09:36.012219 23470 consensus_queue.cc:260] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.014668 23470 ts_tablet_manager.cc:1434] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:36.094643 23099 catalog_manager.cc:5697] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.111464 23349 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.131331 23869 consensus_queue.cc:1048] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:36.142310 23930 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:36.142845 23930 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.149549 23343 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.153228 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:36.160984 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:36.162446 23313 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:36.163250 23774 raft_consensus.cc:2749] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.163372 23930 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:36.198963 23349 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:36.241397 23930 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.241886 23930 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.243813 23930 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:36.252112 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:36.253118 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:36.258298 23924 consensus_queue.cc:1048] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:36.272786 23313 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:36.275470 23774 raft_consensus.cc:2749] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:36.928512 23951 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:36.929083 23951 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.931097 23951 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:36.931794 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:36.932452 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:36.932657 23349 raft_consensus.cc:2393] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:36.933082 23198 raft_consensus.cc:2468] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:36.934252 23387 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:36.935237 23951 raft_consensus.cc:2804] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:36.935575 23951 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:36.935907 23951 raft_consensus.cc:3060] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.942379 23951 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.945183 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:36.945128 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:36.946235 23349 raft_consensus.cc:2393] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:36.947687 23951 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:36.951612 23198 raft_consensus.cc:2468] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:36.952654 23387 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:36.953437 23951 raft_consensus.cc:2804] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.954399 23951 raft_consensus.cc:697] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:36.955314 23951 consensus_queue.cc:237] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:36.965647 23099 catalog_manager.cc:5697] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.424918 23199 raft_consensus.cc:1275] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.426260 23951 consensus_queue.cc:1048] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.442855 23349 raft_consensus.cc:1275] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.454707 24000 raft_consensus.cc:493] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.455929 24000 raft_consensus.cc:515] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:37.458185 24000 leader_election.cc:290] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:37.454597 23951 consensus_queue.cc:1048] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.459664 23198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:37.466384 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec4c4636c76b439db1396da335593209" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:37.467926 23313 leader_election.cc:304] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:37.478967 23930 raft_consensus.cc:2749] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:37.525235 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
W20260709 13:09:37.540746 23239 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 174 similar messages]
W20260709 13:09:37.584995 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 44049.5us
W20260709 13:09:37.616909 23239 consensus_peers.cc:597] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.617841 23239 consensus_peers.cc:597] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.618363 23239 consensus_peers.cc:597] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.626577 23239 consensus_peers.cc:597] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.627295 23239 consensus_peers.cc:597] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.627943 23239 consensus_peers.cc:597] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.632047 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:37.633025 15321 tablet_replica.cc:333] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.633915 15321 raft_consensus.cc:2243] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.635648 15321 raft_consensus.cc:2272] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.638310 15321 tablet_replica.cc:333] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.639254 15321 raft_consensus.cc:2243] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.640043 15321 raft_consensus.cc:2272] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.645589 15321 tablet_replica.cc:333] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.646559 15321 raft_consensus.cc:2243] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.647110 15321 raft_consensus.cc:2272] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.649824 15321 tablet_replica.cc:333] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.650735 15321 raft_consensus.cc:2243] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.651755 15321 raft_consensus.cc:2272] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.653578 23387 consensus_peers.cc:597] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.654428 15321 tablet_replica.cc:333] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.655228 15321 raft_consensus.cc:2243] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.655763 15321 raft_consensus.cc:2272] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.658532 15321 tablet_replica.cc:333] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.659345 15321 raft_consensus.cc:2243] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.660257 15321 raft_consensus.cc:2272] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.662989 15321 tablet_replica.cc:333] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.663738 15321 raft_consensus.cc:2243] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.664599 15321 raft_consensus.cc:2272] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.666968 15321 tablet_replica.cc:333] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.667795 15321 raft_consensus.cc:2243] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.668268 15321 raft_consensus.cc:2272] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.672813 15321 tablet_replica.cc:333] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.673727 15321 raft_consensus.cc:2243] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.674361 15321 raft_consensus.cc:2272] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.677078 15321 tablet_replica.cc:333] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.677670 15321 raft_consensus.cc:2243] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.678102 15321 raft_consensus.cc:2272] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.680366 15321 tablet_replica.cc:333] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.682070 15321 raft_consensus.cc:2243] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.684626 15321 raft_consensus.cc:2272] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.687121 23239 consensus_peers.cc:597] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.687470 15321 tablet_replica.cc:333] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.688216 15321 raft_consensus.cc:2243] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.689175 15321 raft_consensus.cc:2272] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.691599 15321 tablet_replica.cc:333] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.693284 15321 raft_consensus.cc:2243] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.693790 15321 raft_consensus.cc:2272] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.694664 23313 consensus_peers.cc:597] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.696480 15321 tablet_replica.cc:333] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.697248 15321 raft_consensus.cc:2243] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.697686 15321 raft_consensus.cc:2272] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.700273 15321 tablet_replica.cc:333] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.700902 15321 raft_consensus.cc:2243] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.701741 15321 raft_consensus.cc:2272] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.704142 15321 tablet_replica.cc:333] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.704991 15321 raft_consensus.cc:2243] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.705919 15321 raft_consensus.cc:2272] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.709148 15321 tablet_replica.cc:333] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.710002 15321 raft_consensus.cc:2243] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.710950 15321 raft_consensus.cc:2272] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.713102 23239 consensus_peers.cc:597] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.713522 15321 tablet_replica.cc:333] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.715049 15321 raft_consensus.cc:2243] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.715669 15321 raft_consensus.cc:2272] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.718582 15321 tablet_replica.cc:333] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.719213 15321 raft_consensus.cc:2243] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.720027 15321 raft_consensus.cc:2272] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.722131 15321 tablet_replica.cc:333] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.722658 15321 raft_consensus.cc:2243] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.723067 15321 raft_consensus.cc:2272] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.725004 15321 tablet_replica.cc:333] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.725534 15321 raft_consensus.cc:2243] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.725976 15321 raft_consensus.cc:2272] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.728041 15321 tablet_replica.cc:333] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.728814 15321 raft_consensus.cc:2243] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.729611 15321 raft_consensus.cc:2272] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.732089 15321 tablet_replica.cc:333] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.732810 15321 raft_consensus.cc:2243] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.733429 15321 raft_consensus.cc:2272] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.736281 15321 tablet_replica.cc:333] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.737017 15321 raft_consensus.cc:2243] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.737476 15321 raft_consensus.cc:2272] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.739667 23239 consensus_peers.cc:597] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.740475 15321 tablet_replica.cc:333] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.741173 15321 raft_consensus.cc:2243] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.741647 15321 raft_consensus.cc:2272] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.743821 15321 tablet_replica.cc:333] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.744575 15321 raft_consensus.cc:2243] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.745112 15321 raft_consensus.cc:2272] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.747548 15321 tablet_replica.cc:333] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.748111 15321 raft_consensus.cc:2243] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.748961 15321 raft_consensus.cc:2272] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.751483 15321 tablet_replica.cc:333] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.752079 15321 raft_consensus.cc:2243] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.752565 15321 raft_consensus.cc:2272] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.754890 15321 tablet_replica.cc:333] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.755456 15321 raft_consensus.cc:2243] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.755867 15321 raft_consensus.cc:2272] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.757863 15321 tablet_replica.cc:333] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.758668 15321 raft_consensus.cc:2243] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.759723 15321 raft_consensus.cc:2272] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.762312 15321 tablet_replica.cc:333] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.762974 15321 raft_consensus.cc:2243] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.763949 15321 raft_consensus.cc:2272] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.766618 15321 tablet_replica.cc:333] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.767385 15321 raft_consensus.cc:2243] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.767841 15321 raft_consensus.cc:2272] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.770015 15321 tablet_replica.cc:333] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.770531 15321 raft_consensus.cc:2243] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.770980 15321 raft_consensus.cc:2272] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.773027 15321 tablet_replica.cc:333] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.773546 15321 raft_consensus.cc:2243] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.773955 15321 raft_consensus.cc:2272] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.775918 15321 tablet_replica.cc:333] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.776535 15321 raft_consensus.cc:2243] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.777401 15321 raft_consensus.cc:2272] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.779570 15321 tablet_replica.cc:333] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.780104 15321 raft_consensus.cc:2243] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.781021 15321 raft_consensus.cc:2272] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.783615 15321 tablet_replica.cc:333] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.784315 15321 raft_consensus.cc:2243] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.784842 15321 raft_consensus.cc:2272] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.787537 15321 tablet_replica.cc:333] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.788278 15321 raft_consensus.cc:2243] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.789237 15321 raft_consensus.cc:2272] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.792026 15321 tablet_replica.cc:333] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.792757 15321 raft_consensus.cc:2243] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.793789 15321 raft_consensus.cc:2272] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.795755 23239 consensus_peers.cc:597] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.796262 15321 tablet_replica.cc:333] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.796929 15321 raft_consensus.cc:2243] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.797736 15321 raft_consensus.cc:2272] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.800372 15321 tablet_replica.cc:333] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.801077 15321 raft_consensus.cc:2243] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.801643 15321 raft_consensus.cc:2272] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.803737 15321 tablet_replica.cc:333] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.804258 15321 raft_consensus.cc:2243] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.805183 15321 raft_consensus.cc:2272] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.807718 15321 tablet_replica.cc:333] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.808343 15321 raft_consensus.cc:2243] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.809345 15321 raft_consensus.cc:2272] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.811568 15321 tablet_replica.cc:333] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.812036 15321 raft_consensus.cc:2243] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:37.812570 15321 raft_consensus.cc:2272] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:37.814734 15321 tablet_replica.cc:333] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: stopping tablet replica
I20260709 13:09:37.815382 15321 raft_consensus.cc:2243] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:37.816376 15321 raft_consensus.cc:2272] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:37.817903 23387 consensus_peers.cc:597] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.832670 23239 consensus_peers.cc:597] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.827252 23387 consensus_peers.cc:597] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.850287 23387 consensus_peers.cc:597] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.850994 23313 consensus_peers.cc:597] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.852340 23239 consensus_peers.cc:597] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.907989 23239 consensus_peers.cc:597] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:37.916831 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
W20260709 13:09:37.963086 23387 consensus_peers.cc:597] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.985378 23239 consensus_peers.cc:597] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:37.990625 23313 consensus_peers.cc:597] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:38.028429 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:38.035671 23387 consensus_peers.cc:597] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:38.046159 24015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.054729 24016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:38.063561 24019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:38.068616 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:38.073675 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:38.074107 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:38.074399 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602578074378 us; error 0 us; skew 500 ppm
I20260709 13:09:38.075341 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:38.079792 15321 webserver.cc:533] Webserver started at http://127.14.246.65:36959/ using document root <none> and password file <none>
I20260709 13:09:38.080608 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:38.080945 15321 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:38.087294 15321 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:38.104809 24025 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:38.106107 15321 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:09:38.106669 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "d4e47dfe9e4043b28804f74ca6320c78"
format_stamp: "Formatted at 2026-07-09 13:09:24 on dist-test-slave-bhv2"
I20260709 13:09:38.107227 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:38.204394 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:38.206288 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:38.215268 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:38.234315 24034 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:09:38.585300 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:38.585580 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.356s	user 0.013s	sys 0.000s
I20260709 13:09:38.585913 15321 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:38.596180 24034 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.621346 24017 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.621980 24017 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.623386 24034 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.624161 24017 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:38.624444 24034 tablet_bootstrap.cc:492] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.632063 24034 ts_tablet_manager.cc:1403] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.012s
W20260709 13:09:38.629534 23313 leader_election.cc:336] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.632153 24004 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.633744 24004 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.630800 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:38.636360 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.639451 24034 raft_consensus.cc:359] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.640641 24034 raft_consensus.cc:740] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.641577 24034 consensus_queue.cc:260] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.643946 23313 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:38.650050 23387 leader_election.cc:336] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.651732 23387 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.652432 23951 raft_consensus.cc:2749] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.652611 24034 ts_tablet_manager.cc:1434] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:09:38.650472 24004 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.651268 24017 raft_consensus.cc:2749] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.653635 24034 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.676694 24034 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.678193 24034 tablet_bootstrap.cc:492] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.678910 24034 ts_tablet_manager.cc:1403] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:09:38.680296 24017 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.680858 24017 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.681710 24034 raft_consensus.cc:359] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.682430 24034 raft_consensus.cc:740] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.682789 24017 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:38.683243 24034 consensus_queue.cc:260] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.685495 24034 ts_tablet_manager.cc:1434] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:38.686260 24034 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.686203 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:38.694487 23313 leader_election.cc:336] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.694907 23313 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.696067 24017 raft_consensus.cc:2749] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.711885 24034 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.712922 24034 tablet_bootstrap.cc:492] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.713578 24034 ts_tablet_manager.cc:1403] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.010s
I20260709 13:09:38.716094 24034 raft_consensus.cc:359] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.716786 24034 raft_consensus.cc:740] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.717636 24034 consensus_queue.cc:260] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.719830 24034 ts_tablet_manager.cc:1434] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:09:38.720592 24034 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.736431 24004 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.737176 24004 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.739888 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.745702 24034 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.746121 23904 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.746770 24034 tablet_bootstrap.cc:492] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.747521 24034 ts_tablet_manager.cc:1403] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:09:38.746745 23904 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.751042 23904 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.752930 24034 raft_consensus.cc:359] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.753696 24034 raft_consensus.cc:740] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.754530 24034 consensus_queue.cc:260] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.756745 24034 ts_tablet_manager.cc:1434] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:38.757629 24034 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:38.758241 23239 leader_election.cc:336] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.779202 24034 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.779629 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.780213 24034 tablet_bootstrap.cc:492] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.780548 23349 raft_consensus.cc:2468] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:38.781101 24034 ts_tablet_manager.cc:1403] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:09:38.783818 24034 raft_consensus.cc:359] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.784518 24034 raft_consensus.cc:740] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.785357 24034 consensus_queue.cc:260] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.787729 24034 ts_tablet_manager.cc:1434] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:38.788589 24034 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.792200 24007 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.792785 24007 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.794795 24007 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.801179 23930 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.801734 23930 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.803685 23930 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:38.804227 24017 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.804821 24017 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.806918 24017 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:38.809940 23239 leader_election.cc:336] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.814070 23240 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.747574 24004 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.815001 24030 raft_consensus.cc:2804] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:38.815518 24030 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.815917 24030 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.809942 24034 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.817745 23343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.818576 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:38.820986 24034 tablet_bootstrap.cc:492] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
W20260709 13:09:38.813107 23387 leader_election.cc:336] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.825109 23387 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.826404 24004 raft_consensus.cc:2749] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.827229 24034 ts_tablet_manager.cc:1403] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.004s
I20260709 13:09:38.829876 24034 raft_consensus.cc:359] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.832904 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:38.834167 24034 raft_consensus.cc:740] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.835078 24034 consensus_queue.cc:260] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.837091 23240 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.837651 24034 ts_tablet_manager.cc:1434] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:38.838527 24034 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.832894 24030 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.838814 23904 raft_consensus.cc:2749] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.840404 24030 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.840802 24004 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.841347 24004 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.844085 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:38.845422 23239 leader_election.cc:336] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.849406 24004 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.859508 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:38.860112 23349 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:38.863185 23387 leader_election.cc:336] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.864233 23387 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.866070 23930 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.867929 23930 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.869923 23930 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:38.870699 23313 leader_election.cc:336] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.866972 23349 raft_consensus.cc:2468] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
I20260709 13:09:38.871155 24004 raft_consensus.cc:2749] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.871204 23313 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.873647 24017 raft_consensus.cc:2749] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:38.874641 23313 leader_election.cc:336] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.881894 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:38.883471 23313 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:38.884213 24017 raft_consensus.cc:2749] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.886399 23240 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.887425 24030 raft_consensus.cc:2804] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.888139 24030 raft_consensus.cc:697] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:38.889508 24030 consensus_queue.cc:237] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.891206 24034 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.892565 24034 tablet_bootstrap.cc:492] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.893411 24034 ts_tablet_manager.cc:1403] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.007s
I20260709 13:09:38.896456 24034 raft_consensus.cc:359] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
W20260709 13:09:38.896960 23313 leader_election.cc:336] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.897415 24034 raft_consensus.cc:740] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.897717 23313 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:38.898387 24034 consensus_queue.cc:260] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.899518 24017 raft_consensus.cc:2749] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:38.901144 24034 ts_tablet_manager.cc:1434] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:38.902109 24034 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.907019 15321 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:38.907415 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.322s	user 0.252s	sys 0.000s
I20260709 13:09:38.909025 24017 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.909053 24042 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.910041 24042 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.909924 24017 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.915462 24017 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:38.917003 24042 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
W20260709 13:09:38.924817 23239 leader_election.cc:336] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.926666 23904 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.927384 23904 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.935433 24034 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.936563 24034 tablet_bootstrap.cc:492] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.937337 24034 ts_tablet_manager.cc:1403] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.004s
I20260709 13:09:38.940330 24034 raft_consensus.cc:359] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.941191 24034 raft_consensus.cc:740] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.942049 24034 consensus_queue.cc:260] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.943639 24007 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.944212 24007 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.944646 24034 ts_tablet_manager.cc:1434] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:09:38.945753 24034 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.946444 24007 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.950484 24017 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.951296 24017 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.956887 24017 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.957489 24007 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.958202 24007 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.961514 24007 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.963981 23904 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:38.968678 24017 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.969328 24017 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.970271 24034 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:38.971326 24034 tablet_bootstrap.cc:492] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:38.971124 23098 catalog_manager.cc:5697] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.972100 24034 ts_tablet_manager.cc:1403] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
W20260709 13:09:38.972939 23239 leader_election.cc:336] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:38.974565 24004 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.976903 24004 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:38.979622 24004 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.980734 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:38.981411 23419 raft_consensus.cc:2468] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:38.981600 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.982892 24028 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.983451 24028 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:38.985513 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:38.975944 24034 raft_consensus.cc:359] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.986317 24034 raft_consensus.cc:740] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:38.986384 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:38.987151 23268 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:38.987201 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.985674 24028 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:38.987347 24034 consensus_queue.cc:260] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:38.988803 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.989483 23341 raft_consensus.cc:2468] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:38.990862 24034 ts_tablet_manager.cc:1434] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:09:38.991882 24034 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:38.993404 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.993897 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:38.994064 23348 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:38.994462 23349 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:38.998121 24042 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:38.998795 24042 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.000037 24004 raft_consensus.cc:493] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.000707 24004 raft_consensus.cc:515] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.004868 24004 leader_election.cc:290] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.006155 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.006677 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.007522 23313 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:39.009402 23313 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.009526 23930 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.010077 24028 raft_consensus.cc:2804] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.010179 23930 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.010515 24028 raft_consensus.cc:493] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.010902 23930 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.011040 24028 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.006197 23240 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.018600 24049 raft_consensus.cc:2749] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.019066 24028 raft_consensus.cc:515] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.020370 24049 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.021124 24049 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.021762 24028 leader_election.cc:290] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.023515 24028 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.023814 24049 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.024055 24028 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.026455 23951 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.027051 23951 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.028925 23268 raft_consensus.cc:2468] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.029901 24042 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.031268 23951 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.026499 24028 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:38.971822 24017 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:39.038806 23313 leader_election.cc:336] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.039302 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.039330 23313 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.040283 23268 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
W20260709 13:09:39.041335 23313 leader_election.cc:336] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.042203 23313 leader_election.cc:336] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.043291 24028 raft_consensus.cc:2749] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.047111 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd55e8ce6f934c09ba57053aa2ac4298" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.047762 23421 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.048954 24004 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.049640 24004 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.048399 23240 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:39.045555 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 72632.7us
W20260709 13:09:39.060668 23387 leader_election.cc:336] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.061125 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.061385 23387 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.062355 23951 raft_consensus.cc:2749] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.056649 23421 raft_consensus.cc:2468] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.067493 23904 raft_consensus.cc:2804] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.068104 23904 raft_consensus.cc:493] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.068562 23904 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.068796 23951 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
W20260709 13:09:39.069167 23313 leader_election.cc:336] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.069342 23951 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.071794 23951 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.072237 23240 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:39.073647 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.074568 23349 raft_consensus.cc:2468] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:39.075796 23388 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.077468 24023 raft_consensus.cc:2804] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.077852 24023 raft_consensus.cc:493] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.078193 24023 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.085022 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.085250 24023 raft_consensus.cc:515] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.085695 23421 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:39.073575 23313 leader_election.cc:304] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.104839 24007 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
W20260709 13:09:39.122143 23313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 48652.8us
I20260709 13:09:39.122198 24007 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.124876 24007 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.124989 24058 raft_consensus.cc:2804] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.103711 24023 leader_election.cc:290] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.107052 24061 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.107071 24028 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.107903 24017 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.125943 24061 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.126114 24017 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.126031 24028 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.128046 24061 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.128335 24017 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.128922 24028 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.126006 24023 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.130520 24028 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.130638 24023 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.131218 24028 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.133620 24023 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.133723 24028 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.134538 23930 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.137434 23930 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.138226 23313 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.139436 24061 raft_consensus.cc:2804] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.139837 24061 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.140189 24061 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.145651 24007 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.146140 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.146212 24007 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.146893 23348 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:39.147671 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.148384 24007 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.151503 23904 raft_consensus.cc:515] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.152091 24065 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.111603 23387 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.112234 23240 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:39.113077 24060 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.152225 24061 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.153360 24060 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.152928 24065 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.094754 24042 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.114990 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd73e37c60d47939ed13f2464ce939c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.160862 23349 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.074787 24004 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.152733 23388 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.164898 23951 raft_consensus.cc:2804] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.165438 23951 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.165895 23951 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:39.155967 23240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 65378us
W20260709 13:09:39.156607 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 45107.2us
W20260709 13:09:39.169706 23387 leader_election.cc:336] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.170156 23387 leader_election.cc:304] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.170849 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
W20260709 13:09:39.171219 23387 leader_election.cc:336] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.171494 23421 raft_consensus.cc:2468] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.157218 24034 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:39.157584 23239 leader_election.cc:336] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.157742 24007 raft_consensus.cc:2804] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.158159 24023 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.158170 24061 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.158942 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.159583 24060 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.160085 24062 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.173991 23349 raft_consensus.cc:2468] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:39.152971 24058 raft_consensus.cc:697] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.182339 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.191391 24034 tablet_bootstrap.cc:492] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
W20260709 13:09:39.192445 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 48178.5us
I20260709 13:09:39.192384 23421 raft_consensus.cc:2468] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
W20260709 13:09:39.193367 23239 leader_election.cc:336] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.161455 24042 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.195644 24034 ts_tablet_manager.cc:1403] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.204s	user 0.036s	sys 0.025s
I20260709 13:09:39.198115 23388 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.180529 24007 raft_consensus.cc:493] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.177704 24004 raft_consensus.cc:2749] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.188238 24023 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.212051 24023 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.204886 23904 leader_election.cc:290] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.205689 24042 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.219133 23341 raft_consensus.cc:2393] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:39.211602 24007 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.197347 24062 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.238997 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.211041 24058 consensus_queue.cc:237] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.223475 24004 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
W20260709 13:09:39.243750 23313 leader_election.cc:336] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.246045 23421 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
W20260709 13:09:39.247368 23313 leader_election.cc:336] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.248112 23313 leader_election.cc:304] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:39.227231 24049 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.241211 24028 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.254664 24067 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.242343 24061 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.262353 24061 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.262883 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.263592 23341 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:39.265527 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.266036 24061 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.266177 23348 raft_consensus.cc:2468] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:39.261431 24063 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.261258 23951 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.269202 23239 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.276028 24062 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.277722 24034 raft_consensus.cc:359] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.272809 24028 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.278553 24034 raft_consensus.cc:740] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.279397 24034 consensus_queue.cc:260] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.279650 24063 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.272591 24065 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.282996 24063 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.273556 24067 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.283022 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.285506 23348 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:39.285739 24067 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.280485 24028 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.286350 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.286965 23349 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:39.287971 23388 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.288816 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.288939 23388 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.289413 23349 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.289884 24062 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.290361 24062 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.290947 24062 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.250572 24004 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.260457 23313 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.257562 23930 raft_consensus.cc:2749] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.294787 24060 raft_consensus.cc:2804] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.252458 24049 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.296108 23349 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:39.295258 24060 raft_consensus.cc:493] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.296981 24060 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.296264 23313 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.298008 23388 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.299645 24068 raft_consensus.cc:2804] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.300258 24068 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.300376 24066 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.300838 24068 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.300881 24066 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.301512 24066 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.299806 24049 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.300107 24023 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.304067 23930 raft_consensus.cc:2804] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.304533 23930 raft_consensus.cc:493] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.305261 23930 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.305523 24023 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.305914 23951 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.306358 24042 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.306761 23951 raft_consensus.cc:2804] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.294766 24004 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.307358 23951 raft_consensus.cc:697] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:39.308939 23313 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.308939 24071 raft_consensus.cc:2804] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.309767 24063 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.309980 24071 raft_consensus.cc:697] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:39.310233 24063 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.308246 23951 consensus_queue.cc:237] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.310724 24063 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.317469 24034 ts_tablet_manager.cc:1434] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.000s
I20260709 13:09:39.320241 24034 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:39.317643 23239 leader_election.cc:336] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.311425 24071 consensus_queue.cc:237] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.334228 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.314174 24042 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.336103 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.334980 23349 raft_consensus.cc:2468] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 1.
I20260709 13:09:39.330101 24062 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.339110 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.339685 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.340306 23274 raft_consensus.cc:2468] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.339936 23419 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.342877 23388 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.344480 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.345144 23421 raft_consensus.cc:2468] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
W20260709 13:09:39.350760 23239 leader_election.cc:336] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.352665 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.348891 24062 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.360103 24068 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.349205 24007 raft_consensus.cc:515] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.362740 24007 leader_election.cc:290] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.362818 24068 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.363356 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.364351 23422 raft_consensus.cc:2393] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 2: Already voted for candidate d522b0c35d264310bd559b320098c16e in this term.
I20260709 13:09:39.365096 23268 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.346776 24067 raft_consensus.cc:2804] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.366485 24067 raft_consensus.cc:493] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.366850 24067 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.367892 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.368503 23348 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.372493 24066 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.357232 24058 raft_consensus.cc:493] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.374063 24058 raft_consensus.cc:515] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.374830 24066 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.358393 24069 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.376089 24058 leader_election.cc:290] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.373684 23930 raft_consensus.cc:515] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.375846 24069 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.378162 24060 raft_consensus.cc:515] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
W20260709 13:09:39.382354 23313 leader_election.cc:336] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.386601 23313 leader_election.cc:336] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.387341 23313 leader_election.cc:336] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.387388 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
W20260709 13:09:39.387941 23313 leader_election.cc:336] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.388168 23424 raft_consensus.cc:2393] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 2: Already voted for candidate d522b0c35d264310bd559b320098c16e in this term.
I20260709 13:09:39.388265 24060 leader_election.cc:290] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.385748 24067 raft_consensus.cc:515] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.380718 24069 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.393392 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:39.393965 23274 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.394852 24067 leader_election.cc:290] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.382822 23930 leader_election.cc:290] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:39.388664 23313 leader_election.cc:336] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.395675 23313 leader_election.cc:336] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.396001 24063 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.391178 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
W20260709 13:09:39.396673 23313 leader_election.cc:336] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.397254 23268 raft_consensus.cc:2393] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 2: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:39.393775 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.398422 23422 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:39.395682 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea93c613531f490b982eb22566d2be59" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.399056 23349 raft_consensus.cc:2393] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:39.399315 23341 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.399857 24063 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:39.400692 23313 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.401582 23313 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.402602 23098 catalog_manager.cc:5697] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.403585 24063 raft_consensus.cc:2804] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.404049 24063 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.404656 24063 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.407632 23341 raft_consensus.cc:2468] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:39.408269 23930 raft_consensus.cc:2764] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:09:39.409735 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:39.410470 23422 raft_consensus.cc:2468] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
I20260709 13:09:39.411260 23388 leader_election.cc:304] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.412057 24067 raft_consensus.cc:2804] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.413012 24067 raft_consensus.cc:697] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:39.414397 24067 consensus_queue.cc:237] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.416705 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166ec71f2f7b44dfab28c0b65463fee8" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.418179 23422 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.408553 23274 raft_consensus.cc:2468] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.383721 23348 raft_consensus.cc:2468] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:39.421212 23388 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.422102 23951 raft_consensus.cc:2804] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.422576 23951 raft_consensus.cc:697] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:39.423396 23951 consensus_queue.cc:237] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.423755 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:39.424419 23274 raft_consensus.cc:2468] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
W20260709 13:09:39.388664 23239 leader_election.cc:336] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.427424 23239 leader_election.cc:336] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.430377 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daf723b2744f41baae3607813b1f7741" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.431499 24034 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.441792 23424 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.442377 24034 tablet_bootstrap.cc:492] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:39.443095 24034 ts_tablet_manager.cc:1403] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.123s	user 0.016s	sys 0.001s
I20260709 13:09:39.443562 23422 raft_consensus.cc:2468] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
W20260709 13:09:39.444454 23239 leader_election.cc:336] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.433072 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
W20260709 13:09:39.438881 23313 leader_election.cc:336] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.445245 23421 raft_consensus.cc:2393] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 2: Already voted for candidate d522b0c35d264310bd559b320098c16e in this term.
W20260709 13:09:39.445101 23239 leader_election.cc:336] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.445091 23313 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:39.421206 24063 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.446658 23930 raft_consensus.cc:2749] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.446863 23313 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.445734 24034 raft_consensus.cc:359] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.451948 24034 raft_consensus.cc:740] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.452840 24034 consensus_queue.cc:260] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
W20260709 13:09:39.445946 23239 leader_election.cc:336] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.454483 23424 raft_consensus.cc:2468] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.448452 24063 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:39.453550 23313 leader_election.cc:336] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.455590 24034 ts_tablet_manager.cc:1434] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:09:39.455525 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 108168us
I20260709 13:09:39.456516 24034 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:39.457990 23387 leader_election.cc:336] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.458407 23387 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.459071 24004 raft_consensus.cc:2749] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.456415 23313 leader_election.cc:336] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.460186 23387 leader_election.cc:336] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.462313 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83e8fdc5de04a6fb00f47aa53ebbed7" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.463289 23348 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.467900 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:39.468515 23349 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:39.470037 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.470805 23341 raft_consensus.cc:2393] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:39.471328 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4319f76bcdb44f55acf34e3e01b9358e" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.471967 23349 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.471055 23313 leader_election.cc:304] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.473444 24063 raft_consensus.cc:2804] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.473860 24063 raft_consensus.cc:493] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.473659 23313 leader_election.cc:304] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.474888 24063 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.475361 23930 raft_consensus.cc:2804] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.476020 23930 raft_consensus.cc:697] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.481164 23930 consensus_queue.cc:237] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.482659 23348 raft_consensus.cc:2468] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
W20260709 13:09:39.484289 23387 leader_election.cc:336] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.482527 24063 raft_consensus.cc:515] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.493585 23240 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.494482 24030 raft_consensus.cc:2749] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.489295 23239 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.494791 23240 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.495205 24063 leader_election.cc:290] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:39.496305 23239 leader_election.cc:336] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.497056 23239 leader_election.cc:336] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.497437 23239 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:39.498011 24074 raft_consensus.cc:2804] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.498118 24007 raft_consensus.cc:2804] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.498478 24074 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.498553 24007 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.498932 24074 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.498988 24007 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.500463 23904 raft_consensus.cc:2749] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.500653 23349 raft_consensus.cc:2468] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
W20260709 13:09:39.498250 23239 leader_election.cc:336] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.490461 23313 leader_election.cc:304] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.503504 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:39.507328 23268 raft_consensus.cc:2393] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d522b0c35d264310bd559b320098c16e in current term 2: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:39.507571 24063 raft_consensus.cc:2804] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.507222 24007 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.508931 23424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.509510 23424 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.510381 24063 raft_consensus.cc:697] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.511251 24063 consensus_queue.cc:237] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.512950 24007 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.512473 23098 catalog_manager.cc:5697] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.513865 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81908a1bb6847ce8ffb498f00f3d1cb" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.514599 23422 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.515530 23313 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:39.515719 23239 consensus_peers.cc:597] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:39.516264 24060 raft_consensus.cc:2804] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.516630 24060 raft_consensus.cc:493] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.517015 24060 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.523939 24060 raft_consensus.cc:515] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.525861 24060 leader_election.cc:290] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.526731 24074 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.527094 23313 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.528180 23313 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.528453 23930 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.529084 23930 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.537336 23930 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.540933 24058 raft_consensus.cc:2749] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.542271 23313 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.530167 23422 raft_consensus.cc:2468] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.531664 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:39.545372 23421 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.536525 23098 catalog_manager.cc:5697] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.545389 24060 raft_consensus.cc:2804] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.546663 24060 raft_consensus.cc:697] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.547463 24060 consensus_queue.cc:237] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
W20260709 13:09:39.547911 23387 leader_election.cc:336] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.550868 23313 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.552064 23421 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
W20260709 13:09:39.533648 23239 leader_election.cc:336] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.534699 23240 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.555737 24034 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:39.548858 23387 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.556174 23930 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.556674 24034 tablet_bootstrap.cc:492] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:39.557350 24034 ts_tablet_manager.cc:1403] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.007s
I20260709 13:09:39.557984 23930 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:39.532210 23424 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.559949 24034 raft_consensus.cc:359] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.560503 23239 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.561036 24058 raft_consensus.cc:2804] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.561290 24030 raft_consensus.cc:2804] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.561486 24058 raft_consensus.cc:493] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.561712 24030 raft_consensus.cc:493] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.561924 24058 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.562124 24030 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.565903 24066 raft_consensus.cc:2804] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.566609 24066 raft_consensus.cc:697] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:39.567744 24066 consensus_queue.cc:237] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.570818 23240 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.571233 24058 raft_consensus.cc:515] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.571628 24049 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:39.571998 24049 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:39.572371 24049 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.573341 24058 leader_election.cc:290] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:39.579804 23313 leader_election.cc:336] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.528743 24074 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:39.581418 23313 leader_election.cc:336] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.582819 23240 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.586216 24069 raft_consensus.cc:2749] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.582126 23313 leader_election.cc:336] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.588236 23313 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.588635 23313 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e
I20260709 13:09:39.588719 23240 leader_election.cc:304] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.560674 24034 raft_consensus.cc:740] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:39.585091 24030 raft_consensus.cc:515] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.590068 24069 raft_consensus.cc:2804] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.590546 23930 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.590777 24069 raft_consensus.cc:697] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:39.591840 24030 leader_election.cc:290] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.592048 24069 consensus_queue.cc:237] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.593046 24034 consensus_queue.cc:260] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:39.580432 24049 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.596292 24049 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:39.599952 24034 ts_tablet_manager.cc:1434] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:09:39.600821 24034 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:39.603578 23240 leader_election.cc:304] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.605062 24030 raft_consensus.cc:2804] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.605782 24030 raft_consensus.cc:697] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:39.606673 24030 consensus_queue.cc:237] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
W20260709 13:09:39.607928 23239 leader_election.cc:336] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.610386 23313 leader_election.cc:304] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.610994 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:39.611268 23313 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:39.611712 23274 raft_consensus.cc:2393] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 2: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:39.613049 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb613826a4374135aa008dc054ae5daf" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:39.613214 23272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e295bcfea248c8a36d4b46b0c6f55a" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:39.613683 23268 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.616940 24060 raft_consensus.cc:2804] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.617460 24060 raft_consensus.cc:697] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.618328 24060 consensus_queue.cc:237] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.613737 23272 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.626149 24058 raft_consensus.cc:2804] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.626845 24058 raft_consensus.cc:697] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
W20260709 13:09:39.634303 23313 leader_election.cc:336] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.635423 23313 leader_election.cc:336] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.627718 24058 consensus_queue.cc:237] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:39.652880 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.653679 23349 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.667671 23272 raft_consensus.cc:2468] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.669287 23268 raft_consensus.cc:2468] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:39.679816 23348 raft_consensus.cc:1275] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.682061 23348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e45fa2e0e25b4deba3ceadbb53abac4f" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.682778 23348 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.685981 23343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:39.687141 23343 raft_consensus.cc:2393] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:39.691613 23348 raft_consensus.cc:2468] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
W20260709 13:09:39.695792 23313 leader_election.cc:336] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.696491 23313 leader_election.cc:336] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.696969 23313 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.697832 24028 raft_consensus.cc:2749] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.698032 23313 leader_election.cc:336] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.705252 23387 leader_election.cc:336] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.709743 24074 consensus_queue.cc:1048] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.710209 23313 leader_election.cc:304] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.711279 23313 leader_election.cc:304] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.712139 23240 leader_election.cc:304] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:39.713850 24017 raft_consensus.cc:2804] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.713928 23930 raft_consensus.cc:2804] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.714433 24017 raft_consensus.cc:697] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.714597 24074 raft_consensus.cc:2804] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.714737 23930 raft_consensus.cc:697] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:39.715727 24074 raft_consensus.cc:697] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:39.716493 23930 consensus_queue.cc:237] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.715430 24017 consensus_queue.cc:237] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.716784 24074 consensus_queue.cc:237] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.726241 23349 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
W20260709 13:09:39.727286 23387 leader_election.cc:336] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.728080 23387 leader_election.cc:336] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.728448 23387 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.729156 24067 raft_consensus.cc:2749] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:39.729344 23387 leader_election.cc:336] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.730073 23387 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.730966 23240 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.732227 24030 raft_consensus.cc:2804] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.732709 24030 raft_consensus.cc:697] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:39.733147 23387 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.737936 23098 catalog_manager.cc:5697] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.741691 23098 catalog_manager.cc:5697] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.743487 23098 catalog_manager.cc:5697] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.745937 23098 catalog_manager.cc:5697] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.745010 23387 leader_election.cc:336] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.747967 23387 leader_election.cc:336] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.748368 23239 leader_election.cc:336] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:39.749368 23239 leader_election.cc:336] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:39.749866 23239 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:39.801951 24034 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:39.813819 23421 raft_consensus.cc:1275] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.762660 24069 raft_consensus.cc:2749] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.762816 24067 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:39.815621 24060 consensus_queue.cc:1048] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:39.817953 24034 tablet_bootstrap.cc:492] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:39.822801 24034 ts_tablet_manager.cc:1403] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.222s	user 0.017s	sys 0.008s
I20260709 13:09:39.828467 24034 raft_consensus.cc:359] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.829643 24034 raft_consensus.cc:740] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
W20260709 13:09:39.839990 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 76590.9us
I20260709 13:09:39.841859 24034 consensus_queue.cc:260] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.842447 23099 catalog_manager.cc:5697] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.733570 24030 consensus_queue.cc:237] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:39.847355 24034 ts_tablet_manager.cc:1434] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:09:39.849943 24034 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:39.905879 23348 raft_consensus.cc:1275] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.924351 23097 catalog_manager.cc:5697] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.926345 23097 catalog_manager.cc:5697] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.930156 23097 catalog_manager.cc:5697] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:39.950073 23239 consensus_peers.cc:597] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.007367 23348 raft_consensus.cc:1275] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:40.057740 23313 consensus_peers.cc:597] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.076191 23419 raft_consensus.cc:1275] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.081702 23424 raft_consensus.cc:1275] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.083212 23930 consensus_queue.cc:1048] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.085348 23272 raft_consensus.cc:1275] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.085762 23422 raft_consensus.cc:1275] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.089504 23342 raft_consensus.cc:1275] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:40.102680 23387 consensus_peers.cc:597] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.103353 23387 consensus_peers.cc:597] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.112810 23344 raft_consensus.cc:1275] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.117503 24017 consensus_queue.cc:1048] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:40.118393 23313 consensus_peers.cc:597] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.114880 23099 catalog_manager.cc:5697] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:40.119585 23313 consensus_peers.cc:597] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.120338 23099 catalog_manager.cc:5697] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.118896 23930 consensus_queue.cc:1048] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:40.131071 23239 consensus_peers.cc:597] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.135032 23313 consensus_peers.cc:597] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.135823 24004 consensus_queue.cc:1048] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:40.146083 23387 consensus_peers.cc:597] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.147179 23387 consensus_peers.cc:597] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.153529 23239 consensus_peers.cc:597] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.154358 23239 consensus_peers.cc:597] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.154860 23239 consensus_peers.cc:597] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.164958 23342 raft_consensus.cc:1275] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.181700 24034 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.182909 23350 raft_consensus.cc:1275] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.188437 24036 raft_consensus.cc:493] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.188964 24036 raft_consensus.cc:515] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:40.190768 24034 tablet_bootstrap.cc:492] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:40.169762 24071 consensus_queue.cc:1048] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:09:40.191483 24034 ts_tablet_manager.cc:1403] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.343s	user 0.021s	sys 0.016s
I20260709 13:09:40.183363 23417 raft_consensus.cc:1275] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.185889 23268 raft_consensus.cc:1275] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.159176 24017 consensus_queue.cc:1048] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:09:40.194751 23313 consensus_peers.cc:597] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.197057 24107 consensus_queue.cc:1048] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:09:40.165517 24078 consensus_queue.cc:1048] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:09:40.198789 23313 consensus_peers.cc:597] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.165683 24067 consensus_queue.cc:1048] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:09:40.206444 24034 raft_consensus.cc:359] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.207034 24034 raft_consensus.cc:740] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.207932 24034 consensus_queue.cc:260] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.214033 23416 raft_consensus.cc:1275] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.203346 24122 consensus_queue.cc:1048] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:09:40.193737 24036 leader_election.cc:290] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
W20260709 13:09:40.244477 23239 consensus_peers.cc:597] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.249181 24028 consensus_queue.cc:1048] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:40.254047 23387 consensus_peers.cc:597] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.257365 24036 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.257896 24036 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:40.260164 24036 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:40.267139 23313 consensus_peers.cc:597] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.267647 23313 consensus_peers.cc:597] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.266155 23097 catalog_manager.cc:5697] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.273765 23097 catalog_manager.cc:5697] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.275722 23097 catalog_manager.cc:5697] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.277976 23097 catalog_manager.cc:5697] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 2, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 2 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:40.279615 23239 consensus_peers.cc:597] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.286022 24036 raft_consensus.cc:493] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.286592 24036 raft_consensus.cc:515] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:40.288697 24036 leader_election.cc:290] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
W20260709 13:09:40.331779 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 51030.5us
W20260709 13:09:40.332019 23313 consensus_peers.cc:597] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:40.352380 24063 consensus_queue.cc:1048] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.358810 23269 raft_consensus.cc:1275] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.360731 23342 raft_consensus.cc:1275] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.381866 23344 raft_consensus.cc:1275] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.382611 24007 consensus_queue.cc:1048] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.388746 24028 consensus_queue.cc:1048] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:40.391299 23313 consensus_peers.cc:597] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.392324 24007 consensus_queue.cc:1048] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.402443 24034 ts_tablet_manager.cc:1434] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.211s	user 0.019s	sys 0.011s
I20260709 13:09:40.403389 24034 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:40.406327 24135 raft_consensus.cc:493] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.407124 24135 raft_consensus.cc:515] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.415807 24036 raft_consensus.cc:493] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.416370 24036 raft_consensus.cc:515] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:40.418731 24036 leader_election.cc:290] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:40.426558 24036 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.427017 24036 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.428927 24036 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:40.429836 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.68:35951, user_credentials={real_user=slave}} blocked reactor thread for 97037.4us
I20260709 13:09:40.431991 23273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.432648 23272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.434320 23274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.436010 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:40.439451 23387 consensus_peers.cc:597] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.441630 24066 consensus_queue.cc:1048] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.483795 24036 raft_consensus.cc:493] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.484359 24036 raft_consensus.cc:515] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:40.487937 24036 leader_election.cc:290] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:40.409363 24135 leader_election.cc:290] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:40.513322 23239 consensus_peers.cc:597] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.519526 23239 consensus_peers.cc:597] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.519905 23239 consensus_peers.cc:597] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.520228 23239 consensus_peers.cc:597] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.533841 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.538120 24036 raft_consensus.cc:493] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.538669 24036 raft_consensus.cc:515] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:40.540191 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.529461 24135 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.545248 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.532037 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
W20260709 13:09:40.548118 24149 log.cc:927] Time spent T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:09:40.551895 23350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c40f00e82080462d9460eb9c85f4992b" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.552229 23343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87502ffc9004276b2e75e7916ee177f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.553349 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a786424dfd04ed5afafe8bec218aaa7" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.553702 24135 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.555208 24027 leader_election.cc:304] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:40.582484 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
W20260709 13:09:40.583849 24150 log.cc:927] Time spent T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
W20260709 13:09:40.590713 23387 consensus_peers.cc:597] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.591239 23313 consensus_peers.cc:597] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.591585 23387 consensus_peers.cc:597] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.592212 23239 consensus_peers.cc:597] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.592655 23239 consensus_peers.cc:597] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:40.593122 23239 consensus_peers.cc:597] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.617127 24135 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:40.617813 24135 raft_consensus.cc:2749] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.628695 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.660462 24036 leader_election.cc:290] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:40.693663 24026 leader_election.cc:304] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.695071 24161 raft_consensus.cc:2749] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:40.689592 24154 log.cc:927] Time spent T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:09:40.698299 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.699102 23419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.704632 23346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b896a6b74a8d4fc5bb8edddae5e03d75" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.718289 24034 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.720094 24034 tablet_bootstrap.cc:492] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:40.720854 24034 ts_tablet_manager.cc:1403] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.318s	user 0.031s	sys 0.022s
I20260709 13:09:40.711314 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.712191 24026 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
W20260709 13:09:40.735595 23387 consensus_peers.cc:597] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.743327 24161 raft_consensus.cc:2749] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.745494 24026 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.747148 24034 raft_consensus.cc:359] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:40.752686 24161 raft_consensus.cc:2749] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.749976 24034 raft_consensus.cc:740] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.757287 24034 consensus_queue.cc:260] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:40.759567 24034 ts_tablet_manager.cc:1434] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:09:40.760344 24034 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:40.805506 24027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 250408us
I20260709 13:09:40.806356 24027 leader_election.cc:304] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:40.809068 24161 raft_consensus.cc:2749] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.810292 24027 leader_election.cc:304] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:40.811196 24161 raft_consensus.cc:2749] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.812350 24027 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.813860 24161 raft_consensus.cc:2749] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.814925 24027 leader_election.cc:304] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
W20260709 13:09:40.813177 23239 consensus_peers.cc:597] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.818279 24161 raft_consensus.cc:2749] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.827618 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a038d7dba05a4ceab3770a6926c3b41f" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.829900 24161 raft_consensus.cc:493] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.830478 24161 raft_consensus.cc:515] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.834523 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.834848 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cca5c2967b64eccacaac1741e66ae52" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.836012 24161 leader_election.cc:290] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:40.837013 23387 consensus_peers.cc:597] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.838912 24026 leader_election.cc:304] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.839999 24161 raft_consensus.cc:2749] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:40.837095 24027 leader_election.cc:304] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.845958 24161 raft_consensus.cc:2749] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:40.850135 23239 consensus_peers.cc:597] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.890767 24034 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.891721 24034 tablet_bootstrap.cc:492] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:40.892378 24034 ts_tablet_manager.cc:1403] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.132s	user 0.052s	sys 0.033s
I20260709 13:09:40.894986 24034 raft_consensus.cc:359] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.895654 24034 raft_consensus.cc:740] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
W20260709 13:09:40.895694 23239 consensus_peers.cc:597] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:40.896298 23239 consensus_peers.cc:597] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.896517 24034 consensus_queue.cc:260] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.898837 24034 ts_tablet_manager.cc:1434] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:40.899590 24034 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:40.926697 24034 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.927682 24034 tablet_bootstrap.cc:492] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:40.928325 24034 ts_tablet_manager.cc:1403] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.003s
I20260709 13:09:40.932174 24034 raft_consensus.cc:359] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:40.932915 24034 raft_consensus.cc:740] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:40.934963 24034 consensus_queue.cc:260] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:40.937453 24034 ts_tablet_manager.cc:1434] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.008s
I20260709 13:09:40.938270 24034 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:40.957685 23239 consensus_peers.cc:597] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:40.982854 24034 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:40.983908 24034 tablet_bootstrap.cc:492] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:40.984521 24034 ts_tablet_manager.cc:1403] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.001s
I20260709 13:09:40.990784 24161 raft_consensus.cc:493] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.991400 24161 raft_consensus.cc:515] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:40.993340 24161 leader_election.cc:290] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:40.996042 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:40.996428 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f632a33cc3f4e5cadaab0200db6a404" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:40.997993 24026 leader_election.cc:304] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e
I20260709 13:09:40.999192 24161 raft_consensus.cc:2749] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.003511 24161 raft_consensus.cc:493] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.004009 24161 raft_consensus.cc:515] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.007012 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:40.999549 24034 raft_consensus.cc:359] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.010452 24034 raft_consensus.cc:740] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.011319 24034 consensus_queue.cc:260] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.013785 24034 ts_tablet_manager.cc:1434] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:09:41.014650 24034 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.019058 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6c678249de84b02a478517fcded93af" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:41.020946 24026 leader_election.cc:304] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:41.021806 24036 raft_consensus.cc:2749] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.027324 24161 leader_election.cc:290] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:41.051810 24034 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.065771 24034 tablet_bootstrap.cc:492] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.066550 24034 ts_tablet_manager.cc:1403] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.005s
I20260709 13:09:41.069339 24034 raft_consensus.cc:359] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.070088 24034 raft_consensus.cc:740] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.071518 24034 consensus_queue.cc:260] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.091714 24034 ts_tablet_manager.cc:1434] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:09:41.093955 24034 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.127300 24034 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.128314 24034 tablet_bootstrap.cc:492] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.128983 24034 ts_tablet_manager.cc:1403] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.004s
I20260709 13:09:41.141513 24034 raft_consensus.cc:359] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.142525 24034 raft_consensus.cc:740] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.143428 24034 consensus_queue.cc:260] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.145897 24034 ts_tablet_manager.cc:1434] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:09:41.146736 24034 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.164690 24060 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.165458 24060 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.169576 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e" is_pre_election: true
I20260709 13:09:41.170408 23422 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:41.172155 23313 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:41.172941 24017 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.173306 24017 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.173636 24017 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.177548 24060 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:41.186633 24034 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.182439 24017 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.189100 24017 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:41.190197 24034 tablet_bootstrap.cc:492] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.191052 24034 ts_tablet_manager.cc:1403] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.012s
I20260709 13:09:41.193537 24034 raft_consensus.cc:359] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.196132 24034 raft_consensus.cc:740] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.196803 24034 consensus_queue.cc:260] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.198765 24034 ts_tablet_manager.cc:1434] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:41.199554 24034 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.216166 23422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:41.216914 23422 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.222251 24034 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.223296 24034 tablet_bootstrap.cc:492] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.223977 24034 ts_tablet_manager.cc:1403] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:09:41.228263 24034 raft_consensus.cc:359] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.229018 24034 raft_consensus.cc:740] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.229816 24034 consensus_queue.cc:260] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.232615 24034 ts_tablet_manager.cc:1434] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:09:41.233460 24034 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:41.238945 23313 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:41.259115 23422 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 3.
I20260709 13:09:41.266130 23313 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:41.278486 24058 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.279059 24058 raft_consensus.cc:697] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:41.279970 24058 consensus_queue.cc:237] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.294577 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:43229
I20260709 13:09:41.304404 24203 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:43229 every 8 connection(s)
I20260709 13:09:41.316632 24034 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.318919 24034 tablet_bootstrap.cc:492] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.319593 24034 ts_tablet_manager.cc:1403] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.015s
I20260709 13:09:41.324882 24034 raft_consensus.cc:359] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.326701 24034 raft_consensus.cc:740] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.324520 24121 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.327396 24034 consensus_queue.cc:260] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.328022 24121 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.332742 24034 ts_tablet_manager.cc:1434] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:41.333858 24034 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.338570 24121 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:41.343282 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:41.344003 23271 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:41.345698 23387 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:41.352558 24121 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.353652 24121 raft_consensus.cc:493] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.354740 24121 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.374958 23097 catalog_manager.cc:5697] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 3, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.419358 24121 raft_consensus.cc:515] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.424239 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:41.425065 24159 raft_consensus.cc:3060] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.424990 24131 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.439114 24153 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.440421 24143 raft_consensus.cc:3060] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.447613 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:41.465201 24069 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.481215 24121 leader_election.cc:290] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:41.480646 24069 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.498708 24069 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:41.490334 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c011e03361b480dae81285f6f09ef6a" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:41.501257 23271 raft_consensus.cc:3060] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.520305 24060 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.531369 24060 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.557126 24162 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.569185 24162 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.571557 24162 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:41.565452 23342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:41.574559 23342 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
I20260709 13:09:41.570869 24131 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 3.
I20260709 13:09:41.578106 23271 raft_consensus.cc:2468] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 3.
I20260709 13:09:41.578636 23387 leader_election.cc:304] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:41.586190 24123 raft_consensus.cc:2804] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.586696 24123 raft_consensus.cc:697] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 3 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:41.587505 24123 consensus_queue.cc:237] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:41.588927 24171 raft_consensus.cc:3060] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.589329 24131 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.580516 24034 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.582319 24161 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.596136 24161 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.596719 24034 tablet_bootstrap.cc:492] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.597595 24034 ts_tablet_manager.cc:1403] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.264s	user 0.016s	sys 0.009s
I20260709 13:09:41.598234 24161 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:41.604568 23240 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:41.599267 24159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:41.610448 24030 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.610893 24030 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.611325 24030 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.611084 24159 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:41.612740 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:41.615485 23341 raft_consensus.cc:2393] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d4e47dfe9e4043b28804f74ca6320c78 in current term 2: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:41.623853 23342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" is_pre_election: true
I20260709 13:09:41.624650 23342 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 2.
I20260709 13:09:41.628711 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:41.629702 23271 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:41.614542 24060 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:41.635429 24214 log.cc:927] Time spent T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
I20260709 13:09:41.638075 23313 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:41.643769 23240 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 
I20260709 13:09:41.649920 24034 raft_consensus.cc:359] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.650974 24034 raft_consensus.cc:740] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.641222 24063 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.652235 24063 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.652724 24063 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.664191 24221 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:41.664848 24221 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.665189 24221 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.665473 24034 consensus_queue.cc:260] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.668110 24030 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.675552 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
I20260709 13:09:41.676512 24172 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 1.
I20260709 13:09:41.641675 23098 catalog_manager.cc:5697] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 3, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 3 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.680744 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:41.688709 24173 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.691885 24034 ts_tablet_manager.cc:1434] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:09:41.692829 24034 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.704015 24030 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:41.762550 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:41.770191 24165 raft_consensus.cc:3060] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.755102 23341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:41.736413 24221 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.798611 24221 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:41.794889 23341 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.801970 23420 raft_consensus.cc:1275] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:41.802830 24173 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 3.
I20260709 13:09:41.804744 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78" is_pre_election: true
W20260709 13:09:41.805408 23313 leader_election.cc:343] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:41.808861 24206 consensus_queue.cc:1048] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:09:41.847226 23341 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 3.
I20260709 13:09:41.849071 24063 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.851990 24063 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 election: Requested vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:41.808743 24173 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 1.
W20260709 13:09:41.860702 23313 consensus_peers.cc:597] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.862749 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 92605.8us
I20260709 13:09:41.865931 23239 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:41.868101 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:41.868678 24069 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.868856 23269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d20799306e481286363a5ec8b35c0a" is_pre_election: true
I20260709 13:09:41.869578 24069 raft_consensus.cc:697] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:41.869711 23268 raft_consensus.cc:2393] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in current term 3: Already voted for candidate 11d20799306e481286363a5ec8b35c0a in this term.
I20260709 13:09:41.870465 24069 consensus_queue.cc:237] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.888031 23342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:41.888899 23342 raft_consensus.cc:2393] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d20799306e481286363a5ec8b35c0a in current term 3: Already voted for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in this term.
I20260709 13:09:41.897918 24026 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78; no voters: 11d20799306e481286363a5ec8b35c0a, 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:41.898761 24131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "11d20799306e481286363a5ec8b35c0a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:41.902148 24131 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.900851 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
I20260709 13:09:41.915654 24131 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d20799306e481286363a5ec8b35c0a in term 3.
I20260709 13:09:41.933782 24226 raft_consensus.cc:2749] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:41.943073 24034 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:41.944636 24165 raft_consensus.cc:3060] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:41.947234 24034 tablet_bootstrap.cc:492] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:41.947973 24034 ts_tablet_manager.cc:1403] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.255s	user 0.012s	sys 0.007s
I20260709 13:09:41.948268 23313 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:41.950480 24034 raft_consensus.cc:359] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.950845 24017 raft_consensus.cc:2749] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:09:41.951188 24034 raft_consensus.cc:740] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:41.951890 24034 consensus_queue.cc:260] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:41.959801 24034 ts_tablet_manager.cc:1434] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:09:41.960917 24034 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:41.974143 23099 catalog_manager.cc:5697] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 3, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 3 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.985555 23239 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:41.987097 24218 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.987632 24218 raft_consensus.cc:697] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Becoming Leader. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:41.988503 24218 consensus_queue.cc:237] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:41.994894 24209 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38585
I20260709 13:09:41.995368 24209 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:41.996253 24209 heartbeater.cc:507] Master 127.14.246.126:38585 requested a full tablet report, sending...
I20260709 13:09:42.020308 24034 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.023490 24034 tablet_bootstrap.cc:492] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.024271 24034 ts_tablet_manager.cc:1403] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.005s
I20260709 13:09:42.026883 24034 raft_consensus.cc:359] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.029297 24034 raft_consensus.cc:740] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.030447 24034 consensus_queue.cc:260] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.032998 24131 raft_consensus.cc:1275] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.034561 24034 ts_tablet_manager.cc:1434] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:42.036723 24034 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.051914 23099 catalog_manager.cc:5697] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a reported cstate change: term changed from 1 to 3, leader changed from d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65) to 11d20799306e481286363a5ec8b35c0a (127.14.246.66). New cstate: current_term: 3 leader_uuid: "11d20799306e481286363a5ec8b35c0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.058838 24217 consensus_queue.cc:1048] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:42.098073 24173 raft_consensus.cc:3060] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.125365 23271 raft_consensus.cc:1275] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.127513 23099 ts_manager.cc:194] Re-registered known tserver with Master: d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
I20260709 13:09:42.134781 24121 consensus_queue.cc:1048] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.223381 24034 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.224500 24034 tablet_bootstrap.cc:492] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.225366 24034 ts_tablet_manager.cc:1403] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.189s	user 0.044s	sys 0.027s
I20260709 13:09:42.228130 24034 raft_consensus.cc:359] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.228885 24034 raft_consensus.cc:740] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.230681 24034 consensus_queue.cc:260] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.234325 24034 ts_tablet_manager.cc:1434] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:42.235261 24034 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.252077 24034 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.253111 24034 tablet_bootstrap.cc:492] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.253760 24034 ts_tablet_manager.cc:1403] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:09:42.256484 24034 raft_consensus.cc:359] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.257251 24034 raft_consensus.cc:740] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.257959 24034 consensus_queue.cc:260] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.260258 24034 ts_tablet_manager.cc:1434] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:42.261142 24034 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.284415 24034 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.285485 24034 tablet_bootstrap.cc:492] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.286190 24034 ts_tablet_manager.cc:1403] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:09:42.289247 24034 raft_consensus.cc:359] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.290017 24034 raft_consensus.cc:740] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.290751 24034 consensus_queue.cc:260] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.293093 24034 ts_tablet_manager.cc:1434] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:42.293974 24034 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.316300 23099 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41294
I20260709 13:09:42.321902 24034 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.322973 24034 tablet_bootstrap.cc:492] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.323325 24209 heartbeater.cc:499] Master 127.14.246.126:38585 was elected leader, sending a full tablet report...
I20260709 13:09:42.323659 24034 ts_tablet_manager.cc:1403] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 13:09:42.326440 24034 raft_consensus.cc:359] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.327137 24034 raft_consensus.cc:740] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.327773 24034 consensus_queue.cc:260] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.330082 24034 ts_tablet_manager.cc:1434] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:42.330891 24034 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.371156 24034 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.372233 24034 tablet_bootstrap.cc:492] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.372990 24034 ts_tablet_manager.cc:1403] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.023s
I20260709 13:09:42.375712 24034 raft_consensus.cc:359] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.376435 24034 raft_consensus.cc:740] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.377144 24034 consensus_queue.cc:260] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.379355 24034 ts_tablet_manager.cc:1434] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:09:42.379383 23313 consensus_peers.cc:597] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:42.380215 24034 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.400022 24165 raft_consensus.cc:3060] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.403652 24034 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.404690 24034 tablet_bootstrap.cc:492] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.405397 24034 ts_tablet_manager.cc:1403] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:09:42.408193 24034 raft_consensus.cc:359] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.408927 24034 raft_consensus.cc:740] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.409808 24034 consensus_queue.cc:260] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:42.412358 24034 ts_tablet_manager.cc:1434] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:42.413195 24034 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.438421 24034 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.438575 24171 raft_consensus.cc:1275] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.439469 24034 tablet_bootstrap.cc:492] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.440183 24034 ts_tablet_manager.cc:1403] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.009s
I20260709 13:09:42.442840 24034 raft_consensus.cc:359] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.443570 24034 raft_consensus.cc:740] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.444789 24034 consensus_queue.cc:260] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.444926 24230 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:42.447315 24034 ts_tablet_manager.cc:1434] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:09:42.448279 24034 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.465512 24173 raft_consensus.cc:3060] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:42.470650 23313 consensus_peers.cc:597] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:42.518067 24131 raft_consensus.cc:1275] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.526489 23342 raft_consensus.cc:1275] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:42.534920 23341 raft_consensus.cc:1275] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Refusing update from remote peer 11d20799306e481286363a5ec8b35c0a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:09:42.547096 23313 consensus_peers.cc:597] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:42.548029 24236 consensus_queue.cc:1048] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:42.566500 24230 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.565481 24218 consensus_queue.cc:1048] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:09:42.578692 24173 raft_consensus.cc:3060] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.588068 24034 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.589212 24034 tablet_bootstrap.cc:492] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.590152 24034 ts_tablet_manager.cc:1403] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.142s	user 0.051s	sys 0.064s
I20260709 13:09:42.593638 24131 raft_consensus.cc:3060] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.619931 24034 raft_consensus.cc:359] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.620739 24034 raft_consensus.cc:740] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.621662 24034 consensus_queue.cc:260] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.624044 24034 ts_tablet_manager.cc:1434] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:09:42.624912 24034 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.660758 24034 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.664573 24034 tablet_bootstrap.cc:492] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.665218 24034 ts_tablet_manager.cc:1403] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 13:09:42.669245 24165 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.677574 24034 raft_consensus.cc:359] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.678421 24034 raft_consensus.cc:740] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.679322 24034 consensus_queue.cc:260] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.682658 24034 ts_tablet_manager.cc:1434] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:42.683560 24034 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.713862 24131 raft_consensus.cc:3060] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.793277 24034 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.794247 24034 tablet_bootstrap.cc:492] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.794939 24034 ts_tablet_manager.cc:1403] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.035s
I20260709 13:09:42.797559 24034 raft_consensus.cc:359] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.798236 24034 raft_consensus.cc:740] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.800275 24034 consensus_queue.cc:260] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.802500 24034 ts_tablet_manager.cc:1434] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:42.820626 24034 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:42.841558 23387 consensus_peers.cc:597] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:42.897315 24034 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.898259 24034 tablet_bootstrap.cc:492] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.899030 24034 ts_tablet_manager.cc:1403] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.000s
I20260709 13:09:42.902034 24034 raft_consensus.cc:359] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.902814 24034 raft_consensus.cc:740] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.904604 24034 consensus_queue.cc:260] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.909121 24034 ts_tablet_manager.cc:1434] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:09:42.909961 24034 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:42.917372 23239 consensus_peers.cc:597] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:42.942018 24034 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.943382 24034 tablet_bootstrap.cc:492] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.944084 24034 ts_tablet_manager.cc:1403] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.001s
I20260709 13:09:42.946610 24034 raft_consensus.cc:359] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.947288 24034 raft_consensus.cc:740] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.947940 24034 consensus_queue.cc:260] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:42.953142 24034 ts_tablet_manager.cc:1434] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:42.954267 24034 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:42.969290 24165 raft_consensus.cc:3060] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.973946 24173 raft_consensus.cc:3060] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.978071 24034 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:42.979113 24034 tablet_bootstrap.cc:492] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:42.979754 24034 ts_tablet_manager.cc:1403] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:09:42.982470 24034 raft_consensus.cc:359] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.983165 24034 raft_consensus.cc:740] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.983894 24034 consensus_queue.cc:260] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:42.986364 24034 ts_tablet_manager.cc:1434] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:42.987197 24034 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
W20260709 13:09:43.047104 23313 consensus_peers.cc:597] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:43.048799 23239 consensus_peers.cc:597] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:43.055423 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 54115.6us
I20260709 13:09:43.087414 24034 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.088485 24034 tablet_bootstrap.cc:492] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.089161 24034 ts_tablet_manager.cc:1403] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.064s
I20260709 13:09:43.091775 24034 raft_consensus.cc:359] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:43.092506 24034 raft_consensus.cc:740] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.093210 24034 consensus_queue.cc:260] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:43.095775 24034 ts_tablet_manager.cc:1434] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:43.096581 24034 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:43.118623 24034 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.119573 24034 tablet_bootstrap.cc:492] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.120256 24034 ts_tablet_manager.cc:1403] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.006s
I20260709 13:09:43.157788 24034 raft_consensus.cc:359] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.158499 24034 raft_consensus.cc:740] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.159170 24034 consensus_queue.cc:260] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.170183 24034 ts_tablet_manager.cc:1434] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:09:43.171029 24034 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:43.172683 24173 raft_consensus.cc:3060] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.203912 24034 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.204948 24034 tablet_bootstrap.cc:492] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.205622 24034 ts_tablet_manager.cc:1403] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.004s
I20260709 13:09:43.208441 24034 raft_consensus.cc:359] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.209131 24034 raft_consensus.cc:740] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.209844 24034 consensus_queue.cc:260] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.212496 24034 ts_tablet_manager.cc:1434] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:43.213316 24034 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:43.222642 24165 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:43.249171 24034 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.250154 24034 tablet_bootstrap.cc:492] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.250785 24034 ts_tablet_manager.cc:1403] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:09:43.255141 24034 raft_consensus.cc:359] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:43.255787 24034 raft_consensus.cc:740] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.256512 24034 consensus_queue.cc:260] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:43.258662 24034 ts_tablet_manager.cc:1434] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:43.259409 24034 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:43.282145 24034 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.283048 24034 tablet_bootstrap.cc:492] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.283735 24034 ts_tablet_manager.cc:1403] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 13:09:43.286098 24034 raft_consensus.cc:359] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:43.286721 24034 raft_consensus.cc:740] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.287493 24034 consensus_queue.cc:260] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:43.289692 24034 ts_tablet_manager.cc:1434] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:43.290405 24034 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap starting.
I20260709 13:09:43.310528 24034 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:43.311436 24034 tablet_bootstrap.cc:492] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Bootstrap complete.
I20260709 13:09:43.312070 24034 ts_tablet_manager.cc:1403] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:09:43.314738 24034 raft_consensus.cc:359] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.316296 24034 raft_consensus.cc:740] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.317061 24034 consensus_queue.cc:260] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:43.319260 24034 ts_tablet_manager.cc:1434] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:43.330307 24165 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.407671 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.473647 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:51.474314 23268 raft_consensus.cc:606] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:51.476980 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:51.477466 23268 raft_consensus.cc:606] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d522b0c35d264310bd559b320098c16e
I20260709 13:09:51.479789 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:51.480157 23268 raft_consensus.cc:606] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d522b0c35d264310bd559b320098c16e
I20260709 13:09:51.508080 23344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb"
dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:09:51.508708 23344 raft_consensus.cc:606] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:51.511464 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:51.512001 23268 raft_consensus.cc:606] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:51.518623 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:51.519129 23268 raft_consensus.cc:606] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:51.520462 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:51.521994 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:51.576324 24305 raft_consensus.cc:993] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.577119 24310 raft_consensus.cc:1081] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.578702 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:51.579187 24173 raft_consensus.cc:493] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.579495 24173 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.585021 24173 raft_consensus.cc:515] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.586776 24173 leader_election.cc:290] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:51.587662 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:51.587845 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c89b42f5bd47bf9740e16cb5d82506" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:51.588382 23268 raft_consensus.cc:3055] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:51.588433 23344 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.588686 23268 raft_consensus.cc:740] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:51.589470 23268 consensus_queue.cc:260] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.590536 23268 raft_consensus.cc:3060] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:51.595043 23344 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:51.596568 24027 leader_election.cc:304] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:51.596998 23268 raft_consensus.cc:2468] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:51.598870 24315 raft_consensus.cc:2804] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:51.600188 24315 raft_consensus.cc:697] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:51.601256 24315 consensus_queue.cc:237] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.612767 23097 catalog_manager.cc:5697] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 3 to 4, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.658814 24310 raft_consensus.cc:993] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:51.659314 24305 raft_consensus.cc:1081] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:51.660887 23420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6"
dest_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:41300
I20260709 13:09:51.661451 23420 raft_consensus.cc:493] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.661746 23420 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.666905 23420 raft_consensus.cc:515] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.668697 23420 leader_election.cc:290] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:51.669519 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:51.670020 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d45b9dd9d38431e91f7b6fd724e5fc6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:51.670130 23268 raft_consensus.cc:3055] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.670682 23268 raft_consensus.cc:740] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:51.670696 23344 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.671502 23268 consensus_queue.cc:260] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.672744 23268 raft_consensus.cc:3060] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.677556 23344 raft_consensus.cc:2468] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:51.678939 23388 leader_election.cc:304] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:51.679616 23268 raft_consensus.cc:2468] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:51.679883 24311 raft_consensus.cc:2804] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.680395 24311 raft_consensus.cc:697] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:51.681350 24311 consensus_queue.cc:237] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.693215 23097 catalog_manager.cc:5697] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.753357 24305 raft_consensus.cc:993] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.753886 24310 raft_consensus.cc:1081] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.755775 24131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:51.756174 24131 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.756407 24131 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.761549 24131 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:51.763270 24131 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:51.765121 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:51.765744 23420 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.766407 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bbfc36a4fa54f75aadc294c28c47faa" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:51.767102 23268 raft_consensus.cc:3055] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.767429 23268 raft_consensus.cc:740] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:51.768230 23268 consensus_queue.cc:260] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:51.769258 23268 raft_consensus.cc:3060] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.771111 23420 raft_consensus.cc:2468] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:51.772420 24026 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:51.773147 24315 raft_consensus.cc:2804] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.773614 24315 raft_consensus.cc:697] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:51.774456 24315 consensus_queue.cc:237] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:51.775528 23268 raft_consensus.cc:2468] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:51.790884 23097 catalog_manager.cc:5697] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.850206 24305 raft_consensus.cc:993] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.851091 24310 raft_consensus.cc:1081] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:51.854000 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:51.854571 24173 raft_consensus.cc:493] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.854938 24173 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.861028 24173 raft_consensus.cc:515] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.863188 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:51.863312 24173 leader_election.cc:290] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:51.863587 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828fc0c2eb24ed09da6ab517095131d" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:51.863759 23268 raft_consensus.cc:3055] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.864238 23347 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.864238 23268 raft_consensus.cc:740] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:51.865300 23268 consensus_queue.cc:260] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.866202 23268 raft_consensus.cc:3060] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.871529 23347 raft_consensus.cc:2468] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:51.872574 24027 leader_election.cc:304] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:51.873445 24315 raft_consensus.cc:2804] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.874001 24315 raft_consensus.cc:697] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:51.874871 24315 consensus_queue.cc:237] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:51.873049 23268 raft_consensus.cc:2468] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:51.887779 23097 catalog_manager.cc:5697] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.901167 24305 raft_consensus.cc:993] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:51.901755 24325 raft_consensus.cc:1081] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:51.903344 23421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b"
dest_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:41300
I20260709 13:09:51.903832 23421 raft_consensus.cc:493] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.904124 23421 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.911113 23421 raft_consensus.cc:515] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.913352 23421 leader_election.cc:290] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:51.913631 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:51.913954 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf9524fb52314d9493c13161ef93ac3b" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:51.914443 23268 raft_consensus.cc:3055] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.914687 23347 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.914829 23268 raft_consensus.cc:740] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:51.915728 23268 consensus_queue.cc:260] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.916878 23268 raft_consensus.cc:3060] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.922915 23347 raft_consensus.cc:2468] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:51.925043 23388 leader_election.cc:304] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:51.925462 23268 raft_consensus.cc:2468] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:51.925995 24308 raft_consensus.cc:2804] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.926532 24308 raft_consensus.cc:697] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:51.927328 24308 consensus_queue.cc:237] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:51.946581 23097 catalog_manager.cc:5697] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.014866 23268 raft_consensus.cc:1275] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:52.016320 24315 consensus_queue.cc:1048] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.027213 24309 raft_consensus.cc:993] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.027725 24309 raft_consensus.cc:1081] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.029614 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38884
I20260709 13:09:52.030145 24173 raft_consensus.cc:493] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.030501 24173 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.039194 24173 raft_consensus.cc:515] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:52.041846 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:52.042369 24173 leader_election.cc:290] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:52.042912 23344 raft_consensus.cc:1275] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:52.056416 23347 raft_consensus.cc:3055] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.056998 23347 raft_consensus.cc:740] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:52.056660 24315 consensus_queue.cc:1048] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.059756 23347 consensus_queue.cc:260] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:52.043574 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eecef7df2e87484d8d5374f5664d3abb" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:52.060809 23420 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.061599 23347 raft_consensus.cc:3060] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.068754 23347 raft_consensus.cc:2468] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.069964 24027 leader_election.cc:304] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:52.071043 24315 raft_consensus.cc:2804] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.071718 24315 raft_consensus.cc:697] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:52.072641 24315 consensus_queue.cc:237] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:52.080272 23420 raft_consensus.cc:2468] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.086555 23098 catalog_manager.cc:5697] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.185072 23268 raft_consensus.cc:1275] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.186172 24311 consensus_queue.cc:1048] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.203469 23344 raft_consensus.cc:1275] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.205497 23420 raft_consensus.cc:1275] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.206300 24337 consensus_queue.cc:1048] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:52.207067 24315 consensus_queue.cc:1048] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.250375 23268 raft_consensus.cc:1275] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.254393 24315 consensus_queue.cc:1048] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.333113 23268 raft_consensus.cc:1275] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.334371 24311 consensus_queue.cc:1048] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.342784 23344 raft_consensus.cc:1275] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.345127 24337 consensus_queue.cc:1048] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.357088 23268 raft_consensus.cc:1275] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.358439 24316 consensus_queue.cc:1048] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.369541 23344 raft_consensus.cc:1275] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.370826 24315 consensus_queue.cc:1048] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.523097 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.573572 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.600868 23421 raft_consensus.cc:1275] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.602133 24315 consensus_queue.cc:1048] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.616139 23344 raft_consensus.cc:1275] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.617561 24316 consensus_queue.cc:1048] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.627300 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:52.627858 23268 raft_consensus.cc:606] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS 5d73d02a55244a079c8f7bd9b0d7dfd4
I20260709 13:09:52.632050 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:52.632711 23268 raft_consensus.cc:606] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.675578 23421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c"
dest_uuid: "d522b0c35d264310bd559b320098c16e"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:43566
I20260709 13:09:52.676255 23421 raft_consensus.cc:606] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.679049 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6705226baaba42b88325cfeaf478e871"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:52.679654 23268 raft_consensus.cc:606] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.682145 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:52.682598 23268 raft_consensus.cc:606] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.684723 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e10b23f9075c452180fc416e53df2554"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:52.685169 23268 raft_consensus.cc:606] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.687036 23344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f033a61414134e12ae93c9445436d714"
dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:09:52.687495 23344 raft_consensus.cc:606] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:52.688517 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:52.689898 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:52.775566 24305 raft_consensus.cc:993] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.776100 24305 raft_consensus.cc:1081] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.777762 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:52.778317 24173 raft_consensus.cc:493] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.778643 24173 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.785041 24173 raft_consensus.cc:515] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.786630 24173 leader_election.cc:290] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:52.787489 23416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:52.788110 23416 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.788213 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22bfe0a296bd470997118a3f31d9b0de" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:52.788956 23271 raft_consensus.cc:3055] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.789247 23271 raft_consensus.cc:740] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:52.789944 23271 consensus_queue.cc:260] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.790840 23271 raft_consensus.cc:3060] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.797854 23271 raft_consensus.cc:2468] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.800103 24026 leader_election.cc:304] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:52.800877 24316 raft_consensus.cc:2804] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.805022 24316 raft_consensus.cc:697] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:52.805959 24316 consensus_queue.cc:237] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.810290 24310 raft_consensus.cc:993] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.810910 23416 raft_consensus.cc:2468] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.811209 24310 raft_consensus.cc:1081] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.814839 24165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6705226baaba42b88325cfeaf478e871"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:52.815395 24165 raft_consensus.cc:493] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.815783 24165 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.819243 23097 catalog_manager.cc:5697] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.821624 24165 raft_consensus.cc:515] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.823679 24165 leader_election.cc:290] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:52.825152 23416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:52.825700 23416 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.834525 23416 raft_consensus.cc:2468] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.836225 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6705226baaba42b88325cfeaf478e871" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:52.836870 23268 raft_consensus.cc:3055] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.837177 23268 raft_consensus.cc:740] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:52.837414 24026 leader_election.cc:304] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:52.838217 24316 raft_consensus.cc:2804] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.837909 23268 consensus_queue.cc:260] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.845515 24305 raft_consensus.cc:993] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.849018 24305 raft_consensus.cc:1081] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:52.855131 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e10b23f9075c452180fc416e53df2554"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:52.855746 24173 raft_consensus.cc:493] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.856083 24173 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.862687 24173 raft_consensus.cc:515] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:52.845659 23268 raft_consensus.cc:3060] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.838762 24316 raft_consensus.cc:697] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:52.865365 24316 consensus_queue.cc:237] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:52.870239 24173 leader_election.cc:290] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:52.871416 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:52.872082 23347 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.872115 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e10b23f9075c452180fc416e53df2554" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:52.872795 23271 raft_consensus.cc:3055] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.873100 23271 raft_consensus.cc:740] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:52.873863 23271 consensus_queue.cc:260] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:52.875072 23271 raft_consensus.cc:3060] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.878039 23268 raft_consensus.cc:2468] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:52.882907 23347 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:52.882694 23271 raft_consensus.cc:2468] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:52.884613 24027 leader_election.cc:304] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:52.886205 24315 raft_consensus.cc:2804] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.886782 24315 raft_consensus.cc:697] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:52.887737 24315 consensus_queue.cc:237] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:52.899001 23097 catalog_manager.cc:5697] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.900761 23097 catalog_manager.cc:5697] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 2 to 3, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.915988 24305 raft_consensus.cc:993] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower 5d73d02a55244a079c8f7bd9b0d7dfd4 to start an election
I20260709 13:09:52.916584 24354 raft_consensus.cc:1081] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer 5d73d02a55244a079c8f7bd9b0d7dfd4 to start an election
I20260709 13:09:52.918190 23347 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0"
dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
 from {username='slave'} at 127.0.0.1:54152
I20260709 13:09:52.918797 23347 raft_consensus.cc:493] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.919255 23347 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.924512 23347 raft_consensus.cc:515] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:52.926339 23347 leader_election.cc:290] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:52.927091 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:52.927318 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e9b53c11e2a49719268dc7556e5e0c0" candidate_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:52.927744 23271 raft_consensus.cc:3055] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.927927 23421 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.928077 23271 raft_consensus.cc:740] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:52.928884 23271 consensus_queue.cc:260] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:52.929796 23271 raft_consensus.cc:3060] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.933735 23421 raft_consensus.cc:2468] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:52.934666 23271 raft_consensus.cc:2468] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d73d02a55244a079c8f7bd9b0d7dfd4 in term 2.
I20260709 13:09:52.935190 23313 leader_election.cc:304] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:52.936252 24329 raft_consensus.cc:2804] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.938186 24329 raft_consensus.cc:697] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Leader. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:52.939431 24329 consensus_queue.cc:237] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:52.958190 23097 catalog_manager.cc:5697] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.025820 24308 raft_consensus.cc:993] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.026546 24350 raft_consensus.cc:1081] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.028199 24131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38872
I20260709 13:09:53.028702 24131 raft_consensus.cc:493] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.029052 24131 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.035331 24131 raft_consensus.cc:515] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.037367 24131 leader_election.cc:290] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:53.038062 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:53.038247 23421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26551318e3d9433c84c94b167b4cfd8c" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:53.038793 23347 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.038810 23421 raft_consensus.cc:3055] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.039436 23421 raft_consensus.cc:740] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:53.041074 23421 consensus_queue.cc:260] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.042704 23421 raft_consensus.cc:3060] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.050076 23347 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:53.051047 23421 raft_consensus.cc:2468] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:53.051508 24027 leader_election.cc:304] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:53.052368 24315 raft_consensus.cc:2804] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.052888 24315 raft_consensus.cc:697] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:53.053836 24315 consensus_queue.cc:237] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.063076 23097 catalog_manager.cc:5697] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 2 to 3, leader changed from d522b0c35d264310bd559b320098c16e (127.14.246.68) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.100309 24305 raft_consensus.cc:993] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.100798 24354 raft_consensus.cc:1081] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.102321 24131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:53.102845 24131 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.103106 24131 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.107818 24131 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:53.109179 24131 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:53.109944 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:53.110164 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a69a923f9fc9441cb34ffc1d7f0c4104" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:53.110606 23420 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.110675 23271 raft_consensus.cc:3055] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.111091 23271 raft_consensus.cc:740] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:53.111929 23271 consensus_queue.cc:260] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:53.113233 23271 raft_consensus.cc:3060] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.117303 23420 raft_consensus.cc:2468] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:53.119700 23271 raft_consensus.cc:2468] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:53.120612 24026 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:53.121548 24316 raft_consensus.cc:2804] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.122027 24316 raft_consensus.cc:697] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:53.122901 24316 consensus_queue.cc:237] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:53.134559 23097 catalog_manager.cc:5697] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.171864 24360 raft_consensus.cc:993] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.172411 24360 raft_consensus.cc:1081] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.173910 24131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f033a61414134e12ae93c9445436d714"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38884
I20260709 13:09:53.174479 24131 raft_consensus.cc:493] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.174774 24131 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.179937 24131 raft_consensus.cc:515] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.181388 24131 leader_election.cc:290] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:53.182133 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:53.182281 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f033a61414134e12ae93c9445436d714" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:53.182971 23420 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.185065 23347 raft_consensus.cc:3055] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.185415 23347 raft_consensus.cc:740] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:53.186148 23347 consensus_queue.cc:260] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.187237 23347 raft_consensus.cc:3060] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.190956 23420 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:53.193028 23347 raft_consensus.cc:2468] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:53.194164 24027 leader_election.cc:304] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:53.194901 24316 raft_consensus.cc:2804] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.195384 24316 raft_consensus.cc:697] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:53.196266 24316 consensus_queue.cc:237] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.206225 23097 catalog_manager.cc:5697] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 2 to 3, leader changed from 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.320814 23268 raft_consensus.cc:1275] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.322101 24316 consensus_queue.cc:1048] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.332935 23347 raft_consensus.cc:1275] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.334692 24340 consensus_queue.cc:1048] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.338660 23271 raft_consensus.cc:1275] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.340276 23420 raft_consensus.cc:1275] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.342072 24340 consensus_queue.cc:1048] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.342600 23420 raft_consensus.cc:1275] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.347831 24340 consensus_queue.cc:1048] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.374601 24360 consensus_queue.cc:1048] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.389107 23271 raft_consensus.cc:1275] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.390539 24340 consensus_queue.cc:1048] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.399197 23271 raft_consensus.cc:1275] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer 5d73d02a55244a079c8f7bd9b0d7dfd4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.402879 24309 consensus_queue.cc:1048] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.433651 23420 raft_consensus.cc:1275] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.435316 24340 consensus_queue.cc:1048] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.596354 23347 raft_consensus.cc:1275] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.597553 24340 consensus_queue.cc:1048] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.608873 23420 raft_consensus.cc:1275] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.615444 24340 consensus_queue.cc:1048] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.626081 23344 raft_consensus.cc:1275] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.627784 24340 consensus_queue.cc:1048] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.638841 23416 raft_consensus.cc:1275] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.641583 24340 consensus_queue.cc:1048] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:53.643507 23416 raft_consensus.cc:1275] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.644630 24315 consensus_queue.cc:1048] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.665112 23268 raft_consensus.cc:1275] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:53.666402 24316 consensus_queue.cc:1048] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:53.690783 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.730502 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.765372 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:53.765869 23268 raft_consensus.cc:606] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:53.768373 23268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:53.768850 23268 raft_consensus.cc:606] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Received request to transfer leadership to TS d522b0c35d264310bd559b320098c16e
I20260709 13:09:53.771394 23271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3"
dest_uuid: "11d20799306e481286363a5ec8b35c0a"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:51118
I20260709 13:09:53.771907 23271 raft_consensus.cc:606] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:53.774420 23344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611"
dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:36674
I20260709 13:09:53.775090 23344 raft_consensus.cc:606] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:53.776356 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:53.778115 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:53.848542 24305 raft_consensus.cc:993] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:53.849012 24383 raft_consensus.cc:1081] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Signalling peer d522b0c35d264310bd559b320098c16e to start an election
I20260709 13:09:53.850307 23420 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6"
dest_uuid: "d522b0c35d264310bd559b320098c16e"
 from {username='slave'} at 127.0.0.1:41300
I20260709 13:09:53.850704 23420 raft_consensus.cc:493] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.850926 23420 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.854466 24354 raft_consensus.cc:993] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.855023 24305 raft_consensus.cc:1081] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.857429 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:53.857951 24173 raft_consensus.cc:493] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.858280 24173 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.858876 23420 raft_consensus.cc:515] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:53.860857 23420 leader_election.cc:290] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:53.861315 23271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:53.861912 23271 raft_consensus.cc:3055] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:53.861828 23347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f9f863d03148f0b2feb977248ef1f6" candidate_uuid: "d522b0c35d264310bd559b320098c16e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:53.862371 23271 raft_consensus.cc:740] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:53.862581 23347 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.863128 23271 consensus_queue.cc:260] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:53.864182 23271 raft_consensus.cc:3060] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.865535 24173 raft_consensus.cc:515] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:53.868513 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:53.869412 23344 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.871943 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911cc153131d47afb20dbc71912f94b3" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:53.872623 23268 raft_consensus.cc:3055] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.872969 23268 raft_consensus.cc:740] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:53.873795 23268 consensus_queue.cc:260] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:53.874336 23347 raft_consensus.cc:2468] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:53.874981 23268 raft_consensus.cc:3060] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.875330 23388 leader_election.cc:304] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:53.876168 24308 raft_consensus.cc:2804] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.876884 24308 raft_consensus.cc:697] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Becoming Leader. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:53.877701 24308 consensus_queue.cc:237] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } }
I20260709 13:09:53.878208 23271 raft_consensus.cc:2468] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d522b0c35d264310bd559b320098c16e in term 2.
I20260709 13:09:53.883519 23344 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:53.883518 23268 raft_consensus.cc:2468] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:53.884994 24027 leader_election.cc:304] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:53.885926 24315 raft_consensus.cc:2804] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:53.889231 24315 raft_consensus.cc:697] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:53.890187 24315 consensus_queue.cc:237] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } }
I20260709 13:09:53.894557 24173 leader_election.cc:290] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Requested vote from peers 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655), 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801)
I20260709 13:09:53.903699 23098 catalog_manager.cc:5697] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e reported cstate change: term changed from 1 to 2, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d522b0c35d264310bd559b320098c16e (127.14.246.68). New cstate: current_term: 2 leader_uuid: "d522b0c35d264310bd559b320098c16e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.907219 23099 catalog_manager.cc:5697] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 3 to 4, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.918336 24329 raft_consensus.cc:993] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.918922 24329 raft_consensus.cc:1081] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:53.920495 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38884
I20260709 13:09:53.921016 24173 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.921427 24173 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.926275 24173 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.927683 24173 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:53.928416 23344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:53.928618 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca6c6b855f0d46cba85977dc9d19f611" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:53.929034 23344 raft_consensus.cc:3055] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.929227 23420 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.929375 23344 raft_consensus.cc:740] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d73d02a55244a079c8f7bd9b0d7dfd4, State: Running, Role: LEADER
I20260709 13:09:53.930251 23344 consensus_queue.cc:260] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.931304 23344 raft_consensus.cc:3060] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.935155 23420 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:53.936338 24026 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:53.937202 24315 raft_consensus.cc:2804] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:53.937737 23344 raft_consensus.cc:2468] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 4.
I20260709 13:09:53.937693 24315 raft_consensus.cc:697] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:53.938862 24315 consensus_queue.cc:237] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:53.948819 23099 catalog_manager.cc:5697] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 3 to 4, leader changed from 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 4 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.179250 24354 raft_consensus.cc:993] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:54.179736 24354 raft_consensus.cc:1081] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:54.182722 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38856
I20260709 13:09:54.183159 24173 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:54.183460 24173 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:54.190377 24173 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:54.191829 24173 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Requested vote from peers d522b0c35d264310bd559b320098c16e (127.14.246.68:35951), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:54.192643 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:54.192827 23268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f465bb48c534740ae364e2ffd6d61b6" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d20799306e481286363a5ec8b35c0a"
I20260709 13:09:54.193311 23420 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:54.193560 23268 raft_consensus.cc:3055] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:54.193974 23268 raft_consensus.cc:740] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11d20799306e481286363a5ec8b35c0a, State: Running, Role: LEADER
I20260709 13:09:54.194736 23268 consensus_queue.cc:260] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:54.196069 23268 raft_consensus.cc:3060] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:54.198312 23420 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:54.200521 24026 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4e47dfe9e4043b28804f74ca6320c78, d522b0c35d264310bd559b320098c16e; no voters: 
I20260709 13:09:54.201279 24315 raft_consensus.cc:2804] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:54.201725 24315 raft_consensus.cc:697] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:54.202616 24315 consensus_queue.cc:237] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:54.203701 23268 raft_consensus.cc:2468] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 3.
I20260709 13:09:54.220731 23099 catalog_manager.cc:5697] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 2 to 3, leader changed from 11d20799306e481286363a5ec8b35c0a (127.14.246.66) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 3 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.341497 23347 raft_consensus.cc:1275] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:54.349205 23344 raft_consensus.cc:1275] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.351521 24311 consensus_queue.cc:1048] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:54.352029 24340 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.354158 23344 raft_consensus.cc:1275] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:54.378928 24340 consensus_queue.cc:1048] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:09:54.402439 23269 raft_consensus.cc:1275] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:54.410534 24340 consensus_queue.cc:1048] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.458858 23420 raft_consensus.cc:1275] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:54.495959 24315 consensus_queue.cc:1048] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:54.540426 23388 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 47135.2us
W20260709 13:09:54.584921 23387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:41655, user_credentials={real_user=slave}} blocked reactor thread for 48175.1us
I20260709 13:09:54.592778 23268 raft_consensus.cc:1275] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Refusing update from remote peer d522b0c35d264310bd559b320098c16e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:09:54.661722 23239 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43229, user_credentials={real_user=slave}} blocked reactor thread for 88518.6us
I20260709 13:09:54.680974 24350 consensus_queue.cc:1048] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:54.684651 24027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:39801, user_credentials={real_user=slave}} blocked reactor thread for 68554.9us
I20260709 13:09:54.733280 23420 raft_consensus.cc:1275] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.741707 23268 raft_consensus.cc:1275] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:54.745512 24414 consensus_queue.cc:1048] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.753988 24413 consensus_queue.cc:1048] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:54.779307 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.835073 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.870925 23420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33887f114a444f56904e9b07cebf538a"
dest_uuid: "d522b0c35d264310bd559b320098c16e"
mode: GRACEFUL
new_leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:43566
I20260709 13:09:54.871770 23420 raft_consensus.cc:606] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Received request to transfer leadership to TS d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:54.873229 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:54.874773 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:54.949301 24407 raft_consensus.cc:993] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: : Instructing follower d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:54.949935 24407 raft_consensus.cc:1081] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Signalling peer d4e47dfe9e4043b28804f74ca6320c78 to start an election
I20260709 13:09:54.951530 24171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33887f114a444f56904e9b07cebf538a"
dest_uuid: "d4e47dfe9e4043b28804f74ca6320c78"
 from {username='slave'} at 127.0.0.1:38872
I20260709 13:09:54.952075 24171 raft_consensus.cc:493] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:54.952417 24171 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.960131 24171 raft_consensus.cc:515] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:54.962589 24171 leader_election.cc:290] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Requested vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d522b0c35d264310bd559b320098c16e (127.14.246.68:35951)
I20260709 13:09:54.963337 23349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4"
I20260709 13:09:54.964089 23349 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.965157 23420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33887f114a444f56904e9b07cebf538a" candidate_uuid: "d4e47dfe9e4043b28804f74ca6320c78" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d522b0c35d264310bd559b320098c16e"
I20260709 13:09:54.965780 23420 raft_consensus.cc:3055] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.966432 23420 raft_consensus.cc:740] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d522b0c35d264310bd559b320098c16e, State: Running, Role: LEADER
I20260709 13:09:54.967321 23420 consensus_queue.cc:260] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:54.968634 23420 raft_consensus.cc:3060] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.970820 23349 raft_consensus.cc:2468] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:54.971931 24027 leader_election.cc:304] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78; no voters: 
I20260709 13:09:54.972574 24414 raft_consensus.cc:2804] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:54.973009 24414 raft_consensus.cc:697] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Becoming Leader. State: Replica: d4e47dfe9e4043b28804f74ca6320c78, State: Running, Role: LEADER
I20260709 13:09:54.974145 23420 raft_consensus.cc:2468] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4e47dfe9e4043b28804f74ca6320c78 in term 2.
I20260709 13:09:54.973837 24414 consensus_queue.cc:237] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:54.985304 23098 catalog_manager.cc:5697] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 reported cstate change: term changed from 1 to 2, leader changed from d522b0c35d264310bd559b320098c16e (127.14.246.68) to d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "d4e47dfe9e4043b28804f74ca6320c78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:55.397418 23342 raft_consensus.cc:1275] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:55.398870 24340 consensus_queue.cc:1048] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.409693 23421 raft_consensus.cc:1275] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Refusing update from remote peer d4e47dfe9e4043b28804f74ca6320c78: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:55.413950 24412 consensus_queue.cc:1048] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.875749 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:55.916244 15321 tablet_server.cc:179] TabletServer@127.14.246.65:43229 shutting down...
W20260709 13:09:55.918691 23239 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 286 similar messages]
W20260709 13:09:55.926798 23239 consensus_peers.cc:597] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.942778 23239 consensus_peers.cc:597] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.949956 23239 consensus_peers.cc:597] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.950604 23387 consensus_peers.cc:597] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.966019 23239 consensus_peers.cc:597] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.969414 23387 consensus_peers.cc:597] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.972329 23387 consensus_peers.cc:597] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.974911 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:55.975899 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.977116 15321 raft_consensus.cc:2243] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:55.978220 15321 raft_consensus.cc:2272] T eecef7df2e87484d8d5374f5664d3abb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.980871 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.981521 15321 raft_consensus.cc:2243] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.982008 15321 raft_consensus.cc:2272] T a87fc46139f2423a9c3eac9d3761edf0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.985337 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.986394 15321 raft_consensus.cc:2243] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:55.988405 15321 raft_consensus.cc:2272] T e10b23f9075c452180fc416e53df2554 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.991192 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.992172 15321 raft_consensus.cc:2243] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:55.993361 15321 raft_consensus.cc:2272] T 6705226baaba42b88325cfeaf478e871 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.995626 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.996511 15321 raft_consensus.cc:2243] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.997014 15321 raft_consensus.cc:2272] T 53b5776737c44f0399308aa71ba91184 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.999672 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.000192 15321 raft_consensus.cc:2243] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.000567 15321 raft_consensus.cc:2272] T e81908a1bb6847ce8ffb498f00f3d1cb P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.003185 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.004079 15321 raft_consensus.cc:2243] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.004658 15321 raft_consensus.cc:2272] T 166ec71f2f7b44dfab28c0b65463fee8 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.007711 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.008553 15321 raft_consensus.cc:2243] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.009140 15321 raft_consensus.cc:2272] T 4319f76bcdb44f55acf34e3e01b9358e P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.009438 23387 consensus_peers.cc:597] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.012076 15321 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:56.012876 23313 consensus_peers.cc:597] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.013319 15321 raft_consensus.cc:2243] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.014070 15321 raft_consensus.cc:2272] T 5f56852691524f04b8d536bd41ae154a P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.016819 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.017416 15321 raft_consensus.cc:2243] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.017870 15321 raft_consensus.cc:2272] T cb613826a4374135aa008dc054ae5daf P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.020040 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.020653 15321 raft_consensus.cc:2243] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.021128 15321 raft_consensus.cc:2272] T 75e295bcfea248c8a36d4b46b0c6f55a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.023161 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.023734 15321 raft_consensus.cc:2243] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.024735 15321 raft_consensus.cc:2272] T ca6c6b855f0d46cba85977dc9d19f611 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.027921 15321 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:56.028406 23239 consensus_peers.cc:597] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.028831 15321 raft_consensus.cc:2243] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.030102 15321 raft_consensus.cc:2272] T f0c89b42f5bd47bf9740e16cb5d82506 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.033099 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.034082 15321 raft_consensus.cc:2243] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.034710 15321 raft_consensus.cc:2272] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.038188 23387 consensus_peers.cc:597] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.038208 15321 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:56.038887 23387 consensus_peers.cc:597] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.039379 15321 raft_consensus.cc:2243] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.039949 15321 raft_consensus.cc:2272] T f83e8fdc5de04a6fb00f47aa53ebbed7 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.042701 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.043296 15321 raft_consensus.cc:2243] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.044028 15321 raft_consensus.cc:2272] T 33887f114a444f56904e9b07cebf538a P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.046893 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.047459 15321 raft_consensus.cc:2243] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.048082 15321 raft_consensus.cc:2272] T ea93c613531f490b982eb22566d2be59 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.050908 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.051532 15321 raft_consensus.cc:2243] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.051916 15321 raft_consensus.cc:2272] T 8bf352d9d7274a9fbbde27bf171e5a3e P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.054091 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.054700 15321 raft_consensus.cc:2243] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.055190 15321 raft_consensus.cc:2272] T 556266aaafcd47fbad094135c5d321d7 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.057591 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.058367 15321 raft_consensus.cc:2243] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.058874 15321 raft_consensus.cc:2272] T fd55e8ce6f934c09ba57053aa2ac4298 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.061489 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.061970 15321 raft_consensus.cc:2243] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.062368 15321 raft_consensus.cc:2272] T ec4c4636c76b439db1396da335593209 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.064713 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.065496 15321 raft_consensus.cc:2243] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.066633 15321 raft_consensus.cc:2272] T f033a61414134e12ae93c9445436d714 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.069213 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.069841 15321 raft_consensus.cc:2243] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.070309 15321 raft_consensus.cc:2272] T ea08dc522141433e9b0d27a794aacdb0 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.073132 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.073882 15321 raft_consensus.cc:2243] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.074863 15321 raft_consensus.cc:2272] T 1f465bb48c534740ae364e2ffd6d61b6 P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.077033 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.077582 15321 raft_consensus.cc:2243] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.078408 15321 raft_consensus.cc:2272] T 911cc153131d47afb20dbc71912f94b3 P d4e47dfe9e4043b28804f74ca6320c78 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.080458 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.081353 15321 raft_consensus.cc:2243] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.081902 15321 raft_consensus.cc:2272] T 58075f57a8b740fb8e4e030ce9f9fef3 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.085067 15321 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:56.085345 23387 consensus_peers.cc:597] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.085870 15321 raft_consensus.cc:2243] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.086462 15321 raft_consensus.cc:2272] T 2f632a33cc3f4e5cadaab0200db6a404 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.088497 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.089119 15321 raft_consensus.cc:2243] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.089536 15321 raft_consensus.cc:2272] T 4d07f94d31084ca4bec1714d2cd152fd P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.091610 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.092147 15321 raft_consensus.cc:2243] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.092551 15321 raft_consensus.cc:2272] T 6cca5c2967b64eccacaac1741e66ae52 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.095149 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.095937 15321 raft_consensus.cc:2243] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.096522 15321 raft_consensus.cc:2272] T 4ce5ec35ce0e459e94385c9b04253e33 P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.098060 23239 consensus_peers.cc:597] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.099148 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.099841 15321 raft_consensus.cc:2243] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.100539 15321 raft_consensus.cc:2272] T f828fc0c2eb24ed09da6ab517095131d P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.102892 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.103727 15321 raft_consensus.cc:2243] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.104307 15321 raft_consensus.cc:2272] T 8bd73e37c60d47939ed13f2464ce939c P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.106887 23239 consensus_peers.cc:597] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.107380 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.107964 15321 raft_consensus.cc:2243] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.108335 15321 raft_consensus.cc:2272] T e45fa2e0e25b4deba3ceadbb53abac4f P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.110556 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.111045 15321 raft_consensus.cc:2243] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.111773 15321 raft_consensus.cc:2272] T 26551318e3d9433c84c94b167b4cfd8c P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.114171 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.114753 15321 raft_consensus.cc:2243] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.115579 15321 raft_consensus.cc:2272] T 3bbfc36a4fa54f75aadc294c28c47faa P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.117890 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.118463 15321 raft_consensus.cc:2243] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.119329 15321 raft_consensus.cc:2272] T 22bfe0a296bd470997118a3f31d9b0de P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.122298 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.122956 15321 raft_consensus.cc:2243] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.123499 15321 raft_consensus.cc:2272] T daf723b2744f41baae3607813b1f7741 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.123721 23313 consensus_peers.cc:597] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.126556 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.127233 15321 raft_consensus.cc:2243] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.127733 15321 raft_consensus.cc:2272] T a038d7dba05a4ceab3770a6926c3b41f P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.130070 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.130587 15321 raft_consensus.cc:2243] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.131349 15321 raft_consensus.cc:2272] T a69a923f9fc9441cb34ffc1d7f0c4104 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.133379 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.133965 15321 raft_consensus.cc:2243] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.134371 15321 raft_consensus.cc:2272] T f6c678249de84b02a478517fcded93af P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.136931 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.137629 15321 raft_consensus.cc:2243] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.138130 15321 raft_consensus.cc:2272] T 3c011e03361b480dae81285f6f09ef6a P d4e47dfe9e4043b28804f74ca6320c78 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.140671 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.141230 15321 raft_consensus.cc:2243] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.141678 15321 raft_consensus.cc:2272] T c40f00e82080462d9460eb9c85f4992b P d4e47dfe9e4043b28804f74ca6320c78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.144565 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.145234 15321 raft_consensus.cc:2243] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.145771 15321 raft_consensus.cc:2272] T 5a786424dfd04ed5afafe8bec218aaa7 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.149879 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.150630 15321 raft_consensus.cc:2243] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:56.150812 23313 consensus_peers.cc:597] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.151224 15321 raft_consensus.cc:2272] T b896a6b74a8d4fc5bb8edddae5e03d75 P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.154717 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.155403 15321 raft_consensus.cc:2243] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.155990 15321 raft_consensus.cc:2272] T b87502ffc9004276b2e75e7916ee177f P d4e47dfe9e4043b28804f74ca6320c78 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.160807 23313 consensus_peers.cc:597] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.170106 23313 consensus_peers.cc:597] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.196532 23387 consensus_peers.cc:597] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.202402 23387 consensus_peers.cc:597] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.203430 23313 consensus_peers.cc:597] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.204150 23313 consensus_peers.cc:597] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.213899 23239 consensus_peers.cc:597] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.227707 23239 consensus_peers.cc:597] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.249838 15321 tablet_server.cc:196] TabletServer@127.14.246.65:43229 shutdown complete.
W20260709 13:09:56.284497 23239 consensus_peers.cc:597] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.304243 23239 consensus_peers.cc:597] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.313763 23313 consensus_peers.cc:597] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.342692 23239 consensus_peers.cc:597] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.345578 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
I20260709 13:09:56.413343 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.414467 15321 tablet_replica.cc:333] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.415556 15321 raft_consensus.cc:2243] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:56.415617 23239 consensus_peers.cc:597] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.416672 15321 raft_consensus.cc:2272] T b87502ffc9004276b2e75e7916ee177f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.419885 15321 tablet_replica.cc:333] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
W20260709 13:09:56.419812 23387 consensus_peers.cc:597] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.421114 15321 raft_consensus.cc:2243] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.421638 15321 raft_consensus.cc:2272] T 6705226baaba42b88325cfeaf478e871 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.424942 15321 tablet_replica.cc:333] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
W20260709 13:09:56.425019 23313 consensus_peers.cc:597] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.425892 15321 raft_consensus.cc:2243] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.426333 15321 raft_consensus.cc:2272] T bf9524fb52314d9493c13161ef93ac3b P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.427585 23313 consensus_peers.cc:597] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.430055 15321 tablet_replica.cc:333] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.431227 15321 raft_consensus.cc:2243] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.432893 15321 raft_consensus.cc:2272] T a87fc46139f2423a9c3eac9d3761edf0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.436189 15321 tablet_replica.cc:333] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
W20260709 13:09:56.436859 23313 consensus_peers.cc:597] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.437044 15321 raft_consensus.cc:2243] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.437644 15321 raft_consensus.cc:2272] T 5a786424dfd04ed5afafe8bec218aaa7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.439781 15321 tablet_replica.cc:333] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.440505 15321 raft_consensus.cc:2243] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.441087 15321 raft_consensus.cc:2272] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.443648 15321 tablet_replica.cc:333] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
W20260709 13:09:56.444131 23387 consensus_peers.cc:597] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.444217 15321 raft_consensus.cc:2243] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.444916 15321 raft_consensus.cc:2272] T 9a57fa440d304760aa2a0ed56ef83076 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.447589 15321 tablet_replica.cc:333] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.448441 15321 raft_consensus.cc:2243] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.449010 15321 raft_consensus.cc:2272] T a69a923f9fc9441cb34ffc1d7f0c4104 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.451606 15321 tablet_replica.cc:333] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.452486 15321 raft_consensus.cc:2243] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.453377 15321 raft_consensus.cc:2272] T 4319f76bcdb44f55acf34e3e01b9358e P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.455826 15321 tablet_replica.cc:333] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.456439 15321 raft_consensus.cc:2243] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.457419 15321 raft_consensus.cc:2272] T 4ce5ec35ce0e459e94385c9b04253e33 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.460021 15321 tablet_replica.cc:333] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.460879 15321 raft_consensus.cc:2243] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.461481 15321 raft_consensus.cc:2272] T e10b23f9075c452180fc416e53df2554 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.461714 23387 consensus_peers.cc:597] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.463812 15321 tablet_replica.cc:333] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
W20260709 13:09:56.464313 23387 consensus_peers.cc:597] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.464581 15321 raft_consensus.cc:2243] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.465220 15321 raft_consensus.cc:2272] T 8e889863be944540ae44f160918568a7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.467180 15321 tablet_replica.cc:333] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.467832 15321 raft_consensus.cc:2243] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.468268 15321 raft_consensus.cc:2272] T 00f9304058a34b12bfa74024fb2c7221 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.470957 15321 tablet_replica.cc:333] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.471774 15321 raft_consensus.cc:2243] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.472604 15321 raft_consensus.cc:2272] T 556266aaafcd47fbad094135c5d321d7 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.475267 15321 tablet_replica.cc:333] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.476064 15321 raft_consensus.cc:2243] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.476730 15321 raft_consensus.cc:2272] T 20f9f863d03148f0b2feb977248ef1f6 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.479566 15321 tablet_replica.cc:333] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.480226 15321 raft_consensus.cc:2243] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.481092 15321 raft_consensus.cc:2272] T 58075f57a8b740fb8e4e030ce9f9fef3 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.481518 23313 consensus_peers.cc:597] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Couldn't send request to peer d4e47dfe9e4043b28804f74ca6320c78. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.483186 15321 tablet_replica.cc:333] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.483829 15321 raft_consensus.cc:2243] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.484262 15321 raft_consensus.cc:2272] T 1e9b53c11e2a49719268dc7556e5e0c0 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.486263 15321 tablet_replica.cc:333] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.486814 15321 raft_consensus.cc:2243] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.487680 15321 raft_consensus.cc:2272] T c40f00e82080462d9460eb9c85f4992b P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.489646 15321 tablet_replica.cc:333] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.490229 15321 raft_consensus.cc:2243] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.491276 15321 raft_consensus.cc:2272] T 2f632a33cc3f4e5cadaab0200db6a404 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.493643 15321 tablet_replica.cc:333] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.494283 15321 raft_consensus.cc:2243] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.495322 15321 raft_consensus.cc:2272] T 2f84e27c47644330886c6361f8182419 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.498152 15321 tablet_replica.cc:333] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.498940 15321 raft_consensus.cc:2243] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.499958 15321 raft_consensus.cc:2272] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.502786 15321 tablet_replica.cc:333] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.503409 15321 raft_consensus.cc:2243] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.503994 15321 raft_consensus.cc:2272] T 3bbfc36a4fa54f75aadc294c28c47faa P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.506870 15321 tablet_replica.cc:333] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.507594 15321 raft_consensus.cc:2243] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.508168 15321 raft_consensus.cc:2272] T 22bfe0a296bd470997118a3f31d9b0de P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.510854 15321 tablet_replica.cc:333] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.511597 15321 raft_consensus.cc:2243] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:56.511803 23387 consensus_peers.cc:597] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.512120 15321 raft_consensus.cc:2272] T 5b06cf1e83964a088fa4cafd6bc76780 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.514770 15321 tablet_replica.cc:333] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.515555 15321 raft_consensus.cc:2243] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.516294 15321 raft_consensus.cc:2272] T 8bf352d9d7274a9fbbde27bf171e5a3e P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.518772 15321 tablet_replica.cc:333] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.519332 15321 raft_consensus.cc:2243] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.519728 15321 raft_consensus.cc:2272] T 8aef9e8c7d8e4e56965d01215b5f0768 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.521917 15321 tablet_replica.cc:333] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.522469 15321 raft_consensus.cc:2243] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.523226 15321 raft_consensus.cc:2272] T ea08dc522141433e9b0d27a794aacdb0 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.525494 15321 tablet_replica.cc:333] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.526177 15321 raft_consensus.cc:2243] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.526602 15321 raft_consensus.cc:2272] T f7455f72bcbd4d8cb403b4f335ff13ff P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.528693 15321 tablet_replica.cc:333] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.529287 15321 raft_consensus.cc:2243] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.529701 15321 raft_consensus.cc:2272] T f0c89b42f5bd47bf9740e16cb5d82506 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.531601 15321 tablet_replica.cc:333] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.532146 15321 raft_consensus.cc:2243] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.532935 15321 raft_consensus.cc:2272] T e45fa2e0e25b4deba3ceadbb53abac4f P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.534799 15321 tablet_replica.cc:333] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.535321 15321 raft_consensus.cc:2243] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.535746 15321 raft_consensus.cc:2272] T 5ccc079d27d04f62bf9dc344d9bdb606 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.538285 15321 tablet_replica.cc:333] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.538981 15321 raft_consensus.cc:2243] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.539508 15321 raft_consensus.cc:2272] T f828fc0c2eb24ed09da6ab517095131d P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.540302 23387 consensus_peers.cc:597] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.542279 15321 tablet_replica.cc:333] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.543046 15321 raft_consensus.cc:2243] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.543579 15321 raft_consensus.cc:2272] T 1f465bb48c534740ae364e2ffd6d61b6 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.545655 15321 tablet_replica.cc:333] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.546183 15321 raft_consensus.cc:2243] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.546684 15321 raft_consensus.cc:2272] T 911cc153131d47afb20dbc71912f94b3 P 11d20799306e481286363a5ec8b35c0a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.549015 15321 tablet_replica.cc:333] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.549559 15321 raft_consensus.cc:2243] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.550135 15321 raft_consensus.cc:2272] T 53b5776737c44f0399308aa71ba91184 P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.551294 23313 consensus_peers.cc:597] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.552547 15321 tablet_replica.cc:333] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.553252 15321 raft_consensus.cc:2243] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.553710 15321 raft_consensus.cc:2272] T 75e295bcfea248c8a36d4b46b0c6f55a P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.555641 15321 tablet_replica.cc:333] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.556203 15321 raft_consensus.cc:2243] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.556614 15321 raft_consensus.cc:2272] T edd2ca63fc294d39be8e4f0973531faa P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.558494 15321 tablet_replica.cc:333] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.558997 15321 raft_consensus.cc:2243] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.559439 15321 raft_consensus.cc:2272] T 6cca5c2967b64eccacaac1741e66ae52 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.561383 15321 tablet_replica.cc:333] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.561856 15321 raft_consensus.cc:2243] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.562309 15321 raft_consensus.cc:2272] T cb613826a4374135aa008dc054ae5daf P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.564107 15321 tablet_replica.cc:333] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.564584 15321 raft_consensus.cc:2243] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.565042 15321 raft_consensus.cc:2272] T 5f56852691524f04b8d536bd41ae154a P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.566916 15321 tablet_replica.cc:333] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.567421 15321 raft_consensus.cc:2243] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.567948 15321 raft_consensus.cc:2272] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.570125 15321 tablet_replica.cc:333] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.570773 15321 raft_consensus.cc:2243] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.571678 15321 raft_consensus.cc:2272] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 11d20799306e481286363a5ec8b35c0a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.574280 15321 tablet_replica.cc:333] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.574798 15321 raft_consensus.cc:2243] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.575305 15321 raft_consensus.cc:2272] T 3c011e03361b480dae81285f6f09ef6a P 11d20799306e481286363a5ec8b35c0a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.575906 23313 consensus_peers.cc:597] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.577790 15321 tablet_replica.cc:333] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a: stopping tablet replica
I20260709 13:09:56.578528 15321 raft_consensus.cc:2243] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.579485 15321 raft_consensus.cc:2272] T f6c678249de84b02a478517fcded93af P 11d20799306e481286363a5ec8b35c0a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.579926 23313 consensus_peers.cc:597] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.618912 23313 consensus_peers.cc:597] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.644686 23387 consensus_peers.cc:597] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.648449 23387 consensus_peers.cc:597] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.654055 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
W20260709 13:09:56.662328 23387 consensus_peers.cc:597] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.714850 23387 consensus_peers.cc:597] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.724402 23387 consensus_peers.cc:597] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.728192 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
W20260709 13:09:56.747243 23388 consensus_peers.cc:597] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.756986 23313 consensus_peers.cc:597] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 -> Peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Couldn't send request to peer 11d20799306e481286363a5ec8b35c0a. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.784003 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:56.784843 15321 tablet_replica.cc:333] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.785585 15321 raft_consensus.cc:2243] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.786487 15321 raft_consensus.cc:2272] T 166ec71f2f7b44dfab28c0b65463fee8 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.788620 15321 tablet_replica.cc:333] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.789497 15321 raft_consensus.cc:2243] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.790071 15321 raft_consensus.cc:2272] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.792733 23388 consensus_peers.cc:597] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.792867 15321 tablet_replica.cc:333] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.793723 15321 raft_consensus.cc:2243] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.794215 15321 raft_consensus.cc:2272] T b87502ffc9004276b2e75e7916ee177f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.796579 15321 tablet_replica.cc:333] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.797327 15321 raft_consensus.cc:2243] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.798347 15321 raft_consensus.cc:2272] T 5a786424dfd04ed5afafe8bec218aaa7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.800287 15321 tablet_replica.cc:333] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.800958 15321 raft_consensus.cc:2243] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.801718 15321 raft_consensus.cc:2272] T fd55e8ce6f934c09ba57053aa2ac4298 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.803680 15321 tablet_replica.cc:333] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.804253 15321 raft_consensus.cc:2243] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.804688 15321 raft_consensus.cc:2272] T ec4c4636c76b439db1396da335593209 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.806703 15321 tablet_replica.cc:333] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.807312 15321 raft_consensus.cc:2243] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.807762 15321 raft_consensus.cc:2272] T bf9524fb52314d9493c13161ef93ac3b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.810249 15321 tablet_replica.cc:333] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.811097 15321 raft_consensus.cc:2243] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.812052 15321 raft_consensus.cc:2272] T cb613826a4374135aa008dc054ae5daf P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.814371 15321 tablet_replica.cc:333] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.814944 15321 raft_consensus.cc:2243] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.815434 15321 raft_consensus.cc:2272] T 8e889863be944540ae44f160918568a7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.817632 15321 tablet_replica.cc:333] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.818200 15321 raft_consensus.cc:2243] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.818610 15321 raft_consensus.cc:2272] T f0c89b42f5bd47bf9740e16cb5d82506 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.820474 15321 tablet_replica.cc:333] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.821076 15321 raft_consensus.cc:2243] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.821583 15321 raft_consensus.cc:2272] T e10b23f9075c452180fc416e53df2554 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.823544 15321 tablet_replica.cc:333] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.824098 15321 raft_consensus.cc:2243] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.824538 15321 raft_consensus.cc:2272] T 4319f76bcdb44f55acf34e3e01b9358e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.826421 15321 tablet_replica.cc:333] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.826964 15321 raft_consensus.cc:2243] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.827726 15321 raft_consensus.cc:2272] T 9a57fa440d304760aa2a0ed56ef83076 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.829622 15321 tablet_replica.cc:333] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.830341 15321 raft_consensus.cc:2243] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.830847 15321 raft_consensus.cc:2272] T eecef7df2e87484d8d5374f5664d3abb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.833504 15321 tablet_replica.cc:333] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.834193 15321 raft_consensus.cc:2243] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.835012 15321 raft_consensus.cc:2272] T 1e9b53c11e2a49719268dc7556e5e0c0 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.836987 15321 tablet_replica.cc:333] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.837561 15321 raft_consensus.cc:2243] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.837986 15321 raft_consensus.cc:2272] T c40f00e82080462d9460eb9c85f4992b P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.839843 15321 tablet_replica.cc:333] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.840379 15321 raft_consensus.cc:2243] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.841251 15321 raft_consensus.cc:2272] T daf723b2744f41baae3607813b1f7741 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.843382 15321 tablet_replica.cc:333] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.844123 15321 raft_consensus.cc:2243] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.845162 15321 raft_consensus.cc:2272] T a038d7dba05a4ceab3770a6926c3b41f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.848212 15321 tablet_replica.cc:333] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.849067 15321 raft_consensus.cc:2243] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.849650 15321 raft_consensus.cc:2272] T 20f9f863d03148f0b2feb977248ef1f6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.849886 23388 consensus_peers.cc:597] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.852232 15321 tablet_replica.cc:333] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.853113 15321 raft_consensus.cc:2243] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.853674 15321 raft_consensus.cc:2272] T 58075f57a8b740fb8e4e030ce9f9fef3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.856182 15321 tablet_replica.cc:333] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.856730 15321 raft_consensus.cc:2243] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.857556 15321 raft_consensus.cc:2272] T 00f9304058a34b12bfa74024fb2c7221 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.859988 15321 tablet_replica.cc:333] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.860556 15321 raft_consensus.cc:2243] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.861089 15321 raft_consensus.cc:2272] T 2f84e27c47644330886c6361f8182419 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.861927 23388 consensus_peers.cc:597] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.863348 15321 tablet_replica.cc:333] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.864002 15321 raft_consensus.cc:2243] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.864440 15321 raft_consensus.cc:2272] T 7d8397ef767c4037a55c7fa9e4be6ff6 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.866974 15321 tablet_replica.cc:333] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.867753 15321 raft_consensus.cc:2243] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.868731 15321 raft_consensus.cc:2272] T 5b06cf1e83964a088fa4cafd6bc76780 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.871013 15321 tablet_replica.cc:333] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.871663 15321 raft_consensus.cc:2243] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.872102 15321 raft_consensus.cc:2272] T 8bf352d9d7274a9fbbde27bf171e5a3e P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.874130 15321 tablet_replica.cc:333] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.874930 15321 raft_consensus.cc:2243] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.875746 15321 raft_consensus.cc:2272] T e81908a1bb6847ce8ffb498f00f3d1cb P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.877910 15321 tablet_replica.cc:333] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.878664 15321 raft_consensus.cc:2243] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.879169 15321 raft_consensus.cc:2272] T e45fa2e0e25b4deba3ceadbb53abac4f P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.880365 23388 consensus_peers.cc:597] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.881458 15321 tablet_replica.cc:333] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.882091 15321 raft_consensus.cc:2243] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.882519 15321 raft_consensus.cc:2272] T 8bd73e37c60d47939ed13f2464ce939c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.884980 15321 tablet_replica.cc:333] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.885740 15321 raft_consensus.cc:2243] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.886240 15321 raft_consensus.cc:2272] T 26551318e3d9433c84c94b167b4cfd8c P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.888482 15321 tablet_replica.cc:333] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.889070 15321 raft_consensus.cc:2243] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.889490 15321 raft_consensus.cc:2272] T 5ccc079d27d04f62bf9dc344d9bdb606 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.891391 15321 tablet_replica.cc:333] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.891919 15321 raft_consensus.cc:2243] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.892339 15321 raft_consensus.cc:2272] T f828fc0c2eb24ed09da6ab517095131d P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.894258 15321 tablet_replica.cc:333] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.894778 15321 raft_consensus.cc:2243] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.895519 15321 raft_consensus.cc:2272] T f7455f72bcbd4d8cb403b4f335ff13ff P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.897905 15321 tablet_replica.cc:333] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.898440 15321 raft_consensus.cc:2243] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.898852 15321 raft_consensus.cc:2272] T f033a61414134e12ae93c9445436d714 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.901239 15321 tablet_replica.cc:333] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.901789 15321 raft_consensus.cc:2243] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.902558 15321 raft_consensus.cc:2272] T 8aef9e8c7d8e4e56965d01215b5f0768 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.904577 15321 tablet_replica.cc:333] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.905123 15321 raft_consensus.cc:2243] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.905553 15321 raft_consensus.cc:2272] T f6c678249de84b02a478517fcded93af P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.907523 15321 tablet_replica.cc:333] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.908027 15321 raft_consensus.cc:2243] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.908898 15321 raft_consensus.cc:2272] T 4d07f94d31084ca4bec1714d2cd152fd P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.910961 15321 tablet_replica.cc:333] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.911509 15321 raft_consensus.cc:2243] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.911928 15321 raft_consensus.cc:2272] T edd2ca63fc294d39be8e4f0973531faa P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.913856 15321 tablet_replica.cc:333] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.914403 15321 raft_consensus.cc:2243] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.914822 15321 raft_consensus.cc:2272] T f83e8fdc5de04a6fb00f47aa53ebbed7 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.916994 15321 tablet_replica.cc:333] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.917515 15321 raft_consensus.cc:2243] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.917948 15321 raft_consensus.cc:2272] T ea93c613531f490b982eb22566d2be59 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.919785 15321 tablet_replica.cc:333] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.920287 15321 raft_consensus.cc:2243] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.920706 15321 raft_consensus.cc:2272] T 33887f114a444f56904e9b07cebf538a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.922725 15321 tablet_replica.cc:333] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.923246 15321 raft_consensus.cc:2243] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.923640 15321 raft_consensus.cc:2272] T b896a6b74a8d4fc5bb8edddae5e03d75 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.925491 15321 tablet_replica.cc:333] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.925971 15321 raft_consensus.cc:2243] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.926430 15321 raft_consensus.cc:2272] T 911cc153131d47afb20dbc71912f94b3 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.928702 15321 tablet_replica.cc:333] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.929344 15321 raft_consensus.cc:2243] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.929831 15321 raft_consensus.cc:2272] T ca6c6b855f0d46cba85977dc9d19f611 P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.931093 23388 consensus_peers.cc:597] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.932157 15321 tablet_replica.cc:333] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4: stopping tablet replica
I20260709 13:09:56.932639 15321 raft_consensus.cc:2243] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:56.933348 15321 raft_consensus.cc:2272] T 75e295bcfea248c8a36d4b46b0c6f55a P 5d73d02a55244a079c8f7bd9b0d7dfd4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.993325 23388 consensus_peers.cc:597] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.011909 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
W20260709 13:09:57.021727 23388 consensus_peers.cc:597] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.67:39801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.032498 24431 raft_consensus.cc:493] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:57.035063 24415 raft_consensus.cc:493] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:57.035873 24415 raft_consensus.cc:515] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:57.038561 24415 leader_election.cc:290] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:57.039930 24431 raft_consensus.cc:515] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d73d02a55244a079c8f7bd9b0d7dfd4" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 39801 } } peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } }
I20260709 13:09:57.044792 24431 leader_election.cc:290] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801), d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229)
W20260709 13:09:57.047698 23388 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Network error: Client connection negotiation failed: client connection to 127.14.246.67:39801: connect: Connection refused (error 111)
W20260709 13:09:57.052409 23388 consensus_peers.cc:597] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.67:39801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:57.055918 23387 leader_election.cc:336] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
W20260709 13:09:57.058815 23387 leader_election.cc:336] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111)
I20260709 13:09:57.059276 23387 leader_election.cc:304] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:57.060179 24441 raft_consensus.cc:2749] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:57.060555 23387 leader_election.cc:336] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:57.061101 23387 leader_election.cc:304] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 5d73d02a55244a079c8f7bd9b0d7dfd4, d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:57.061677 23388 consensus_peers.cc:597] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e -> Peer 5d73d02a55244a079c8f7bd9b0d7dfd4 (127.14.246.67:39801): Couldn't send request to peer 5d73d02a55244a079c8f7bd9b0d7dfd4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.67:39801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.061841 24441 raft_consensus.cc:2749] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:09:57.094694 24416 raft_consensus.cc:493] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:57.095263 24416 raft_consensus.cc:515] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:57.098975 24416 leader_election.cc:290] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
W20260709 13:09:57.103785 23387 leader_election.cc:336] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111)
W20260709 13:09:57.105114 23387 leader_election.cc:336] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:57.105566 23387 leader_election.cc:304] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:57.106345 24431 raft_consensus.cc:2749] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:57.108963 15321 tablet_server.cc:179] TabletServer@127.14.246.68:0 shutting down...
I20260709 13:09:57.155417 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:57.156407 15321 tablet_replica.cc:333] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.157658 15321 raft_consensus.cc:2243] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.158324 15321 raft_consensus.cc:2272] T 166ec71f2f7b44dfab28c0b65463fee8 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.160924 15321 tablet_replica.cc:333] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.161671 15321 raft_consensus.cc:2243] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.162250 15321 raft_consensus.cc:2272] T 6705226baaba42b88325cfeaf478e871 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.164970 15321 tablet_replica.cc:333] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.165540 15321 raft_consensus.cc:2243] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.165916 15321 raft_consensus.cc:2272] T a87fc46139f2423a9c3eac9d3761edf0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.168008 15321 tablet_replica.cc:333] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.168543 15321 raft_consensus.cc:2243] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.169356 15321 raft_consensus.cc:2272] T ec4c4636c76b439db1396da335593209 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.171411 15321 tablet_replica.cc:333] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.171929 15321 raft_consensus.cc:2243] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.172317 15321 raft_consensus.cc:2272] T fd55e8ce6f934c09ba57053aa2ac4298 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.174371 15321 tablet_replica.cc:333] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.174911 15321 raft_consensus.cc:2243] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.175644 15321 raft_consensus.cc:2272] T 7d45b9dd9d38431e91f7b6fd724e5fc6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.177676 15321 tablet_replica.cc:333] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.178200 15321 raft_consensus.cc:2243] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.178932 15321 raft_consensus.cc:2272] T bf9524fb52314d9493c13161ef93ac3b P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.181071 15321 tablet_replica.cc:333] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.181640 15321 raft_consensus.cc:2243] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.182010 15321 raft_consensus.cc:2272] T 1e9b53c11e2a49719268dc7556e5e0c0 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.183936 15321 tablet_replica.cc:333] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.184454 15321 raft_consensus.cc:2243] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.184947 15321 raft_consensus.cc:2272] T 9a57fa440d304760aa2a0ed56ef83076 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.186839 15321 tablet_replica.cc:333] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.187366 15321 raft_consensus.cc:2243] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.187750 15321 raft_consensus.cc:2272] T ca6c6b855f0d46cba85977dc9d19f611 P d522b0c35d264310bd559b320098c16e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.189102 24431 raft_consensus.cc:493] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:57.189527 24431 raft_consensus.cc:515] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:57.189807 15321 tablet_replica.cc:333] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.190555 15321 raft_consensus.cc:2243] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.191247 24431 leader_election.cc:290] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:57.191509 15321 raft_consensus.cc:2272] T 3e8ce9b3559b43c4b1aeab0a4dd28f75 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.194882 15321 tablet_replica.cc:333] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
W20260709 13:09:57.195621 23387 leader_election.cc:336] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:57.195828 15321 raft_consensus.cc:2243] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.196389 15321 raft_consensus.cc:2272] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:57.196419 23387 leader_election.cc:336] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111)
I20260709 13:09:57.197147 23387 leader_election.cc:304] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
W20260709 13:09:57.197791 23387 raft_consensus.cc:2686] T a69a923f9fc9441cb34ffc1d7f0c4104 P d522b0c35d264310bd559b320098c16e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:57.199357 15321 tablet_replica.cc:333] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.199994 15321 raft_consensus.cc:2243] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.200739 15321 raft_consensus.cc:2272] T 8e889863be944540ae44f160918568a7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.202430 24431 raft_consensus.cc:493] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d4e47dfe9e4043b28804f74ca6320c78)
I20260709 13:09:57.203111 15321 tablet_replica.cc:333] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.203045 24431 raft_consensus.cc:515] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d522b0c35d264310bd559b320098c16e" member_type: VOTER last_known_addr { host: "127.14.246.68" port: 35951 } } peers { permanent_uuid: "d4e47dfe9e4043b28804f74ca6320c78" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43229 } } peers { permanent_uuid: "11d20799306e481286363a5ec8b35c0a" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 41655 } }
I20260709 13:09:57.204137 15321 raft_consensus.cc:2243] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.204705 15321 raft_consensus.cc:2272] T 5b06cf1e83964a088fa4cafd6bc76780 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.205502 24431 leader_election.cc:290] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229), 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655)
I20260709 13:09:57.207636 15321 tablet_replica.cc:333] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.208530 15321 raft_consensus.cc:2243] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:57.208889 23387 leader_election.cc:336] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d4e47dfe9e4043b28804f74ca6320c78 (127.14.246.65:43229): Network error: Client connection negotiation failed: client connection to 127.14.246.65:43229: connect: Connection refused (error 111)
I20260709 13:09:57.209246 15321 raft_consensus.cc:2272] T eecef7df2e87484d8d5374f5664d3abb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:57.211022 23387 leader_election.cc:336] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 11d20799306e481286363a5ec8b35c0a (127.14.246.66:41655): Network error: Client connection negotiation failed: client connection to 127.14.246.66:41655: connect: Connection refused (error 111)
I20260709 13:09:57.211477 23387 leader_election.cc:304] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d522b0c35d264310bd559b320098c16e; no voters: 11d20799306e481286363a5ec8b35c0a, d4e47dfe9e4043b28804f74ca6320c78
I20260709 13:09:57.212100 15321 tablet_replica.cc:333] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.212152 24431 raft_consensus.cc:2749] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:57.213165 15321 raft_consensus.cc:2243] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.213650 15321 raft_consensus.cc:2272] T 2f632a33cc3f4e5cadaab0200db6a404 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.215677 15321 tablet_replica.cc:333] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.216296 15321 raft_consensus.cc:2243] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.216863 15321 raft_consensus.cc:2272] T 2f84e27c47644330886c6361f8182419 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.218854 15321 tablet_replica.cc:333] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.219440 15321 raft_consensus.cc:2243] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.219908 15321 raft_consensus.cc:2272] T 7d8397ef767c4037a55c7fa9e4be6ff6 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.222046 15321 tablet_replica.cc:333] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.222715 15321 raft_consensus.cc:2243] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.223188 15321 raft_consensus.cc:2272] T 556266aaafcd47fbad094135c5d321d7 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.225132 15321 tablet_replica.cc:333] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.225713 15321 raft_consensus.cc:2243] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.226172 15321 raft_consensus.cc:2272] T daf723b2744f41baae3607813b1f7741 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.228436 15321 tablet_replica.cc:333] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.229075 15321 raft_consensus.cc:2243] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.229527 15321 raft_consensus.cc:2272] T a038d7dba05a4ceab3770a6926c3b41f P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.231554 15321 tablet_replica.cc:333] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.232138 15321 raft_consensus.cc:2243] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.232579 15321 raft_consensus.cc:2272] T 00f9304058a34b12bfa74024fb2c7221 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.234670 15321 tablet_replica.cc:333] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.235273 15321 raft_consensus.cc:2243] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.235769 15321 raft_consensus.cc:2272] T e81908a1bb6847ce8ffb498f00f3d1cb P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.237883 15321 tablet_replica.cc:333] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.238449 15321 raft_consensus.cc:2243] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.238909 15321 raft_consensus.cc:2272] T 4d07f94d31084ca4bec1714d2cd152fd P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.241144 15321 tablet_replica.cc:333] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.241714 15321 raft_consensus.cc:2243] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.242515 15321 raft_consensus.cc:2272] T 6cca5c2967b64eccacaac1741e66ae52 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.245127 15321 tablet_replica.cc:333] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.245980 15321 raft_consensus.cc:2243] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.247006 15321 raft_consensus.cc:2272] T edd2ca63fc294d39be8e4f0973531faa P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.249171 15321 tablet_replica.cc:333] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.249680 15321 raft_consensus.cc:2243] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.250103 15321 raft_consensus.cc:2272] T 4ce5ec35ce0e459e94385c9b04253e33 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.251995 15321 tablet_replica.cc:333] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.252641 15321 raft_consensus.cc:2243] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.253115 15321 raft_consensus.cc:2272] T 3bbfc36a4fa54f75aadc294c28c47faa P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.255450 15321 tablet_replica.cc:333] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.256014 15321 raft_consensus.cc:2243] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.256420 15321 raft_consensus.cc:2272] T 22bfe0a296bd470997118a3f31d9b0de P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.258751 15321 tablet_replica.cc:333] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.259271 15321 raft_consensus.cc:2243] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.259989 15321 raft_consensus.cc:2272] T ea93c613531f490b982eb22566d2be59 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.262015 15321 tablet_replica.cc:333] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.262506 15321 raft_consensus.cc:2243] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.262936 15321 raft_consensus.cc:2272] T 33887f114a444f56904e9b07cebf538a P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.264956 15321 tablet_replica.cc:333] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.265470 15321 raft_consensus.cc:2243] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.266212 15321 raft_consensus.cc:2272] T 8bd73e37c60d47939ed13f2464ce939c P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.268093 15321 tablet_replica.cc:333] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.268602 15321 raft_consensus.cc:2243] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.269083 15321 raft_consensus.cc:2272] T 26551318e3d9433c84c94b167b4cfd8c P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.271139 15321 tablet_replica.cc:333] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.271636 15321 raft_consensus.cc:2243] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.272363 15321 raft_consensus.cc:2272] T 5ccc079d27d04f62bf9dc344d9bdb606 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.274292 15321 tablet_replica.cc:333] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.274776 15321 raft_consensus.cc:2243] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.275470 15321 raft_consensus.cc:2272] T b896a6b74a8d4fc5bb8edddae5e03d75 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.277683 15321 tablet_replica.cc:333] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.278175 15321 raft_consensus.cc:2243] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.278889 15321 raft_consensus.cc:2272] T 3c011e03361b480dae81285f6f09ef6a P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.280889 15321 tablet_replica.cc:333] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.281457 15321 raft_consensus.cc:2243] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.281852 15321 raft_consensus.cc:2272] T 1f465bb48c534740ae364e2ffd6d61b6 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.283775 15321 tablet_replica.cc:333] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.284242 15321 raft_consensus.cc:2243] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.284627 15321 raft_consensus.cc:2272] T f7455f72bcbd4d8cb403b4f335ff13ff P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.286504 15321 tablet_replica.cc:333] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.286973 15321 raft_consensus.cc:2243] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.287329 15321 raft_consensus.cc:2272] T f033a61414134e12ae93c9445436d714 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.289222 15321 tablet_replica.cc:333] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.289804 15321 raft_consensus.cc:2243] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.290186 15321 raft_consensus.cc:2272] T ea08dc522141433e9b0d27a794aacdb0 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.292039 15321 tablet_replica.cc:333] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.292495 15321 raft_consensus.cc:2243] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.292927 15321 raft_consensus.cc:2272] T 8aef9e8c7d8e4e56965d01215b5f0768 P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.294786 15321 tablet_replica.cc:333] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.295246 15321 raft_consensus.cc:2243] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.295965 15321 raft_consensus.cc:2272] T 20f9f863d03148f0b2feb977248ef1f6 P d522b0c35d264310bd559b320098c16e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.297950 15321 tablet_replica.cc:333] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.298379 15321 raft_consensus.cc:2243] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.299070 15321 raft_consensus.cc:2272] T 5f56852691524f04b8d536bd41ae154a P d522b0c35d264310bd559b320098c16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.301066 15321 tablet_replica.cc:333] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e: stopping tablet replica
I20260709 13:09:57.301494 15321 raft_consensus.cc:2243] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.302208 15321 raft_consensus.cc:2272] T 53b5776737c44f0399308aa71ba91184 P d522b0c35d264310bd559b320098c16e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.372304 15321 tablet_server.cc:196] TabletServer@127.14.246.68:0 shutdown complete.
I20260709 13:09:57.433561 15321 master.cc:562] Master@127.14.246.126:38585 shutting down...
I20260709 13:09:57.468340 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.468933 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.469236 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P e871ff198e1c459ba6940bae570a0172: stopping tablet replica
I20260709 13:09:57.518826 15321 master.cc:584] Master@127.14.246.126:38585 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33466 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:57.605055 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:46253
I20260709 13:09:57.606137 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.611239 24442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.611301 24443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.612733 24445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.613509 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:57.614653 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.614838 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.614951 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602597614941 us; error 0 us; skew 500 ppm
I20260709 13:09:57.615406 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.617951 15321 webserver.cc:533] Webserver started at http://127.14.246.126:40849/ using document root <none> and password file <none>
I20260709 13:09:57.618376 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.618521 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.618732 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.619763 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "174accde91a14eac8a1cf0ced9d433a4"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.624025 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:57.627317 24450 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.628037 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:57.628295 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "174accde91a14eac8a1cf0ced9d433a4"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.628527 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.650832 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.652019 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.688990 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:46253
I20260709 13:09:57.689121 24501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:46253 every 8 connection(s)
I20260709 13:09:57.692840 24502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.703019 24502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4: Bootstrap starting.
I20260709 13:09:57.708452 24502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.713042 24502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4: No bootstrap required, opened a new log
I20260709 13:09:57.715346 24502 raft_consensus.cc:359] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER }
I20260709 13:09:57.715757 24502 raft_consensus.cc:385] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.715956 24502 raft_consensus.cc:740] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 174accde91a14eac8a1cf0ced9d433a4, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.716493 24502 consensus_queue.cc:260] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER }
I20260709 13:09:57.716969 24502 raft_consensus.cc:399] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:57.717186 24502 raft_consensus.cc:493] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:57.717418 24502 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.722142 24502 raft_consensus.cc:515] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER }
I20260709 13:09:57.722636 24502 leader_election.cc:304] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 174accde91a14eac8a1cf0ced9d433a4; no voters: 
I20260709 13:09:57.723874 24502 leader_election.cc:290] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:57.724296 24505 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.725728 24505 raft_consensus.cc:697] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 1 LEADER]: Becoming Leader. State: Replica: 174accde91a14eac8a1cf0ced9d433a4, State: Running, Role: LEADER
I20260709 13:09:57.726418 24505 consensus_queue.cc:237] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER }
I20260709 13:09:57.727133 24502 sys_catalog.cc:565] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:57.730618 24506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "174accde91a14eac8a1cf0ced9d433a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER } }
I20260709 13:09:57.731401 24506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:57.731079 24507 sys_catalog.cc:455] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 174accde91a14eac8a1cf0ced9d433a4. Latest consensus state: current_term: 1 leader_uuid: "174accde91a14eac8a1cf0ced9d433a4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "174accde91a14eac8a1cf0ced9d433a4" member_type: VOTER } }
I20260709 13:09:57.732121 24507 sys_catalog.cc:458] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:57.735217 24511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:57.741613 24511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:57.743492 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:57.750207 24511 catalog_manager.cc:1383] Generated new cluster ID: b5d849745be141838b5924e6c0feac16
I20260709 13:09:57.750500 24511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:57.792594 24511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:57.793887 24511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:57.805860 24511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4: Generated new TSK 0
I20260709 13:09:57.806468 24511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:57.874038 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.880364 24523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.881417 24524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.886097 24526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.886293 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:57.887460 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.887655 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.887781 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602597887770 us; error 0 us; skew 500 ppm
I20260709 13:09:57.888249 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.890718 15321 webserver.cc:533] Webserver started at http://127.14.246.65:45071/ using document root <none> and password file <none>
I20260709 13:09:57.891170 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.891322 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.891528 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.892522 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.897212 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:57.900851 24531 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.901656 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:09:57.901994 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.902350 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.913050 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.914299 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.915728 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:57.918015 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:57.918246 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.918478 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:57.918677 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.959244 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:44223
I20260709 13:09:57.959339 24593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:44223 every 8 connection(s)
I20260709 13:09:57.964359 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.971393 24598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.972864 24599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.974509 24601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.975574 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:57.976547 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.976763 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.976967 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602597976949 us; error 0 us; skew 500 ppm
I20260709 13:09:57.977710 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.980491 15321 webserver.cc:533] Webserver started at http://127.14.246.66:44779/ using document root <none> and password file <none>
I20260709 13:09:57.981071 24594 heartbeater.cc:344] Connected to a master server at 127.14.246.126:46253
I20260709 13:09:57.981097 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.981547 24594 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:57.981575 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.982051 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.982425 24594 heartbeater.cc:507] Master 127.14.246.126:46253 requested a full tablet report, sending...
I20260709 13:09:57.983150 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "18fe96a430354e139040442b300f7e3c"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.984716 24467 ts_manager.cc:194] Registered new tserver with Master: fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:09:57.987156 24467 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58228
I20260709 13:09:57.989216 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:57.992758 24606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.993549 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:09:57.993840 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "18fe96a430354e139040442b300f7e3c"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:09:57.994148 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:58.009649 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:58.010829 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:58.012223 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:58.014568 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:58.014755 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.015056 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:58.015198 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.059003 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:39349
I20260709 13:09:58.059098 24668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:39349 every 8 connection(s)
I20260709 13:09:58.063653 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:58.070906 24672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.073184 24673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.075273 24675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:58.075498 15321 server_base.cc:1061] running on GCE node
I20260709 13:09:58.076620 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:58.076905 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:58.076982 24669 heartbeater.cc:344] Connected to a master server at 127.14.246.126:46253
I20260709 13:09:58.077138 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602598077117 us; error 0 us; skew 500 ppm
I20260709 13:09:58.077474 24669 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:58.077953 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:58.078387 24669 heartbeater.cc:507] Master 127.14.246.126:46253 requested a full tablet report, sending...
I20260709 13:09:58.080690 15321 webserver.cc:533] Webserver started at http://127.14.246.67:45781/ using document root <none> and password file <none>
I20260709 13:09:58.080760 24467 ts_manager.cc:194] Registered new tserver with Master: 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.081422 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:58.081670 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:58.081943 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:58.082419 24467 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58244
I20260709 13:09:58.083143 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "7be9196561ce4ffaac38728aeac7eba0"
format_stamp: "Formatted at 2026-07-09 13:09:58 on dist-test-slave-bhv2"
I20260709 13:09:58.087509 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:58.090597 24680 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.091341 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:58.091627 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "7be9196561ce4ffaac38728aeac7eba0"
format_stamp: "Formatted at 2026-07-09 13:09:58 on dist-test-slave-bhv2"
I20260709 13:09:58.091907 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:58.108883 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:58.110090 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:58.111513 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:58.113714 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:58.113935 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.114210 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:58.114393 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.153797 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:42407
I20260709 13:09:58.153906 24742 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:42407 every 8 connection(s)
I20260709 13:09:58.167908 24743 heartbeater.cc:344] Connected to a master server at 127.14.246.126:46253
I20260709 13:09:58.168469 24743 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:58.169358 24743 heartbeater.cc:507] Master 127.14.246.126:46253 requested a full tablet report, sending...
I20260709 13:09:58.171201 24467 ts_manager.cc:194] Registered new tserver with Master: 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.171594 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014568255s
I20260709 13:09:58.172911 24467 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58248
I20260709 13:09:58.197366 24467 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58260:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:58.200156 24467 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:58.283258 24557 tablet_service.cc:1511] Processing CreateTablet for tablet 1b81c5cfedbe45819b2454251cc8d33f (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.283595 24708 tablet_service.cc:1511] Processing CreateTablet for tablet 25b780e118504096bfe2bb96f42edd69 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.284056 24707 tablet_service.cc:1511] Processing CreateTablet for tablet 0849b65edb4b4d82a5eb69195c30cc53 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.284993 24557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b81c5cfedbe45819b2454251cc8d33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.285920 24559 tablet_service.cc:1511] Processing CreateTablet for tablet 25b780e118504096bfe2bb96f42edd69 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.286299 24706 tablet_service.cc:1511] Processing CreateTablet for tablet 1b81c5cfedbe45819b2454251cc8d33f (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.287314 24559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b780e118504096bfe2bb96f42edd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.288546 24705 tablet_service.cc:1511] Processing CreateTablet for tablet 93fc020debe04772be866f452c9b8c3c (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.289687 24708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b780e118504096bfe2bb96f42edd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.290041 24556 tablet_service.cc:1511] Processing CreateTablet for tablet 93fc020debe04772be866f452c9b8c3c (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.291630 24556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fc020debe04772be866f452c9b8c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.291299 24704 tablet_service.cc:1511] Processing CreateTablet for tablet 87d830f1645d4f3ab5da82ff3edf2714 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.294350 24558 tablet_service.cc:1511] Processing CreateTablet for tablet 0849b65edb4b4d82a5eb69195c30cc53 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.294425 24555 tablet_service.cc:1511] Processing CreateTablet for tablet 87d830f1645d4f3ab5da82ff3edf2714 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.296231 24558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849b65edb4b4d82a5eb69195c30cc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.299120 24555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d830f1645d4f3ab5da82ff3edf2714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.298765 24703 tablet_service.cc:1511] Processing CreateTablet for tablet a8127f4b95954fbc9a65aa84e6381b7e (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.300876 24704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d830f1645d4f3ab5da82ff3edf2714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.302412 24705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fc020debe04772be866f452c9b8c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.303889 24707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849b65edb4b4d82a5eb69195c30cc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.303521 24554 tablet_service.cc:1511] Processing CreateTablet for tablet a8127f4b95954fbc9a65aa84e6381b7e (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.305619 24706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b81c5cfedbe45819b2454251cc8d33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.306408 24554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8127f4b95954fbc9a65aa84e6381b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.307993 24703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8127f4b95954fbc9a65aa84e6381b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.323016 24553 tablet_service.cc:1511] Processing CreateTablet for tablet 0889f160af5a4fe9812f3adc8bd87e8b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.324431 24553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0889f160af5a4fe9812f3adc8bd87e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.326027 24702 tablet_service.cc:1511] Processing CreateTablet for tablet 0889f160af5a4fe9812f3adc8bd87e8b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.327548 24702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0889f160af5a4fe9812f3adc8bd87e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.337967 24552 tablet_service.cc:1511] Processing CreateTablet for tablet 0be6b7826e5843b9874bf7477a5eccbe (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.339382 24552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be6b7826e5843b9874bf7477a5eccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.343855 24701 tablet_service.cc:1511] Processing CreateTablet for tablet 0be6b7826e5843b9874bf7477a5eccbe (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.345412 24701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be6b7826e5843b9874bf7477a5eccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.347280 24551 tablet_service.cc:1511] Processing CreateTablet for tablet 1761ddeba21445d591fc7ffc3e9f6661 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.348624 24551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761ddeba21445d591fc7ffc3e9f6661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.354807 24700 tablet_service.cc:1511] Processing CreateTablet for tablet 1761ddeba21445d591fc7ffc3e9f6661 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.356182 24700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761ddeba21445d591fc7ffc3e9f6661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.358248 24634 tablet_service.cc:1511] Processing CreateTablet for tablet 25b780e118504096bfe2bb96f42edd69 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.359722 24634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b780e118504096bfe2bb96f42edd69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.366793 24633 tablet_service.cc:1511] Processing CreateTablet for tablet 0849b65edb4b4d82a5eb69195c30cc53 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.368448 24633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0849b65edb4b4d82a5eb69195c30cc53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.369357 24550 tablet_service.cc:1511] Processing CreateTablet for tablet dc421a2effe74fa992d9dc0f9846c77b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.370808 24632 tablet_service.cc:1511] Processing CreateTablet for tablet 1b81c5cfedbe45819b2454251cc8d33f (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.371969 24699 tablet_service.cc:1511] Processing CreateTablet for tablet dc421a2effe74fa992d9dc0f9846c77b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.370819 24550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc421a2effe74fa992d9dc0f9846c77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.373435 24699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc421a2effe74fa992d9dc0f9846c77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.381110 24632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b81c5cfedbe45819b2454251cc8d33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.386608 24631 tablet_service.cc:1511] Processing CreateTablet for tablet 93fc020debe04772be866f452c9b8c3c (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.388079 24631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93fc020debe04772be866f452c9b8c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.390053 24759 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.390605 24630 tablet_service.cc:1511] Processing CreateTablet for tablet 87d830f1645d4f3ab5da82ff3edf2714 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.391993 24630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d830f1645d4f3ab5da82ff3edf2714. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.398984 24759 tablet_bootstrap.cc:654] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.402026 24629 tablet_service.cc:1511] Processing CreateTablet for tablet a8127f4b95954fbc9a65aa84e6381b7e (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.403435 24629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8127f4b95954fbc9a65aa84e6381b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.410513 24628 tablet_service.cc:1511] Processing CreateTablet for tablet 0889f160af5a4fe9812f3adc8bd87e8b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.411993 24628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0889f160af5a4fe9812f3adc8bd87e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.418514 24627 tablet_service.cc:1511] Processing CreateTablet for tablet 0be6b7826e5843b9874bf7477a5eccbe (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.420116 24627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be6b7826e5843b9874bf7477a5eccbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.426371 24626 tablet_service.cc:1511] Processing CreateTablet for tablet 1761ddeba21445d591fc7ffc3e9f6661 (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.427819 24626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1761ddeba21445d591fc7ffc3e9f6661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.431320 24625 tablet_service.cc:1511] Processing CreateTablet for tablet dc421a2effe74fa992d9dc0f9846c77b (DEFAULT_TABLE table=test-workload [id=0c2950955f164e03820bd82e1e51a1d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.432713 24625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc421a2effe74fa992d9dc0f9846c77b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.445998 24758 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.471298 24759 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.471859 24759 ts_tablet_manager.cc:1403] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.082s	user 0.019s	sys 0.032s
I20260709 13:09:58.474900 24759 raft_consensus.cc:359] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.475579 24759 raft_consensus.cc:385] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.475876 24759 raft_consensus.cc:740] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.476701 24759 consensus_queue.cc:260] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.504562 24758 tablet_bootstrap.cc:654] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.509050 24594 heartbeater.cc:499] Master 127.14.246.126:46253 was elected leader, sending a full tablet report...
I20260709 13:09:58.518549 24761 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.521130 24759 ts_tablet_manager.cc:1434] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.049s	user 0.019s	sys 0.005s
I20260709 13:09:58.522212 24759 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.531566 24759 tablet_bootstrap.cc:654] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.534269 24761 tablet_bootstrap.cc:654] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.539520 24759 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.543915 24759 ts_tablet_manager.cc:1403] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 13:09:58.545933 24761 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.546347 24758 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.546399 24761 ts_tablet_manager.cc:1403] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.006s
I20260709 13:09:58.547046 24758 ts_tablet_manager.cc:1403] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.005s
I20260709 13:09:58.546727 24759 raft_consensus.cc:359] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.547516 24759 raft_consensus.cc:385] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.547838 24759 raft_consensus.cc:740] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.548573 24759 consensus_queue.cc:260] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.549103 24761 raft_consensus.cc:359] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.549829 24761 raft_consensus.cc:385] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.550081 24761 raft_consensus.cc:740] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.550691 24759 ts_tablet_manager.cc:1434] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:58.550733 24761 consensus_queue.cc:260] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.551820 24759 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.551548 24758 raft_consensus.cc:359] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.552305 24758 raft_consensus.cc:385] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.552606 24758 raft_consensus.cc:740] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.553468 24758 consensus_queue.cc:260] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.561180 24761 ts_tablet_manager.cc:1434] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 13:09:58.561915 24669 heartbeater.cc:499] Master 127.14.246.126:46253 was elected leader, sending a full tablet report...
W20260709 13:09:58.563289 24670 tablet.cc:2406] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:58.563334 24759 tablet_bootstrap.cc:654] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.564605 24758 ts_tablet_manager.cc:1434] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:09:58.565408 24743 heartbeater.cc:499] Master 127.14.246.126:46253 was elected leader, sending a full tablet report...
I20260709 13:09:58.565764 24758 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.569221 24759 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.569800 24759 ts_tablet_manager.cc:1403] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.003s
I20260709 13:09:58.572171 24758 tablet_bootstrap.cc:654] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.572928 24759 raft_consensus.cc:359] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.573729 24759 raft_consensus.cc:385] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.574076 24759 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.574832 24759 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.573724 24761 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.579355 24758 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.579906 24758 ts_tablet_manager.cc:1403] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:58.582921 24758 raft_consensus.cc:359] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.583691 24758 raft_consensus.cc:385] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.584008 24758 raft_consensus.cc:740] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.584419 24759 ts_tablet_manager.cc:1434] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:09:58.584828 24758 consensus_queue.cc:260] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.585520 24759 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.587317 24758 ts_tablet_manager.cc:1434] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:09:58.588308 24758 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.592619 24759 tablet_bootstrap.cc:654] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.594817 24758 tablet_bootstrap.cc:654] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.595546 24762 raft_consensus.cc:493] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.596066 24762 raft_consensus.cc:515] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.583362 24761 tablet_bootstrap.cc:654] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.609055 24762 leader_election.cc:290] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.609320 24759 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.610117 24759 ts_tablet_manager.cc:1403] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:09:58.614357 24759 raft_consensus.cc:359] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.615386 24759 raft_consensus.cc:385] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.615764 24759 raft_consensus.cc:740] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.622814 24759 consensus_queue.cc:260] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.624802 24761 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.625604 24761 ts_tablet_manager.cc:1403] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.012s
I20260709 13:09:58.625933 24759 ts_tablet_manager.cc:1434] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:09:58.627359 24759 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.628439 24761 raft_consensus.cc:359] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.629263 24761 raft_consensus.cc:385] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.629561 24761 raft_consensus.cc:740] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.630681 24761 consensus_queue.cc:260] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.632812 24761 ts_tablet_manager.cc:1434] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:58.633780 24761 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.639495 24758 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.640111 24758 ts_tablet_manager.cc:1403] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.031s
I20260709 13:09:58.641528 24761 tablet_bootstrap.cc:654] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.643240 24758 raft_consensus.cc:359] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.644013 24758 raft_consensus.cc:385] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.644290 24758 raft_consensus.cc:740] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.645037 24758 consensus_queue.cc:260] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.647501 24758 ts_tablet_manager.cc:1434] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:58.647979 24759 tablet_bootstrap.cc:654] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.648509 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
W20260709 13:09:58.650241 24532 leader_election.cc:343] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.653390 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.654912 24762 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.655543 24762 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.648510 24758 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.657838 24762 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.658545 24761 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.659050 24761 ts_tablet_manager.cc:1403] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
W20260709 13:09:58.661903 24533 leader_election.cc:343] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.662415 24533 leader_election.cc:304] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb920c8f030e4b62bd67fa63ef96d8be; no voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:09:58.662154 24761 raft_consensus.cc:359] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.663046 24761 raft_consensus.cc:385] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.663362 24761 raft_consensus.cc:740] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.663817 24758 tablet_bootstrap.cc:654] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.664207 24761 consensus_queue.cc:260] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.664867 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.665505 24718 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:58.666882 24532 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:58.668597 24761 ts_tablet_manager.cc:1434] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:58.669286 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.669696 24761 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.669883 24644 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:58.671425 24762 raft_consensus.cc:2749] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.672266 24762 raft_consensus.cc:2804] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.672621 24758 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.673379 24758 ts_tablet_manager.cc:1403] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.008s
I20260709 13:09:58.674858 24759 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.675406 24759 ts_tablet_manager.cc:1403] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.010s
I20260709 13:09:58.672683 24762 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.676578 24762 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.676729 24758 raft_consensus.cc:359] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.677747 24758 raft_consensus.cc:385] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.676631 24761 tablet_bootstrap.cc:654] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.678114 24758 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.679147 24758 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.683065 24759 raft_consensus.cc:359] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.683905 24759 raft_consensus.cc:385] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.684237 24759 raft_consensus.cc:740] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.685120 24759 consensus_queue.cc:260] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.686484 24762 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.687776 24759 ts_tablet_manager.cc:1434] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:58.688891 24759 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.688953 24758 ts_tablet_manager.cc:1434] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:09:58.689442 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:58.690330 24644 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.690454 24778 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.690968 24778 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.697091 24759 tablet_bootstrap.cc:654] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.697557 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.698195 24718 raft_consensus.cc:2468] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:58.699570 24532 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:58.700987 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.701138 24758 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
W20260709 13:09:58.702550 24533 leader_election.cc:343] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.696799 24778 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.705121 24778 raft_consensus.cc:2804] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.705484 24778 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.705881 24778 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.708417 24644 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:58.709261 24759 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.710608 24758 tablet_bootstrap.cc:654] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.713155 24533 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:58.714251 24781 raft_consensus.cc:2804] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.714224 24778 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.716463 24778 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.717397 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:58.711336 24762 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.712742 24759 ts_tablet_manager.cc:1403] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 13:09:58.719846 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:58.720481 24717 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.721863 24759 raft_consensus.cc:359] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.722616 24759 raft_consensus.cc:385] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.722918 24759 raft_consensus.cc:740] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.723682 24759 consensus_queue.cc:260] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.725131 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:58.725751 24718 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.726707 24759 ts_tablet_manager.cc:1434] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:09:58.727865 24759 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
W20260709 13:09:58.728554 24533 leader_election.cc:343] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.734125 24717 raft_consensus.cc:2468] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:58.735194 24758 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.735473 24532 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 18fe96a430354e139040442b300f7e3c
I20260709 13:09:58.719978 24761 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.735983 24758 ts_tablet_manager.cc:1403] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.008s
I20260709 13:09:58.736399 24761 ts_tablet_manager.cc:1403] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.000s
I20260709 13:09:58.736799 24762 raft_consensus.cc:2804] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.737365 24762 raft_consensus.cc:697] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:58.738592 24762 consensus_queue.cc:237] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
W20260709 13:09:58.739112 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:58.739601 24761 raft_consensus.cc:359] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.740355 24761 raft_consensus.cc:385] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.740656 24761 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.741642 24781 raft_consensus.cc:697] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:58.742240 24759 tablet_bootstrap.cc:654] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.742367 24758 raft_consensus.cc:359] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.742792 24781 consensus_queue.cc:237] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.743415 24758 raft_consensus.cc:385] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.744432 24758 raft_consensus.cc:740] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.745491 24758 consensus_queue.cc:260] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.735924 24718 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:58.749236 24761 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.752298 24761 ts_tablet_manager.cc:1434] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:58.753705 24761 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.759132 24758 ts_tablet_manager.cc:1434] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:09:58.760231 24758 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.766765 24758 tablet_bootstrap.cc:654] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.770550 24761 tablet_bootstrap.cc:654] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.781701 24465 catalog_manager.cc:5697] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.786661 24762 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.787417 24762 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.791076 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.791771 24718 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:58.792359 24762 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.792742 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.793768 24532 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
W20260709 13:09:58.794631 24533 leader_election.cc:343] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.795184 24759 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.795248 24758 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.795588 24762 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.796032 24758 ts_tablet_manager.cc:1403] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.015s
I20260709 13:09:58.796242 24762 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.796006 24759 ts_tablet_manager.cc:1403] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.032s
I20260709 13:09:58.796883 24762 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.799839 24759 raft_consensus.cc:359] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.796887 24761 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.801331 24761 ts_tablet_manager.cc:1403] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.007s
I20260709 13:09:58.800609 24758 raft_consensus.cc:359] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.802023 24758 raft_consensus.cc:385] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.802472 24758 raft_consensus.cc:740] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.803678 24758 consensus_queue.cc:260] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.800604 24759 raft_consensus.cc:385] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.804572 24762 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.805394 24759 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.806301 24759 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.807657 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:58.808264 24718 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.809301 24759 ts_tablet_manager.cc:1434] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:09:58.804431 24761 raft_consensus.cc:359] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.810338 24758 ts_tablet_manager.cc:1434] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:58.810832 24761 raft_consensus.cc:385] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.811441 24761 raft_consensus.cc:740] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.810372 24759 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.812011 24758 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.816368 24761 consensus_queue.cc:260] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.819044 24761 ts_tablet_manager.cc:1434] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:58.821871 24766 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.822427 24758 tablet_bootstrap.cc:654] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.822440 24766 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.826324 24766 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.832002 24761 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.836951 24758 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.837769 24758 ts_tablet_manager.cc:1403] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 13:09:58.841867 24758 raft_consensus.cc:359] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.842947 24758 raft_consensus.cc:385] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.843434 24758 raft_consensus.cc:740] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.843106 24762 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.844693 24758 consensus_queue.cc:260] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.847335 24761 tablet_bootstrap.cc:654] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.855547 24718 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:58.856977 24532 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:58.857993 24762 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.858496 24762 raft_consensus.cc:697] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:58.859299 24758 ts_tablet_manager.cc:1434] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:09:58.859350 24762 consensus_queue.cc:237] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:58.861159 24761 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.862561 24761 ts_tablet_manager.cc:1403] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:09:58.861488 24758 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.862986 24767 raft_consensus.cc:493] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.865059 24767 raft_consensus.cc:515] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.869654 24761 raft_consensus.cc:359] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.870517 24761 raft_consensus.cc:385] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.870896 24761 raft_consensus.cc:740] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.871402 24759 tablet_bootstrap.cc:654] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.871825 24761 consensus_queue.cc:260] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.872406 24767 leader_election.cc:290] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.871440 24758 tablet_bootstrap.cc:654] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.880848 24761 ts_tablet_manager.cc:1434] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:58.882084 24761 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.904565 24766 raft_consensus.cc:493] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.904691 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:58.905323 24766 raft_consensus.cc:515] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.906533 24761 tablet_bootstrap.cc:654] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.907488 24759 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:58.907665 24766 leader_election.cc:290] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.908041 24759 ts_tablet_manager.cc:1403] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.098s	user 0.013s	sys 0.004s
I20260709 13:09:58.910638 24758 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.911199 24758 ts_tablet_manager.cc:1403] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.006s
I20260709 13:09:58.914635 24758 raft_consensus.cc:359] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.916070 24758 raft_consensus.cc:385] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.918370 24758 raft_consensus.cc:740] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.917604 24759 raft_consensus.cc:359] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.919342 24759 raft_consensus.cc:385] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.919723 24759 raft_consensus.cc:740] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.920621 24759 consensus_queue.cc:260] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.921622 24758 consensus_queue.cc:260] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.922940 24766 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.923547 24766 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.926128 24766 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.926503 24767 raft_consensus.cc:493] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.927400 24767 raft_consensus.cc:515] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.929338 24759 ts_tablet_manager.cc:1434] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:09:58.929881 24758 ts_tablet_manager.cc:1434] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:09:58.929526 24767 leader_election.cc:290] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.930689 24759 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:58.934863 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.930893 24758 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:58.936313 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.937112 24717 raft_consensus.cc:2468] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:58.937328 24762 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.937827 24767 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.938292 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.938562 24767 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.936367 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.940853 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.939036 24643 raft_consensus.cc:2468] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 0.
I20260709 13:09:58.941578 24718 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:58.937881 24762 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.943269 24767 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
W20260709 13:09:58.944550 24682 leader_election.cc:343] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.944816 24762 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.945578 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:58.929452 24465 catalog_manager.cc:5697] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.945943 24682 leader_election.cc:304] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
W20260709 13:09:58.947165 24532 leader_election.cc:343] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.948758 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.949772 24759 tablet_bootstrap.cc:654] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.947257 24767 raft_consensus.cc:2804] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.951754 24767 raft_consensus.cc:493] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.952121 24767 raft_consensus.cc:3060] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.950071 24643 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 0.
W20260709 13:09:58.950435 24607 leader_election.cc:343] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.953780 24607 leader_election.cc:304] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:09:58.954713 24766 raft_consensus.cc:2804] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.954803 24607 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:09:58.955420 24766 raft_consensus.cc:493] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.956032 24766 raft_consensus.cc:3060] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.957758 24761 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:58.958359 24761 ts_tablet_manager.cc:1403] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.018s
I20260709 13:09:58.959846 24767 raft_consensus.cc:515] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.963300 24767 leader_election.cc:290] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:58.951213 24758 tablet_bootstrap.cc:654] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.963498 24761 raft_consensus.cc:359] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.965835 24761 raft_consensus.cc:385] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.966221 24761 raft_consensus.cc:740] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.947424 24465 catalog_manager.cc:5697] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.967196 24761 consensus_queue.cc:260] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.971737 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:58.972678 24643 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
W20260709 13:09:58.974370 24533 leader_election.cc:343] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.975478 24533 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:09:58.976482 24762 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.977039 24762 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.977499 24762 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.985384 24758 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:58.985977 24758 ts_tablet_manager.cc:1403] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.002s
I20260709 13:09:58.988121 24806 raft_consensus.cc:2804] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.988732 24806 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.989181 24806 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.989933 24761 ts_tablet_manager.cc:1434] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.005s
I20260709 13:09:58.991148 24761 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:58.994421 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:58.995981 24682 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:09:58.996322 24781 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.996973 24767 raft_consensus.cc:2804] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.996836 24781 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.997320 24758 raft_consensus.cc:359] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.998165 24758 raft_consensus.cc:385] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.998490 24758 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.999423 24781 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:58.997311 24782 raft_consensus.cc:493] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.997397 24767 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.001217 24767 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.001389 24759 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:59.001935 24759 ts_tablet_manager.cc:1403] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.001s
I20260709 13:09:59.005511 24806 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.006140 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.000468 24782 raft_consensus.cc:515] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.007835 24806 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.009066 24782 leader_election.cc:290] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.009920 24761 tablet_bootstrap.cc:654] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.010821 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.010931 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:59.011541 24717 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:59.011935 24644 raft_consensus.cc:2393] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb920c8f030e4b62bd67fa63ef96d8be in current term 1: Already voted for candidate 18fe96a430354e139040442b300f7e3c in this term.
I20260709 13:09:59.012880 24532 leader_election.cc:304] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.013743 24782 raft_consensus.cc:2804] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.013375 24759 raft_consensus.cc:359] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.014160 24782 raft_consensus.cc:493] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.014719 24782 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.014279 24759 raft_consensus.cc:385] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.014160 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:59.015173 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.015743 24759 raft_consensus.cc:740] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.015996 24644 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:59.014547 24758 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.016862 24567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:58.986624 24762 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:58.975273 24766 raft_consensus.cc:515] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.017609 24567 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 0.
I20260709 13:09:59.019119 24643 raft_consensus.cc:2393] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7be9196561ce4ffaac38728aeac7eba0 in current term 1: Already voted for candidate 18fe96a430354e139040442b300f7e3c in this term.
I20260709 13:09:59.018468 24563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.019547 24564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.019726 24563 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:59.020254 24564 raft_consensus.cc:2468] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:59.020468 24762 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.020650 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.021399 24566 raft_consensus.cc:3060] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.021281 24565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.022135 24565 raft_consensus.cc:2393] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate fb920c8f030e4b62bd67fa63ef96d8be in this term.
I20260709 13:09:59.016492 24568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.023847 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.024492 24717 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.026443 24766 leader_election.cc:290] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.017899 24759 consensus_queue.cc:260] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.029414 24569 raft_consensus.cc:2468] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 0.
I20260709 13:09:59.029769 24568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.030755 24568 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.014125 24767 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.033834 24718 raft_consensus.cc:2393] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb920c8f030e4b62bd67fa63ef96d8be in current term 1: Already voted for candidate 7be9196561ce4ffaac38728aeac7eba0 in this term.
I20260709 13:09:59.032537 24759 ts_tablet_manager.cc:1434] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.002s
I20260709 13:09:59.036214 24759 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:09:59.037557 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.041023 24718 raft_consensus.cc:2393] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate 7be9196561ce4ffaac38728aeac7eba0 in this term.
I20260709 13:09:59.041335 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.042136 24716 raft_consensus.cc:2393] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate 7be9196561ce4ffaac38728aeac7eba0 in this term.
I20260709 13:09:59.043520 24761 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:59.044070 24761 ts_tablet_manager.cc:1403] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.053s	user 0.004s	sys 0.013s
I20260709 13:09:59.046391 24767 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:59.047483 24759 tablet_bootstrap.cc:654] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.048236 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:59.040158 24717 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.047868 24761 raft_consensus.cc:359] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.032488 24566 raft_consensus.cc:2468] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:09:59.049259 24643 raft_consensus.cc:2393] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7be9196561ce4ffaac38728aeac7eba0 in current term 1: Already voted for candidate 18fe96a430354e139040442b300f7e3c in this term.
I20260709 13:09:59.049921 24761 raft_consensus.cc:385] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.049865 24532 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.050465 24761 raft_consensus.cc:740] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.050951 24762 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.051437 24762 raft_consensus.cc:697] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:59.051352 24761 consensus_queue.cc:260] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.052264 24766 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.052439 24762 consensus_queue.cc:237] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.052848 24766 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.053517 24761 ts_tablet_manager.cc:1434] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:09:59.054979 24766 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.052425 24758 ts_tablet_manager.cc:1434] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.004s
I20260709 13:09:59.056407 24761 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:59.057344 24758 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: Bootstrap starting.
I20260709 13:09:59.062579 24761 tablet_bootstrap.cc:654] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.067054 24759 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: No bootstrap required, opened a new log
I20260709 13:09:59.067560 24759 ts_tablet_manager.cc:1403] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.004s
I20260709 13:09:59.070154 24759 raft_consensus.cc:359] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.069979 24467 catalog_manager.cc:5697] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.070854 24759 raft_consensus.cc:385] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.071139 24759 raft_consensus.cc:740] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.071753 24759 consensus_queue.cc:260] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.064353 24758 tablet_bootstrap.cc:654] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.077423 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.078552 24717 raft_consensus.cc:2393] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate fb920c8f030e4b62bd67fa63ef96d8be in this term.
I20260709 13:09:59.082492 24759 ts_tablet_manager.cc:1434] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:59.089123 24684 leader_election.cc:304] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 18fe96a430354e139040442b300f7e3c
I20260709 13:09:59.089291 24568 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:09:59.089147 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:59.090211 24761 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:59.090166 24808 raft_consensus.cc:2804] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.090659 24610 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18fe96a430354e139040442b300f7e3c; no voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:09:59.090905 24808 raft_consensus.cc:493] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.090975 24761 ts_tablet_manager.cc:1403] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.013s
I20260709 13:09:59.091416 24643 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.089147 24533 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb920c8f030e4b62bd67fa63ef96d8be; no voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:09:59.091419 24808 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.093084 24762 raft_consensus.cc:2749] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.093894 24761 raft_consensus.cc:359] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.094635 24761 raft_consensus.cc:385] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.094887 24761 raft_consensus.cc:740] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.095602 24568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.096582 24566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1761ddeba21445d591fc7ffc3e9f6661" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.097030 24568 raft_consensus.cc:2393] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7be9196561ce4ffaac38728aeac7eba0 in current term 1: Already voted for candidate 18fe96a430354e139040442b300f7e3c in this term.
I20260709 13:09:59.097353 24566 raft_consensus.cc:2393] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate 7be9196561ce4ffaac38728aeac7eba0 in this term.
I20260709 13:09:59.095690 24761 consensus_queue.cc:260] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.097934 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.099164 24643 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.099488 24610 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:09:59.099761 24806 raft_consensus.cc:2749] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.100339 24684 leader_election.cc:304] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 18fe96a430354e139040442b300f7e3c
I20260709 13:09:59.100623 24766 raft_consensus.cc:2804] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.104457 24761 ts_tablet_manager.cc:1434] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:09:59.104502 24766 raft_consensus.cc:697] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:09:59.105008 24767 raft_consensus.cc:2804] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.105787 24684 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0; no voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:09:59.105607 24766 consensus_queue.cc:237] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.110098 24758 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: No bootstrap required, opened a new log
I20260709 13:09:59.110750 24758 ts_tablet_manager.cc:1403] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.005s
I20260709 13:09:59.111284 24804 raft_consensus.cc:493] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.111933 24804 raft_consensus.cc:515] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.114373 24758 raft_consensus.cc:359] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.115312 24758 raft_consensus.cc:385] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.115656 24758 raft_consensus.cc:740] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.116110 24804 leader_election.cc:290] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.102104 24610 leader_election.cc:304] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18fe96a430354e139040442b300f7e3c; no voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:09:59.103590 24808 raft_consensus.cc:515] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.116691 24758 consensus_queue.cc:260] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.119287 24808 leader_election.cc:290] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:09:59.120213 24808 raft_consensus.cc:2749] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.106035 24761 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: Bootstrap starting.
I20260709 13:09:59.127249 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:59.127978 24643 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.131294 24758 ts_tablet_manager.cc:1434] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.009s
I20260709 13:09:59.131721 24761 tablet_bootstrap.cc:654] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.133270 24806 raft_consensus.cc:2749] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.135977 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.136803 24569 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:59.137310 24643 raft_consensus.cc:2468] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:09:59.138765 24682 leader_election.cc:304] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:09:59.139900 24808 raft_consensus.cc:2804] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.140836 24808 raft_consensus.cc:697] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:09:59.141949 24808 consensus_queue.cc:237] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.090487 24782 raft_consensus.cc:515] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.135898 24610 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18fe96a430354e139040442b300f7e3c; no voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:09:59.145006 24806 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.146926 24762 raft_consensus.cc:493] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.147435 24762 raft_consensus.cc:515] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.148562 24767 raft_consensus.cc:697] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:09:59.149689 24762 leader_election.cc:290] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.149503 24767 consensus_queue.cc:237] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.150646 24761 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: No bootstrap required, opened a new log
I20260709 13:09:59.151113 24761 ts_tablet_manager.cc:1403] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.008s
I20260709 13:09:59.154066 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.154151 24761 raft_consensus.cc:359] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:59.154860 24717 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:59.155032 24761 raft_consensus.cc:385] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.155416 24761 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Initialized, Role: FOLLOWER
W20260709 13:09:59.152806 24684 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:44223, user_credentials={real_user=slave}} blocked reactor thread for 47100.2us
I20260709 13:09:59.156224 24761 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:59.157042 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.157606 24806 raft_consensus.cc:2749] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.157790 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.158242 24532 leader_election.cc:304] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.158536 24717 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 0.
I20260709 13:09:59.157655 24569 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.158937 24761 ts_tablet_manager.cc:1434] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:59.155915 24465 catalog_manager.cc:5697] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 1 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.160125 24610 leader_election.cc:304] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.161506 24782 leader_election.cc:290] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.163713 24762 raft_consensus.cc:2804] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.164351 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.164753 24762 raft_consensus.cc:493] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.164978 24717 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.165172 24762 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.166913 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:09:59.167271 24781 consensus_queue.cc:1048] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.167594 24643 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 0.
I20260709 13:09:59.169872 24806 raft_consensus.cc:2804] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.171175 24806 raft_consensus.cc:493] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.166917 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:59.171519 24806 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.171816 24644 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.176165 24569 raft_consensus.cc:2468] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:09:59.178917 24806 raft_consensus.cc:515] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.182240 24467 catalog_manager.cc:5697] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.184515 24762 raft_consensus.cc:515] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.185237 24782 consensus_queue.cc:1048] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.186637 24762 leader_election.cc:290] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Requested vote from peers 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.188247 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.188863 24718 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.202805 24642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:09:59.203591 24642 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.203974 24717 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.207587 24806 leader_election.cc:290] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:09:59.207427 24532 leader_election.cc:304] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.209236 24762 raft_consensus.cc:2804] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.209656 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:09:59.209896 24762 raft_consensus.cc:697] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:59.210276 24717 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.210989 24718 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.211140 24762 consensus_queue.cc:237] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.215117 24532 leader_election.cc:304] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.216286 24781 raft_consensus.cc:2804] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.216923 24781 raft_consensus.cc:697] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Becoming Leader. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Running, Role: LEADER
I20260709 13:09:59.218008 24781 consensus_queue.cc:237] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.223776 24642 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.229580 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:09:59.230295 24569 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.232548 24782 consensus_queue.cc:1048] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.248021 24644 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb920c8f030e4b62bd67fa63ef96d8be in term 1.
I20260709 13:09:59.249997 24569 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:09:59.276681 24717 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:09:59.276455 24465 catalog_manager.cc:5697] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.279474 24610 leader_election.cc:304] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:09:59.284149 24806 raft_consensus.cc:2804] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.284631 24806 raft_consensus.cc:697] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:09:59.285559 24806 consensus_queue.cc:237] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:09:59.293059 24766 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.295152 24766 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:09:59.300635 24766 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:09:59.301983 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:09:59.302901 24716 raft_consensus.cc:2393] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18fe96a430354e139040442b300f7e3c in current term 1: Already voted for candidate fb920c8f030e4b62bd67fa63ef96d8be in this term.
I20260709 13:09:59.304490 24569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" is_pre_election: true
I20260709 13:09:59.306195 24467 catalog_manager.cc:5697] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be reported cstate change: term changed from 0 to 1, leader changed from <none> to fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65). New cstate: current_term: 1 leader_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.312305 24464 catalog_manager.cc:5697] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.317848 24762 consensus_queue.cc:1048] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:59.323278 24610 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18fe96a430354e139040442b300f7e3c; no voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:09:59.331074 24806 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.347528 24467 catalog_manager.cc:5697] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 1 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.348579 24806 raft_consensus.cc:2749] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.370700 24762 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.381202 24826 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:59.433704 15321 ts_manager.cc:295] Set tserver state for fb920c8f030e4b62bd67fa63ef96d8be to MAINTENANCE_MODE
I20260709 13:09:59.434722 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
I20260709 13:09:59.446440 24826 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.462769 24782 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.477419 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:59.479007 15321 tablet_replica.cc:333] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.479781 15321 raft_consensus.cc:2243] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.480522 15321 pending_rounds.cc:70] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Trying to abort 1 pending ops.
I20260709 13:09:59.480819 15321 pending_rounds.cc:77] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636246444507136 op_type: NO_OP noop_request { }
I20260709 13:09:59.481200 15321 raft_consensus.cc:2889] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:59.481540 15321 raft_consensus.cc:2272] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.484268 15321 tablet_replica.cc:333] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.484849 15321 raft_consensus.cc:2243] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.485173 15321 raft_consensus.cc:2272] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.486876 15321 tablet_replica.cc:333] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.487354 15321 raft_consensus.cc:2243] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.488042 15321 raft_consensus.cc:2272] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.490046 15321 tablet_replica.cc:333] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.490521 15321 raft_consensus.cc:2243] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.490830 15321 raft_consensus.cc:2272] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.492271 15321 tablet_replica.cc:333] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.492730 15321 raft_consensus.cc:2243] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.493393 15321 pending_rounds.cc:70] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Trying to abort 1 pending ops.
I20260709 13:09:59.493639 15321 pending_rounds.cc:77] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636246396047360 op_type: NO_OP noop_request { }
I20260709 13:09:59.493863 15321 raft_consensus.cc:2889] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:59.494158 15321 raft_consensus.cc:2272] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.496191 15321 tablet_replica.cc:333] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.496658 15321 raft_consensus.cc:2243] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.497422 15321 raft_consensus.cc:2272] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.499305 15321 tablet_replica.cc:333] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.499763 15321 raft_consensus.cc:2243] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.500406 15321 raft_consensus.cc:2272] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.502382 15321 tablet_replica.cc:333] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.502828 15321 raft_consensus.cc:2243] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.503170 15321 raft_consensus.cc:2272] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.504920 15321 tablet_replica.cc:333] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.505324 15321 raft_consensus.cc:2243] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.505995 15321 raft_consensus.cc:2272] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.507866 15321 tablet_replica.cc:333] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: stopping tablet replica
I20260709 13:09:59.508270 15321 raft_consensus.cc:2243] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.508554 15321 raft_consensus.cc:2272] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.536542 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
I20260709 13:09:59.691251 24808 consensus_queue.cc:1048] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:59.709797 24684 consensus_peers.cc:597] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.712546 24806 consensus_queue.cc:1048] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:59.713964 24610 consensus_peers.cc:597] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:59.728559 24684 consensus_peers.cc:597] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:59.740229 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:59.757040 24767 consensus_queue.cc:1048] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:59.768014 24610 consensus_peers.cc:597] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.808243 24845 consensus_queue.cc:1048] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:00.729180 24808 raft_consensus.cc:493] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.729725 24808 raft_consensus.cc:515] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.731398 24808 leader_election.cc:290] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.732574 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:10:00.733435 24643 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:10:00.734639 24682 leader_election.cc:304] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
W20260709 13:10:00.735163 24684 leader_election.cc:336] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.735301 24808 raft_consensus.cc:2804] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.735728 24808 raft_consensus.cc:493] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.735997 24808 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.740985 24808 raft_consensus.cc:515] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
W20260709 13:10:00.741194 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:00.742575 24808 leader_election.cc:290] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.743678 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93fc020debe04772be866f452c9b8c3c" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:00.744318 24643 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:00.745980 24684 leader_election.cc:336] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.749292 24643 raft_consensus.cc:2468] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:00.750382 24682 leader_election.cc:304] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.751067 24808 raft_consensus.cc:2804] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.751560 24808 raft_consensus.cc:697] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:00.752341 24808 consensus_queue.cc:237] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.761134 24464 catalog_manager.cc:5697] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.796854 24808 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.797401 24808 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.799068 24808 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.800136 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
W20260709 13:10:00.802925 24684 leader_election.cc:336] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.803308 24684 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0; no voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.803948 24808 raft_consensus.cc:2749] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.805893 24808 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.806316 24808 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.806871 24845 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.807377 24845 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.808149 24808 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.809412 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:10:00.809443 24845 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.812199 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
W20260709 13:10:00.812358 24684 leader_election.cc:336] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.813053 24717 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:10:00.813027 24684 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0; no voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be
W20260709 13:10:00.813426 24610 leader_election.cc:336] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.814257 24808 raft_consensus.cc:2749] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.814828 24607 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.815505 24845 raft_consensus.cc:2804] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.815825 24845 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.816169 24845 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.822007 24845 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.823719 24845 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.824966 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:00.825640 24717 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:00.828541 24610 leader_election.cc:336] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.832135 24717 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 2.
I20260709 13:10:00.833261 24607 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.833907 24845 raft_consensus.cc:2804] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.834223 24766 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.834415 24845 raft_consensus.cc:697] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:00.834777 24766 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.835387 24845 consensus_queue.cc:237] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.836911 24766 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.838231 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:10:00.839043 24717 raft_consensus.cc:2468] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:10:00.840258 24607 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
W20260709 13:10:00.840838 24610 leader_election.cc:336] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.841107 24766 raft_consensus.cc:2804] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.841518 24766 raft_consensus.cc:493] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.841842 24766 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.844285 24464 catalog_manager.cc:5697] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 2 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.848505 24766 raft_consensus.cc:515] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.850962 24766 leader_election.cc:290] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.851722 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d830f1645d4f3ab5da82ff3edf2714" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:00.852320 24717 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:00.855587 24610 leader_election.cc:336] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.858160 24717 raft_consensus.cc:2468] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 2.
I20260709 13:10:00.859290 24607 leader_election.cc:304] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.860061 24766 raft_consensus.cc:2804] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.860536 24766 raft_consensus.cc:697] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:00.861451 24766 consensus_queue.cc:237] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.868283 24464 catalog_manager.cc:5697] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 2 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.879668 24766 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.880239 24766 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:00.882314 24766 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:10:00.882838 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:10:00.884625 24808 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.885136 24808 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
W20260709 13:10:00.886314 24610 leader_election.cc:336] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.886783 24610 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18fe96a430354e139040442b300f7e3c; no voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.887072 24808 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.887682 24766 raft_consensus.cc:2749] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.888186 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:10:00.888868 24643 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:10:00.889811 24682 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:10:00.890554 24808 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.890874 24808 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
W20260709 13:10:00.890924 24684 leader_election.cc:336] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.891191 24808 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.896351 24808 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:00.897863 24808 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.898900 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:00.899513 24643 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.900362 24808 raft_consensus.cc:493] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.900878 24808 raft_consensus.cc:515] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
W20260709 13:10:00.901640 24684 leader_election.cc:336] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.902822 24808 leader_election.cc:290] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.904023 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
I20260709 13:10:00.904672 24644 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 1.
I20260709 13:10:00.905953 24682 leader_election.cc:304] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
I20260709 13:10:00.906509 24643 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
W20260709 13:10:00.906574 24684 leader_election.cc:336] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.906783 24808 raft_consensus.cc:2804] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.907310 24808 raft_consensus.cc:493] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.907713 24808 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.907765 24682 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.908671 24767 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.909602 24767 raft_consensus.cc:697] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:00.910445 24767 consensus_queue.cc:237] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:00.914870 24808 raft_consensus.cc:515] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.916790 24808 leader_election.cc:290] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.917858 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:00.918547 24643 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.918969 24464 catalog_manager.cc:5697] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:00.920590 24684 leader_election.cc:336] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.926873 24643 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:00.928005 24682 leader_election.cc:304] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.928922 24808 raft_consensus.cc:2804] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.929386 24808 raft_consensus.cc:697] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:00.930126 24808 consensus_queue.cc:237] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.937386 24464 catalog_manager.cc:5697] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.966746 24808 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.967252 24808 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.969076 24808 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:00.970188 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18fe96a430354e139040442b300f7e3c" is_pre_election: true
W20260709 13:10:00.970275 24684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111) [suppressed 138 similar messages]
W20260709 13:10:00.973991 24684 leader_election.cc:336] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.974505 24766 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.974701 24684 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0; no voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.975859 24808 raft_consensus.cc:2749] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:00.975538 24766 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.979261 24766 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.980803 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0" is_pre_election: true
I20260709 13:10:00.981509 24717 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 1.
I20260709 13:10:00.982511 24607 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: 
W20260709 13:10:00.983074 24610 leader_election.cc:336] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.983243 24766 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:00.983685 24766 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader fb920c8f030e4b62bd67fa63ef96d8be)
I20260709 13:10:00.983983 24766 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.988833 24766 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:00.990387 24766 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:00.991504 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:00.992137 24717 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:00.993966 24610 leader_election.cc:336] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111)
I20260709 13:10:00.997475 24717 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 2.
I20260709 13:10:00.998507 24607 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, 7be9196561ce4ffaac38728aeac7eba0; no voters: fb920c8f030e4b62bd67fa63ef96d8be
I20260709 13:10:00.999161 24766 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.999571 24766 raft_consensus.cc:697] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:01.000272 24766 consensus_queue.cc:237] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:01.006916 24464 catalog_manager.cc:5697] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 1 to 2, leader changed from fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 2 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:01.135180 24684 consensus_peers.cc:597] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:01.253713 24498 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7cc0 after lost signal to thread 15324
W20260709 13:10:01.254702 24498 debug-util.cc:398] Leaking SignalData structure 0x7b08000993e0 after lost signal to thread 24501
W20260709 13:10:01.255723 24498 debug-util.cc:398] Leaking SignalData structure 0x7b080025b0e0 after lost signal to thread 24668
W20260709 13:10:01.256912 24498 debug-util.cc:398] Leaking SignalData structure 0x7b08000b75a0 after lost signal to thread 24742
W20260709 13:10:01.265492 24610 consensus_peers.cc:597] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.266777 24643 raft_consensus.cc:1275] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:01.268296 24808 consensus_queue.cc:1048] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:01.311143 24684 consensus_peers.cc:597] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:01.330139 24610 consensus_peers.cc:597] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.333698 24643 raft_consensus.cc:1275] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:01.335069 24767 consensus_queue.cc:1048] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.384948 24717 raft_consensus.cc:1275] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.386312 24766 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:01.400915 24610 consensus_peers.cc:597] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.435933 24717 raft_consensus.cc:1275] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.437448 24864 consensus_queue.cc:1048] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:01.462795 24717 raft_consensus.cc:1275] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.464275 24766 consensus_queue.cc:1048] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:01.475482 24684 consensus_peers.cc:597] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:01.519030 24643 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.520402 24808 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:01.742260 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:02.239714 24610 consensus_peers.cc:597] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:02.257751 24684 consensus_peers.cc:597] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:02.287618 24684 consensus_peers.cc:597] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:02.647718 24610 consensus_peers.cc:597] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:02.743220 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:03.566290 24684 consensus_peers.cc:597] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:03.744345 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:10:03.763240 24684 consensus_peers.cc:597] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:03.810942 24610 consensus_peers.cc:597] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:03.892457 24610 consensus_peers.cc:597] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:03.949967 24610 consensus_peers.cc:597] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:04.121863 24684 consensus_peers.cc:597] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:04.578220 24684 consensus_peers.cc:597] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:04.580646 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:04.589859 24869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:04.590199 24870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:04.592593 24872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:04.593955 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:04.596206 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:04.596521 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:04.596745 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602604596727 us; error 0 us; skew 500 ppm
I20260709 13:10:04.597443 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:04.600267 15321 webserver.cc:533] Webserver started at http://127.14.246.65:45071/ using document root <none> and password file <none>
I20260709 13:10:04.600906 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:04.601091 15321 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:10:04.605420 15321 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:04.609575 24877 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.610510 15321 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:04.610865 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-bhv2"
I20260709 13:10:04.611379 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:04.641199 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:04.642468 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:04.643926 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:04.647781 24884 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:10:04.665501 24684 consensus_peers.cc:597] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:04.691679 24610 consensus_peers.cc:597] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:04.707549 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:10:04.707978 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:10:04.708317 15321 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:10:04.714286 24884 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.728107 24884 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.728982 24884 tablet_bootstrap.cc:492] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.729563 24884 ts_tablet_manager.cc:1403] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:10:04.731920 24884 raft_consensus.cc:359] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:04.732749 24884 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.733572 24884 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:04.735924 24884 ts_tablet_manager.cc:1434] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:10:04.736596 24884 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
W20260709 13:10:04.745884 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:04.748210 24884 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.749046 24884 tablet_bootstrap.cc:492] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.749626 24884 ts_tablet_manager.cc:1403] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:10:04.750982 15321 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:10:04.751335 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.038s	sys 0.003s
I20260709 13:10:04.751890 24884 raft_consensus.cc:359] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.752501 24884 raft_consensus.cc:740] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.753237 24884 consensus_queue.cc:260] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.754853 24884 ts_tablet_manager.cc:1434] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:04.755559 24884 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.770705 24884 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:04.772123 24884 tablet_bootstrap.cc:492] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.772972 24884 ts_tablet_manager.cc:1403] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:10:04.776547 24884 raft_consensus.cc:359] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.777773 24884 raft_consensus.cc:740] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.778676 24884 consensus_queue.cc:260] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.781286 24884 ts_tablet_manager.cc:1434] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:04.782297 24884 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.798298 24884 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.799324 24884 tablet_bootstrap.cc:492] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.800136 24884 ts_tablet_manager.cc:1403] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:10:04.803158 24884 raft_consensus.cc:359] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.803960 24884 raft_consensus.cc:740] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.804739 24884 consensus_queue.cc:260] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.807267 24884 ts_tablet_manager.cc:1434] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:04.808229 24884 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.809324 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:44223
I20260709 13:10:04.809473 24945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:44223 every 8 connection(s)
I20260709 13:10:04.815538 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.842900 24884 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.844132 24884 tablet_bootstrap.cc:492] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.844868 24884 ts_tablet_manager.cc:1403] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.024s
I20260709 13:10:04.847638 24884 raft_consensus.cc:359] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.848421 24884 raft_consensus.cc:740] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.849231 24884 consensus_queue.cc:260] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.851504 24884 ts_tablet_manager.cc:1434] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:04.852411 24884 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.858181 24644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
mode: GRACEFUL
new_leader_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:10:04.859035 24644 raft_consensus.cc:606] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Received request to transfer leadership to TS 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:10:04.860625 24946 heartbeater.cc:344] Connected to a master server at 127.14.246.126:46253
I20260709 13:10:04.861153 24946 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:04.862119 24946 heartbeater.cc:507] Master 127.14.246.126:46253 requested a full tablet report, sending...
I20260709 13:10:04.871590 24919 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.872177 24467 ts_manager.cc:194] Re-registered known tserver with Master: fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:10:04.883281 24884 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.884271 24884 tablet_bootstrap.cc:492] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.884979 24884 ts_tablet_manager.cc:1403] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.014s
I20260709 13:10:04.885588 24718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
mode: GRACEFUL
new_leader_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:50642
I20260709 13:10:04.886502 24718 raft_consensus.cc:606] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Received request to transfer leadership to TS 18fe96a430354e139040442b300f7e3c
I20260709 13:10:04.887487 24884 raft_consensus.cc:359] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.888278 24884 raft_consensus.cc:740] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.888299 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:04.889165 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:04.889205 24884 consensus_queue.cc:260] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.890107 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:04.891458 24884 ts_tablet_manager.cc:1434] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:04.892349 24884 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.893723 24467 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43188
I20260709 13:10:04.897971 24946 heartbeater.cc:499] Master 127.14.246.126:46253 was elected leader, sending a full tablet report...
I20260709 13:10:04.901607 24767 raft_consensus.cc:993] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: : Instructing follower 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:04.902267 24959 raft_consensus.cc:1081] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Signalling peer 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:04.903935 24644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:10:04.904507 24644 raft_consensus.cc:493] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.904875 24644 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.909516 24884 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.910511 24884 tablet_bootstrap.cc:492] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.911197 24884 ts_tablet_manager.cc:1403] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:10:04.911796 24644 raft_consensus.cc:515] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.913949 24644 leader_election.cc:290] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 3 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:04.914847 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:04.915337 24718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc421a2effe74fa992d9dc0f9846c77b" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:04.915526 24919 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.913777 24884 raft_consensus.cc:359] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.915956 24718 raft_consensus.cc:3055] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:04.916105 24884 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.916427 24718 raft_consensus.cc:740] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:04.917004 24884 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.917495 24718 consensus_queue.cc:260] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.919023 24718 raft_consensus.cc:3060] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:04.919196 24884 ts_tablet_manager.cc:1434] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:04.920106 24884 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.922896 24919 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 3.
I20260709 13:10:04.925779 24610 leader_election.cc:304] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:04.926816 24864 raft_consensus.cc:2804] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:04.927418 24718 raft_consensus.cc:2468] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 3.
I20260709 13:10:04.929119 24920 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.933086 24864 raft_consensus.cc:697] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:04.934011 24864 consensus_queue.cc:237] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.935894 24884 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.936856 24884 tablet_bootstrap.cc:492] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.938243 24884 ts_tablet_manager.cc:1403] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 13:10:04.941813 24884 raft_consensus.cc:359] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.942726 24884 raft_consensus.cc:740] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.943557 24884 consensus_queue.cc:260] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.945675 24884 ts_tablet_manager.cc:1434] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:10:04.946584 24884 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.945796 24467 catalog_manager.cc:5697] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 2 to 3, leader changed from 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 3 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.962673 24884 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:04.963536 24884 tablet_bootstrap.cc:492] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.964135 24884 ts_tablet_manager.cc:1403] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:10:04.966452 24884 raft_consensus.cc:359] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.967062 24884 raft_consensus.cc:740] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.967587 24884 consensus_queue.cc:260] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.969156 24884 ts_tablet_manager.cc:1434] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:10:04.969830 24884 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap starting.
I20260709 13:10:04.980976 24884 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.981622 24884 tablet_bootstrap.cc:492] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Bootstrap complete.
I20260709 13:10:04.982147 24884 ts_tablet_manager.cc:1403] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:10:04.983870 24884 raft_consensus.cc:359] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.984336 24884 raft_consensus.cc:740] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb920c8f030e4b62bd67fa63ef96d8be, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.984892 24884 consensus_queue.cc:260] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:04.986291 24884 ts_tablet_manager.cc:1434] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:05.033907 24920 raft_consensus.cc:3060] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.039481 24920 pending_rounds.cc:85] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Aborting all ops after (but not including) 0
I20260709 13:10:05.039734 24920 pending_rounds.cc:107] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:05.039925 24920 raft_consensus.cc:2889] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.052701 24919 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.312475 24864 raft_consensus.cc:993] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: : Instructing follower 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:05.313038 24977 raft_consensus.cc:1081] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Signalling peer 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:05.314498 24718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:43982
I20260709 13:10:05.314934 24718 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.315176 24718 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.320302 24718 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:05.321879 24718 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 3 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:05.322666 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:05.322917 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:05.323376 24919 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.323506 24644 raft_consensus.cc:3055] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:05.323887 24644 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:05.324596 24644 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:05.325683 24644 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.328647 24919 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 3.
I20260709 13:10:05.329698 24684 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:05.330415 24959 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:05.330901 24959 raft_consensus.cc:697] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:05.331856 24959 consensus_queue.cc:237] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:05.332279 24644 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 3.
I20260709 13:10:05.339265 24467 catalog_manager.cc:5697] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 2 to 3, leader changed from 18fe96a430354e139040442b300f7e3c (127.14.246.66) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.347268 24718 raft_consensus.cc:1275] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:05.348636 24977 consensus_queue.cc:1048] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.358872 24919 raft_consensus.cc:1275] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:05.362465 24977 consensus_queue.cc:1048] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.363106 24977 consensus_queue.cc:1243] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [LEADER]: Peer fb920c8f030e4b62bd67fa63ef96d8be log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 13:10:05.367123 24919 pending_rounds.cc:85] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Aborting all ops after (but not including) 0
I20260709 13:10:05.367540 24919 pending_rounds.cc:107] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:05.367846 24919 raft_consensus.cc:2889] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:05.393483 24919 raft_consensus.cc:3060] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:05.747081 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:05.802990 24919 raft_consensus.cc:1275] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:05.804337 24959 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.812505 24644 raft_consensus.cc:1275] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:05.814059 24984 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:05.900688 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:05.908726 24644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
mode: GRACEFUL
new_leader_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:10:05.909596 24644 raft_consensus.cc:606] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Received request to transfer leadership to TS 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:10:05.912509 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
mode: GRACEFUL
new_leader_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:50642
I20260709 13:10:05.913003 24717 raft_consensus.cc:606] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Received request to transfer leadership to TS 18fe96a430354e139040442b300f7e3c
I20260709 13:10:05.914188 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:05.914709 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:05.915349 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.340044 24961 raft_consensus.cc:993] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: : Instructing follower 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:06.340678 24961 raft_consensus.cc:1081] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Signalling peer 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:06.342468 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:43982
I20260709 13:10:06.343009 24717 raft_consensus.cc:493] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.343328 24717 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.351359 24717 raft_consensus.cc:515] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.353402 24717 leader_election.cc:290] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:06.353928 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:06.354444 24644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0849b65edb4b4d82a5eb69195c30cc53" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:06.354563 24919 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.355139 24644 raft_consensus.cc:3055] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:06.355496 24644 raft_consensus.cc:740] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:06.356213 24644 consensus_queue.cc:260] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.357429 24644 raft_consensus.cc:3060] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:06.360303 24919 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:06.361486 24684 leader_election.cc:304] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:06.362286 24984 raft_consensus.cc:2804] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:06.363009 24644 raft_consensus.cc:2468] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:06.363327 24984 raft_consensus.cc:697] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:06.364547 24984 consensus_queue.cc:237] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.371737 24467 catalog_manager.cc:5697] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 1 to 2, leader changed from 18fe96a430354e139040442b300f7e3c (127.14.246.66) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.405712 24986 raft_consensus.cc:993] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: : Instructing follower 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:06.406191 24992 raft_consensus.cc:1081] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Signalling peer 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:06.407755 24644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:10:06.408319 24644 raft_consensus.cc:493] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.408758 24644 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.414114 24644 raft_consensus.cc:515] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.415875 24644 leader_election.cc:290] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 4 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:06.416656 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:06.416896 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8127f4b95954fbc9a65aa84e6381b7e" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:06.417316 24919 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.417586 24717 raft_consensus.cc:3055] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:06.417927 24717 raft_consensus.cc:740] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:06.418783 24717 consensus_queue.cc:260] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.419747 24717 raft_consensus.cc:3060] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:06.423985 24919 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 4.
I20260709 13:10:06.425174 24610 leader_election.cc:304] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:06.425486 24717 raft_consensus.cc:2468] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 4.
I20260709 13:10:06.425907 24961 raft_consensus.cc:2804] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:06.426450 24961 raft_consensus.cc:697] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 4 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:06.427325 24961 consensus_queue.cc:237] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:06.434023 24467 catalog_manager.cc:5697] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 3 to 4, leader changed from 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 4 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:06.748036 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:06.924965 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.931115 24920 raft_consensus.cc:1275] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:06.932540 24986 consensus_queue.cc:1048] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.934638 24644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
mode: GRACEFUL
new_leader_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:10:06.935124 24644 raft_consensus.cc:606] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Received request to transfer leadership to TS 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:10:06.937798 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
mode: GRACEFUL
new_leader_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:50642
I20260709 13:10:06.938500 24717 raft_consensus.cc:606] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Received request to transfer leadership to TS 18fe96a430354e139040442b300f7e3c
I20260709 13:10:06.939838 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:06.940476 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.940788 24644 raft_consensus.cc:1275] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:06.942425 24992 consensus_queue.cc:1048] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.948261 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.978928 24920 raft_consensus.cc:1275] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:06.980072 24961 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.988503 24717 raft_consensus.cc:1275] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:06.990558 25001 consensus_queue.cc:1048] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.147956 25001 raft_consensus.cc:993] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: : Instructing follower 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:07.148422 25000 raft_consensus.cc:1081] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Signalling peer 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:07.149785 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:43982
I20260709 13:10:07.150251 24717 raft_consensus.cc:493] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.150538 24717 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.155646 24717 raft_consensus.cc:515] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:07.157315 24717 leader_election.cc:290] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 3 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:07.158099 24920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:07.158529 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be6b7826e5843b9874bf7477a5eccbe" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:07.158869 24920 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.159256 24643 raft_consensus.cc:3055] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:07.159631 24643 raft_consensus.cc:740] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:07.160624 24643 consensus_queue.cc:260] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:07.162201 24643 raft_consensus.cc:3060] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.167130 24920 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 3.
I20260709 13:10:07.168497 24684 leader_election.cc:304] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:07.169307 24986 raft_consensus.cc:2804] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.169842 24986 raft_consensus.cc:697] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:07.170778 24643 raft_consensus.cc:2468] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 3.
I20260709 13:10:07.170876 24986 consensus_queue.cc:237] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:07.178843 24467 catalog_manager.cc:5697] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 2 to 3, leader changed from 18fe96a430354e139040442b300f7e3c (127.14.246.66) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.404852 24992 raft_consensus.cc:993] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: : Instructing follower 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:07.405416 25007 raft_consensus.cc:1081] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Signalling peer 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:07.406802 24643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:10:07.407297 24643 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.407613 24643 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.412382 24643 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:07.413969 24643 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 3 election: Requested vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:10:07.414772 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:07.415009 24920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:07.415395 24717 raft_consensus.cc:3055] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:07.415570 24920 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.415710 24717 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:07.416567 24717 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:07.417644 24717 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:07.421002 24920 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 3.
I20260709 13:10:07.422125 24610 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:07.422192 24717 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 3.
I20260709 13:10:07.422837 25000 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:07.423321 25000 raft_consensus.cc:697] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:07.424160 25000 consensus_queue.cc:237] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:07.431069 24467 catalog_manager.cc:5697] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 2 to 3, leader changed from 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 3 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:07.749167 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:07.750080 24919 raft_consensus.cc:1275] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.751456 25007 consensus_queue.cc:1048] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.755076 24643 raft_consensus.cc:1275] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.756613 25007 consensus_queue.cc:1048] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.863271 24717 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.864449 25000 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.873170 24919 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.875253 25000 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:07.959697 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.966749 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
mode: GRACEFUL
new_leader_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:50642
I20260709 13:10:07.967307 24717 raft_consensus.cc:606] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Received request to transfer leadership to TS 18fe96a430354e139040442b300f7e3c
I20260709 13:10:07.969930 24643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
mode: GRACEFUL
new_leader_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:10:07.970419 24643 raft_consensus.cc:606] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Received request to transfer leadership to TS 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:10:07.971565 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:07.972195 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:07.972908 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:08.073392 25007 raft_consensus.cc:993] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: : Instructing follower 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:08.073958 24986 raft_consensus.cc:1081] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Signalling peer 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:08.075470 24643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:10:08.076004 24643 raft_consensus.cc:493] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.076318 24643 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.081506 24643 raft_consensus.cc:515] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:08.083168 24643 leader_election.cc:290] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407)
I20260709 13:10:08.084187 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:08.084542 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b81c5cfedbe45819b2454251cc8d33f" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:08.084813 24919 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.085141 24717 raft_consensus.cc:3055] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.085430 24717 raft_consensus.cc:740] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:08.086078 24717 consensus_queue.cc:260] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:08.087026 24717 raft_consensus.cc:3060] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.090535 24919 raft_consensus.cc:2468] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 2.
I20260709 13:10:08.091785 24610 leader_election.cc:304] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:08.091810 24717 raft_consensus.cc:2468] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 2.
I20260709 13:10:08.092602 25000 raft_consensus.cc:2804] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.093101 25000 raft_consensus.cc:697] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:08.093971 25000 consensus_queue.cc:237] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:08.101975 24464 catalog_manager.cc:5697] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 1 to 2, leader changed from 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 2 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.432534 25001 raft_consensus.cc:993] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: : Instructing follower 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:08.433050 25000 raft_consensus.cc:1081] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Signalling peer 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:08.434438 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:43982
I20260709 13:10:08.434934 24717 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.435215 24717 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.439603 24717 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:08.440979 24717 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 4 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:08.441810 24920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:08.441980 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:08.442435 24920 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.442551 24643 raft_consensus.cc:3055] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:08.442921 24643 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:08.443629 24643 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:08.444567 24643 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:08.447649 24920 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 4.
I20260709 13:10:08.448743 24684 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:08.449429 24986 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:08.449805 24986 raft_consensus.cc:697] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:08.450282 24643 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 4.
I20260709 13:10:08.450529 24986 consensus_queue.cc:237] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:08.456596 24464 catalog_manager.cc:5697] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 3 to 4, leader changed from 18fe96a430354e139040442b300f7e3c (127.14.246.66) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 4 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.616613 24717 raft_consensus.cc:1275] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.617789 25000 consensus_queue.cc:1048] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.627197 24920 raft_consensus.cc:1275] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.628690 25000 consensus_queue.cc:1048] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:08.750187 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:08.910709 24643 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:08.911908 24986 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.919988 24920 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:08.921425 25029 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.980499 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:08.987622 24643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
mode: GRACEFUL
new_leader_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:53342
I20260709 13:10:08.988128 24643 raft_consensus.cc:606] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Received request to transfer leadership to TS 7be9196561ce4ffaac38728aeac7eba0
I20260709 13:10:08.990643 24717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
mode: GRACEFUL
new_leader_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:50642
I20260709 13:10:08.991151 24717 raft_consensus.cc:606] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 LEADER]: Received request to transfer leadership to TS 18fe96a430354e139040442b300f7e3c
I20260709 13:10:08.992192 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:08.992671 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:08.993254 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:09.073258 25023 raft_consensus.cc:993] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: : Instructing follower 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:09.073778 25000 raft_consensus.cc:1081] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Signalling peer 7be9196561ce4ffaac38728aeac7eba0 to start an election
I20260709 13:10:09.075088 24717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b"
dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
 from {username='slave'} at 127.0.0.1:43982
I20260709 13:10:09.075574 24717 raft_consensus.cc:493] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.075906 24717 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.081027 24717 raft_consensus.cc:515] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:09.082617 24717 leader_election.cc:290] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Requested vote from peers fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223), 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349)
I20260709 13:10:09.083528 24920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:09.083837 24643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0889f160af5a4fe9812f3adc8bd87e8b" candidate_uuid: "7be9196561ce4ffaac38728aeac7eba0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18fe96a430354e139040442b300f7e3c"
I20260709 13:10:09.084210 24920 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.084432 24643 raft_consensus.cc:3055] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:09.084841 24643 raft_consensus.cc:740] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:09.085482 24643 consensus_queue.cc:260] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:09.086369 24643 raft_consensus.cc:3060] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:09.090394 24920 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:09.090792 24643 raft_consensus.cc:2468] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be9196561ce4ffaac38728aeac7eba0 in term 2.
I20260709 13:10:09.091137 24919 raft_consensus.cc:1240] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Rejecting Update request from peer 18fe96a430354e139040442b300f7e3c for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:09.091585 24684 leader_election.cc:304] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be9196561ce4ffaac38728aeac7eba0, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:09.092613 25029 raft_consensus.cc:2804] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:09.093279 25029 raft_consensus.cc:697] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Becoming Leader. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:09.094414 25029 consensus_queue.cc:237] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } }
I20260709 13:10:09.101665 24464 catalog_manager.cc:5697] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 reported cstate change: term changed from 1 to 2, leader changed from 18fe96a430354e139040442b300f7e3c (127.14.246.66) to 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "7be9196561ce4ffaac38728aeac7eba0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.473374 24919 raft_consensus.cc:1275] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.475394 25037 consensus_queue.cc:1048] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.485571 24643 raft_consensus.cc:1275] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Refusing update from remote peer 7be9196561ce4ffaac38728aeac7eba0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:09.487416 25007 consensus_queue.cc:1048] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.540727 25029 raft_consensus.cc:993] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: : Instructing follower 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:09.541217 25007 raft_consensus.cc:1081] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 LEADER]: Signalling peer 18fe96a430354e139040442b300f7e3c to start an election
I20260709 13:10:09.542686 24643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69"
dest_uuid: "18fe96a430354e139040442b300f7e3c"
 from {username='slave'} at 127.0.0.1:57578
I20260709 13:10:09.543140 24643 raft_consensus.cc:493] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:09.543408 24643 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.547863 24643 raft_consensus.cc:515] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:09.549706 24643 leader_election.cc:290] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 5 election: Requested vote from peers 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67:42407), fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223)
I20260709 13:10:09.550150 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7be9196561ce4ffaac38728aeac7eba0"
I20260709 13:10:09.550361 24919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b780e118504096bfe2bb96f42edd69" candidate_uuid: "18fe96a430354e139040442b300f7e3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fb920c8f030e4b62bd67fa63ef96d8be"
I20260709 13:10:09.550779 24717 raft_consensus.cc:3055] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:09.551023 24919 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.551115 24717 raft_consensus.cc:740] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7be9196561ce4ffaac38728aeac7eba0, State: Running, Role: LEADER
I20260709 13:10:09.552001 24717 consensus_queue.cc:260] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:09.553177 24717 raft_consensus.cc:3060] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:09.556442 24919 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 5.
I20260709 13:10:09.557575 24610 leader_election.cc:304] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18fe96a430354e139040442b300f7e3c, fb920c8f030e4b62bd67fa63ef96d8be; no voters: 
I20260709 13:10:09.557665 24717 raft_consensus.cc:2468] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fe96a430354e139040442b300f7e3c in term 5.
I20260709 13:10:09.558310 25023 raft_consensus.cc:2804] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:09.558794 25023 raft_consensus.cc:697] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 5 LEADER]: Becoming Leader. State: Replica: 18fe96a430354e139040442b300f7e3c, State: Running, Role: LEADER
I20260709 13:10:09.559481 25023 consensus_queue.cc:237] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } }
I20260709 13:10:09.565030 24464 catalog_manager.cc:5697] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c reported cstate change: term changed from 4 to 5, leader changed from 7be9196561ce4ffaac38728aeac7eba0 (127.14.246.67) to 18fe96a430354e139040442b300f7e3c (127.14.246.66). New cstate: current_term: 5 leader_uuid: "18fe96a430354e139040442b300f7e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18fe96a430354e139040442b300f7e3c" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 39349 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:09.751168 24515 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:09.998734 24919 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 5 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:09.999475 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.001426 25023 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb920c8f030e4b62bd67fa63ef96d8be" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.013669 24717 raft_consensus.cc:1275] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 5 FOLLOWER]: Refusing update from remote peer 18fe96a430354e139040442b300f7e3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:10.016094 25023 consensus_queue.cc:1048] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be9196561ce4ffaac38728aeac7eba0" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:10.043084 15321 tablet_server.cc:179] TabletServer@127.14.246.65:44223 shutting down...
I20260709 13:10:10.066500 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:10.067166 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.067793 15321 raft_consensus.cc:2243] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.068264 15321 raft_consensus.cc:2272] T 0849b65edb4b4d82a5eb69195c30cc53 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.070994 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.071614 15321 raft_consensus.cc:2243] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.072103 15321 raft_consensus.cc:2272] T 93fc020debe04772be866f452c9b8c3c P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.074381 15321 tablet_replica.cc:333] stopping tablet replica
W20260709 13:10:10.074380 24684 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 77 similar messages]
I20260709 13:10:10.075575 15321 raft_consensus.cc:2243] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.076128 15321 raft_consensus.cc:2272] T 87d830f1645d4f3ab5da82ff3edf2714 P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:10.077441 24684 consensus_peers.cc:597] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.078480 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.079099 15321 raft_consensus.cc:2243] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.079506 15321 raft_consensus.cc:2272] T 1761ddeba21445d591fc7ffc3e9f6661 P fb920c8f030e4b62bd67fa63ef96d8be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.081470 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.082132 15321 raft_consensus.cc:2243] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.082702 15321 raft_consensus.cc:2272] T 1b81c5cfedbe45819b2454251cc8d33f P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.084553 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.085109 15321 raft_consensus.cc:2243] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.085575 15321 raft_consensus.cc:2272] T a8127f4b95954fbc9a65aa84e6381b7e P fb920c8f030e4b62bd67fa63ef96d8be [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.087354 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.087865 15321 raft_consensus.cc:2243] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.088269 15321 raft_consensus.cc:2272] T dc421a2effe74fa992d9dc0f9846c77b P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.090093 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.090629 15321 raft_consensus.cc:2243] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.091023 15321 raft_consensus.cc:2272] T 0be6b7826e5843b9874bf7477a5eccbe P fb920c8f030e4b62bd67fa63ef96d8be [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.092821 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.093343 15321 raft_consensus.cc:2243] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.093794 15321 raft_consensus.cc:2272] T 0889f160af5a4fe9812f3adc8bd87e8b P fb920c8f030e4b62bd67fa63ef96d8be [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.095873 15321 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:10.096417 15321 raft_consensus.cc:2243] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.096909 15321 raft_consensus.cc:2272] T 25b780e118504096bfe2bb96f42edd69 P fb920c8f030e4b62bd67fa63ef96d8be [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.126422 15321 tablet_server.cc:196] TabletServer@127.14.246.65:44223 shutdown complete.
W20260709 13:10:10.129180 24610 consensus_peers.cc:597] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.144236 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
W20260709 13:10:10.168715 24610 consensus_peers.cc:597] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.483973 24682 consensus_peers.cc:597] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 -> Peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Couldn't send request to peer 18fe96a430354e139040442b300f7e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.486589 24684 consensus_peers.cc:597] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.486917 24682 consensus_peers.cc:597] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Couldn't send request to peer 18fe96a430354e139040442b300f7e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.487190 24684 consensus_peers.cc:597] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.487658 24682 consensus_peers.cc:597] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 -> Peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Couldn't send request to peer 18fe96a430354e139040442b300f7e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.488273 24682 consensus_peers.cc:597] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Couldn't send request to peer 18fe96a430354e139040442b300f7e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.484529 24610 consensus_peers.cc:597] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.488878 24682 consensus_peers.cc:597] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 -> Peer 18fe96a430354e139040442b300f7e3c (127.14.246.66:39349): Couldn't send request to peer 18fe96a430354e139040442b300f7e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.489266 24610 consensus_peers.cc:597] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.493542 24684 consensus_peers.cc:597] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:10.494258 24684 consensus_peers.cc:597] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 -> Peer fb920c8f030e4b62bd67fa63ef96d8be (127.14.246.65:44223): Couldn't send request to peer fb920c8f030e4b62bd67fa63ef96d8be. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:44223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:10.494781 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:10.496088 15321 tablet_replica.cc:333] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.496896 15321 raft_consensus.cc:2243] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.497880 15321 raft_consensus.cc:2272] T 25b780e118504096bfe2bb96f42edd69 P 18fe96a430354e139040442b300f7e3c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.501374 15321 tablet_replica.cc:333] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.501962 15321 raft_consensus.cc:2243] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.502420 15321 raft_consensus.cc:2272] T 93fc020debe04772be866f452c9b8c3c P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.504483 15321 tablet_replica.cc:333] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.505028 15321 raft_consensus.cc:2243] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.505748 15321 raft_consensus.cc:2272] T 1b81c5cfedbe45819b2454251cc8d33f P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.507807 15321 tablet_replica.cc:333] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.508371 15321 raft_consensus.cc:2243] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.508805 15321 raft_consensus.cc:2272] T 0849b65edb4b4d82a5eb69195c30cc53 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.510867 15321 tablet_replica.cc:333] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.511439 15321 raft_consensus.cc:2243] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.511904 15321 raft_consensus.cc:2272] T 1761ddeba21445d591fc7ffc3e9f6661 P 18fe96a430354e139040442b300f7e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.514371 15321 tablet_replica.cc:333] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.514937 15321 raft_consensus.cc:2243] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.515868 15321 raft_consensus.cc:2272] T 87d830f1645d4f3ab5da82ff3edf2714 P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.518095 15321 tablet_replica.cc:333] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.518586 15321 raft_consensus.cc:2243] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.519304 15321 raft_consensus.cc:2272] T dc421a2effe74fa992d9dc0f9846c77b P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.521399 15321 tablet_replica.cc:333] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.521886 15321 raft_consensus.cc:2243] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.522622 15321 raft_consensus.cc:2272] T a8127f4b95954fbc9a65aa84e6381b7e P 18fe96a430354e139040442b300f7e3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.524536 15321 tablet_replica.cc:333] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.525044 15321 raft_consensus.cc:2243] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.525449 15321 raft_consensus.cc:2272] T 0be6b7826e5843b9874bf7477a5eccbe P 18fe96a430354e139040442b300f7e3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.527433 15321 tablet_replica.cc:333] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c: stopping tablet replica
I20260709 13:10:10.527868 15321 raft_consensus.cc:2243] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.528419 15321 raft_consensus.cc:2272] T 0889f160af5a4fe9812f3adc8bd87e8b P 18fe96a430354e139040442b300f7e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.563170 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
I20260709 13:10:10.587145 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
I20260709 13:10:10.610415 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:10.611195 15321 tablet_replica.cc:333] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.611969 15321 raft_consensus.cc:2243] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.612933 15321 raft_consensus.cc:2272] T 0849b65edb4b4d82a5eb69195c30cc53 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.615401 15321 tablet_replica.cc:333] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.616074 15321 raft_consensus.cc:2243] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.617084 15321 raft_consensus.cc:2272] T 93fc020debe04772be866f452c9b8c3c P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.619396 15321 tablet_replica.cc:333] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.619984 15321 raft_consensus.cc:2243] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.620427 15321 raft_consensus.cc:2272] T 1b81c5cfedbe45819b2454251cc8d33f P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.622623 15321 tablet_replica.cc:333] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.623232 15321 raft_consensus.cc:2243] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.623615 15321 raft_consensus.cc:2272] T a8127f4b95954fbc9a65aa84e6381b7e P 7be9196561ce4ffaac38728aeac7eba0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.625761 15321 tablet_replica.cc:333] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.626269 15321 raft_consensus.cc:2243] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.626999 15321 raft_consensus.cc:2272] T 0be6b7826e5843b9874bf7477a5eccbe P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.629191 15321 tablet_replica.cc:333] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.629747 15321 raft_consensus.cc:2243] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.630194 15321 raft_consensus.cc:2272] T dc421a2effe74fa992d9dc0f9846c77b P 7be9196561ce4ffaac38728aeac7eba0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.632279 15321 tablet_replica.cc:333] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.632848 15321 raft_consensus.cc:2243] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.633237 15321 raft_consensus.cc:2272] T 25b780e118504096bfe2bb96f42edd69 P 7be9196561ce4ffaac38728aeac7eba0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.636148 15321 tablet_replica.cc:333] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.636646 15321 raft_consensus.cc:2243] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.637501 15321 raft_consensus.cc:2272] T 1761ddeba21445d591fc7ffc3e9f6661 P 7be9196561ce4ffaac38728aeac7eba0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.639657 15321 tablet_replica.cc:333] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.640133 15321 raft_consensus.cc:2243] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:10.640558 15321 raft_consensus.cc:2272] T 87d830f1645d4f3ab5da82ff3edf2714 P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.642702 15321 tablet_replica.cc:333] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0: stopping tablet replica
I20260709 13:10:10.643162 15321 raft_consensus.cc:2243] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.643923 15321 raft_consensus.cc:2272] T 0889f160af5a4fe9812f3adc8bd87e8b P 7be9196561ce4ffaac38728aeac7eba0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.678190 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:10:10.702097 15321 master.cc:562] Master@127.14.246.126:46253 shutting down...
I20260709 13:10:10.723024 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:10.723574 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:10.723917 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P 174accde91a14eac8a1cf0ced9d433a4: stopping tablet replica
W20260709 13:10:11.228370 24498 debug-util.cc:398] Leaking SignalData structure 0x7b08002c46c0 after lost signal to thread 15324
W20260709 13:10:11.229794 24498 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4440 after lost signal to thread 24630
W20260709 13:10:11.740911 15321 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24498)
I20260709 13:10:11.916543 15321 master.cc:584] Master@127.14.246.126:46253 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14355 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:11.961046 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:44029
I20260709 13:10:11.962203 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:11.967095 25060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:11.968952 25063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.969046 15321 server_base.cc:1061] running on GCE node
W20260709 13:10:11.969144 25061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:11.970485 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:11.970666 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:11.970896 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602611970874 us; error 0 us; skew 500 ppm
I20260709 13:10:11.971438 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:11.973740 15321 webserver.cc:533] Webserver started at http://127.14.246.126:43873/ using document root <none> and password file <none>
I20260709 13:10:11.974253 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:11.974409 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:11.974717 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:11.975808 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "364edd7159194345b5380bd0a6623f8b"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-bhv2"
I20260709 13:10:11.980365 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:10:11.983726 25068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:11.984411 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:11.984702 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "364edd7159194345b5380bd0a6623f8b"
format_stamp: "Formatted at 2026-07-09 13:10:11 on dist-test-slave-bhv2"
I20260709 13:10:11.985015 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:12.005445 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:12.006628 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:12.046221 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:44029
I20260709 13:10:12.046324 25119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:44029 every 8 connection(s)
I20260709 13:10:12.050055 25120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.061275 25120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b: Bootstrap starting.
I20260709 13:10:12.066051 25120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.070367 25120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b: No bootstrap required, opened a new log
I20260709 13:10:12.072546 25120 raft_consensus.cc:359] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER }
I20260709 13:10:12.073035 25120 raft_consensus.cc:385] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.073284 25120 raft_consensus.cc:740] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 364edd7159194345b5380bd0a6623f8b, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.073870 25120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER }
I20260709 13:10:12.074327 25120 raft_consensus.cc:399] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:12.074548 25120 raft_consensus.cc:493] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:12.074859 25120 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.079592 25120 raft_consensus.cc:515] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER }
I20260709 13:10:12.080075 25120 leader_election.cc:304] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 364edd7159194345b5380bd0a6623f8b; no voters: 
I20260709 13:10:12.081190 25120 leader_election.cc:290] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:12.081534 25123 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.082929 25123 raft_consensus.cc:697] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 1 LEADER]: Becoming Leader. State: Replica: 364edd7159194345b5380bd0a6623f8b, State: Running, Role: LEADER
I20260709 13:10:12.083508 25123 consensus_queue.cc:237] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER }
I20260709 13:10:12.084000 25120 sys_catalog.cc:565] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:12.088043 25125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 364edd7159194345b5380bd0a6623f8b. Latest consensus state: current_term: 1 leader_uuid: "364edd7159194345b5380bd0a6623f8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER } }
I20260709 13:10:12.088599 25124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "364edd7159194345b5380bd0a6623f8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "364edd7159194345b5380bd0a6623f8b" member_type: VOTER } }
I20260709 13:10:12.093307 25124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:12.093681 25125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:12.096016 25131 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:12.103914 25131 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:12.104897 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:12.112690 25131 catalog_manager.cc:1383] Generated new cluster ID: 226c9d09756f44d099b2380a3e38833e
I20260709 13:10:12.113035 25131 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:12.158972 25131 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:12.160279 25131 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:12.172077 25131 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b: Generated new TSK 0
I20260709 13:10:12.172606 25131 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:12.236488 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:12.242762 25141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:12.243862 25142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:12.245908 25144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:12.245955 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:12.247246 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:12.247478 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:12.247653 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602612247639 us; error 0 us; skew 500 ppm
I20260709 13:10:12.248314 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:12.250699 15321 webserver.cc:533] Webserver started at http://127.14.246.65:36789/ using document root <none> and password file <none>
I20260709 13:10:12.251196 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:12.251397 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:12.251663 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:12.252733 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.257408 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:12.260890 25149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.261670 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:12.262073 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.262344 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:12.280023 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:12.281231 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:12.282637 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:12.284754 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:12.285019 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.285254 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:12.285427 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.326730 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:35147
I20260709 13:10:12.326821 25211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:35147 every 8 connection(s)
I20260709 13:10:12.331760 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:12.338676 25216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:12.339900 25217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:12.343811 15321 server_base.cc:1061] running on GCE node
W20260709 13:10:12.344437 25219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:12.345441 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:12.345718 25212 heartbeater.cc:344] Connected to a master server at 127.14.246.126:44029
W20260709 13:10:12.345742 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:12.346168 25212 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:12.346216 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602612346194 us; error 0 us; skew 500 ppm
I20260709 13:10:12.347015 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:12.347035 25212 heartbeater.cc:507] Master 127.14.246.126:44029 requested a full tablet report, sending...
I20260709 13:10:12.349629 25085 ts_manager.cc:194] Registered new tserver with Master: 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147)
I20260709 13:10:12.349817 15321 webserver.cc:533] Webserver started at http://127.14.246.66:41663/ using document root <none> and password file <none>
I20260709 13:10:12.350440 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:12.350623 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:12.350914 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:12.351691 25085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39174
I20260709 13:10:12.351987 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "58c3688d2bcc4f65b75e035e63fe429f"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.356504 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:12.359581 25224 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.360328 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:12.360672 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "58c3688d2bcc4f65b75e035e63fe429f"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.361094 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:12.403532 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:12.404930 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:12.406509 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:12.408929 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:12.409175 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.409440 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:12.409634 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.451670 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:36243
I20260709 13:10:12.451766 25286 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:36243 every 8 connection(s)
I20260709 13:10:12.457249 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:12.464305 25290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:12.465698 25291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:12.467902 25294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:12.468489 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:12.469565 25287 heartbeater.cc:344] Connected to a master server at 127.14.246.126:44029
I20260709 13:10:12.469601 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:12.470121 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:12.470162 25287 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:12.470338 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602612470323 us; error 0 us; skew 500 ppm
I20260709 13:10:12.471131 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:12.471226 25287 heartbeater.cc:507] Master 127.14.246.126:44029 requested a full tablet report, sending...
I20260709 13:10:12.473698 25085 ts_manager.cc:194] Registered new tserver with Master: 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243)
I20260709 13:10:12.473888 15321 webserver.cc:533] Webserver started at http://127.14.246.67:45655/ using document root <none> and password file <none>
I20260709 13:10:12.474527 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:12.474720 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:12.475003 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:12.475493 25085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39180
I20260709 13:10:12.476218 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "09b854015d674042b5557265d9c81cd3"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.480893 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:12.484385 25298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.485337 15321 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:12.485651 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "09b854015d674042b5557265d9c81cd3"
format_stamp: "Formatted at 2026-07-09 13:10:12 on dist-test-slave-bhv2"
I20260709 13:10:12.485985 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:12.501135 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:12.502329 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:12.503808 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:12.506042 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:12.506268 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.506512 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:12.506682 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:12.546952 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:40783
I20260709 13:10:12.547083 25360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:40783 every 8 connection(s)
I20260709 13:10:12.560647 25361 heartbeater.cc:344] Connected to a master server at 127.14.246.126:44029
I20260709 13:10:12.561142 25361 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:12.561848 25361 heartbeater.cc:507] Master 127.14.246.126:44029 requested a full tablet report, sending...
I20260709 13:10:12.563786 25085 ts_manager.cc:194] Registered new tserver with Master: 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:12.564520 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01443585s
I20260709 13:10:12.565220 25085 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39190
I20260709 13:10:12.587873 25085 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39194:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:12.590018 25085 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:12.635070 25325 tablet_service.cc:1511] Processing CreateTablet for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:12.637002 25325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.638351 25326 tablet_service.cc:1511] Processing CreateTablet for tablet f3b8aabc8dc3444ba24456c4375db7e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:12.639809 25326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b8aabc8dc3444ba24456c4375db7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.651789 25177 tablet_service.cc:1511] Processing CreateTablet for tablet f3b8aabc8dc3444ba24456c4375db7e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:12.653250 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b8aabc8dc3444ba24456c4375db7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.658077 25375 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: Bootstrap starting.
I20260709 13:10:12.658510 25176 tablet_service.cc:1511] Processing CreateTablet for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:12.658829 25252 tablet_service.cc:1511] Processing CreateTablet for tablet f3b8aabc8dc3444ba24456c4375db7e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:12.659916 25176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.660038 25252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b8aabc8dc3444ba24456c4375db7e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.660787 25251 tablet_service.cc:1511] Processing CreateTablet for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5729c9d8cb694194ad73b335a5bbfb2e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:12.662287 25251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b87ad57f0864b2fb21d2ff52fc1daa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:12.669462 25375 tablet_bootstrap.cc:654] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.684304 25377 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: Bootstrap starting.
I20260709 13:10:12.689915 25378 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: Bootstrap starting.
I20260709 13:10:12.692188 25375 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: No bootstrap required, opened a new log
I20260709 13:10:12.692824 25375 ts_tablet_manager.cc:1403] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.019s
I20260709 13:10:12.694965 25377 tablet_bootstrap.cc:654] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.695356 25375 raft_consensus.cc:359] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.696007 25375 raft_consensus.cc:385] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.696249 25375 raft_consensus.cc:740] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.696969 25375 consensus_queue.cc:260] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.699368 25361 heartbeater.cc:499] Master 127.14.246.126:44029 was elected leader, sending a full tablet report...
I20260709 13:10:12.699433 25378 tablet_bootstrap.cc:654] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.699864 25375 ts_tablet_manager.cc:1434] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:10:12.700886 25375 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: Bootstrap starting.
I20260709 13:10:12.707319 25375 tablet_bootstrap.cc:654] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.715106 25378 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: No bootstrap required, opened a new log
I20260709 13:10:12.715757 25378 ts_tablet_manager.cc:1403] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:10:12.715876 25375 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: No bootstrap required, opened a new log
I20260709 13:10:12.716483 25375 ts_tablet_manager.cc:1403] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:10:12.718905 25377 tablet_bootstrap.cc:492] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: No bootstrap required, opened a new log
I20260709 13:10:12.718911 25375 raft_consensus.cc:359] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.719595 25377 ts_tablet_manager.cc:1403] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.012s
I20260709 13:10:12.719623 25375 raft_consensus.cc:385] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.719516 25378 raft_consensus.cc:359] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.720317 25375 raft_consensus.cc:740] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.720613 25378 raft_consensus.cc:385] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.721060 25378 raft_consensus.cc:740] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.721161 25375 consensus_queue.cc:260] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.722069 25378 consensus_queue.cc:260] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.723460 25375 ts_tablet_manager.cc:1434] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:10:12.723330 25377 raft_consensus.cc:359] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.724524 25377 raft_consensus.cc:385] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.725076 25377 raft_consensus.cc:740] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.725792 25212 heartbeater.cc:499] Master 127.14.246.126:44029 was elected leader, sending a full tablet report...
I20260709 13:10:12.726537 25378 ts_tablet_manager.cc:1434] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:10:12.726131 25377 consensus_queue.cc:260] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.727763 25378 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: Bootstrap starting.
I20260709 13:10:12.728184 25379 raft_consensus.cc:493] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.728709 25379 raft_consensus.cc:515] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.731453 25379 leader_election.cc:290] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243), 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147)
I20260709 13:10:12.735880 25287 heartbeater.cc:499] Master 127.14.246.126:44029 was elected leader, sending a full tablet report...
I20260709 13:10:12.736248 25377 ts_tablet_manager.cc:1434] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent starting tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:10:12.737403 25378 tablet_bootstrap.cc:654] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.737443 25377 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: Bootstrap starting.
I20260709 13:10:12.747496 25377 tablet_bootstrap.cc:654] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.750058 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f" is_pre_election: true
I20260709 13:10:12.751091 25262 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 0.
I20260709 13:10:12.753166 25299 leader_election.cc:304] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:12.754427 25379 raft_consensus.cc:2804] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.754935 25379 raft_consensus.cc:493] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.755339 25379 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.756568 25386 raft_consensus.cc:493] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.757149 25386 raft_consensus.cc:515] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.759945 25386 leader_election.cc:290] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783), 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243)
I20260709 13:10:12.762228 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" is_pre_election: true
I20260709 13:10:12.762987 25187 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 0.
I20260709 13:10:12.769842 25379 raft_consensus.cc:515] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.771104 25378 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: No bootstrap required, opened a new log
I20260709 13:10:12.771718 25378 ts_tablet_manager.cc:1403] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.016s
I20260709 13:10:12.773552 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
I20260709 13:10:12.774199 25262 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.774870 25378 raft_consensus.cc:359] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.775638 25378 raft_consensus.cc:385] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.775920 25378 raft_consensus.cc:740] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.776789 25378 consensus_queue.cc:260] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.777349 25261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f" is_pre_election: true
I20260709 13:10:12.779187 25378 ts_tablet_manager.cc:1434] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:12.780261 25377 tablet_bootstrap.cc:492] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: No bootstrap required, opened a new log
I20260709 13:10:12.780839 25377 ts_tablet_manager.cc:1403] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.003s
I20260709 13:10:12.783531 25377 raft_consensus.cc:359] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.783912 25262 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 1.
I20260709 13:10:12.784245 25377 raft_consensus.cc:385] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.784648 25377 raft_consensus.cc:740] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.785213 25379 leader_election.cc:290] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243), 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147)
I20260709 13:10:12.785491 25377 consensus_queue.cc:260] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.785246 25299 leader_election.cc:304] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:12.787835 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
I20260709 13:10:12.788192 25377 ts_tablet_manager.cc:1434] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:12.788398 25187 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.793072 25379 raft_consensus.cc:2804] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.796737 25379 raft_consensus.cc:697] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Becoming Leader. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Running, Role: LEADER
I20260709 13:10:12.796906 25187 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 1.
I20260709 13:10:12.797734 25379 consensus_queue.cc:237] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:12.801657 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09b854015d674042b5557265d9c81cd3" is_pre_election: true
I20260709 13:10:12.803395 25153 leader_election.cc:304] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b; no voters: 09b854015d674042b5557265d9c81cd3, 58c3688d2bcc4f65b75e035e63fe429f
I20260709 13:10:12.804337 25383 raft_consensus.cc:2749] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.807866 25084 catalog_manager.cc:5697] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09b854015d674042b5557265d9c81cd3 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "09b854015d674042b5557265d9c81cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.867534 25379 raft_consensus.cc:493] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.868160 25379 raft_consensus.cc:515] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.869949 25379 leader_election.cc:290] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147), 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243)
I20260709 13:10:12.870796 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b87ad57f0864b2fb21d2ff52fc1daa9" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" is_pre_election: true
I20260709 13:10:12.871070 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b87ad57f0864b2fb21d2ff52fc1daa9" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f" is_pre_election: true
I20260709 13:10:12.871417 25187 raft_consensus.cc:2468] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 0.
I20260709 13:10:12.871719 25262 raft_consensus.cc:2468] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 0.
I20260709 13:10:12.872494 25299 leader_election.cc:304] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 3831c7059d1b43688d5dd3ad8ec7725b; no voters: 
I20260709 13:10:12.873113 25379 raft_consensus.cc:2804] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.873395 25379 raft_consensus.cc:493] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.873651 25379 raft_consensus.cc:3060] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.878445 25379 raft_consensus.cc:515] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.880000 25379 leader_election.cc:290] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 election: Requested vote from peers 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147), 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243)
I20260709 13:10:12.880851 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b87ad57f0864b2fb21d2ff52fc1daa9" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
I20260709 13:10:12.881002 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b87ad57f0864b2fb21d2ff52fc1daa9" candidate_uuid: "09b854015d674042b5557265d9c81cd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
I20260709 13:10:12.881599 25187 raft_consensus.cc:3060] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.881609 25262 raft_consensus.cc:3060] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.888499 25262 raft_consensus.cc:2468] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 1.
I20260709 13:10:12.888499 25187 raft_consensus.cc:2468] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09b854015d674042b5557265d9c81cd3 in term 1.
I20260709 13:10:12.889658 25299 leader_election.cc:304] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 3831c7059d1b43688d5dd3ad8ec7725b; no voters: 
I20260709 13:10:12.890296 25379 raft_consensus.cc:2804] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.890763 25379 raft_consensus.cc:697] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Becoming Leader. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Running, Role: LEADER
I20260709 13:10:12.891525 25379 consensus_queue.cc:237] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:12.897871 25084 catalog_manager.cc:5697] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09b854015d674042b5557265d9c81cd3 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "09b854015d674042b5557265d9c81cd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.976043 25084 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45160:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:12.977916 25084 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:13.000211 25176 tablet_service.cc:1511] Processing CreateTablet for tablet 47151e97222d4a4d979403cd26702b39 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:13.001554 25176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47151e97222d4a4d979403cd26702b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.001664 25252 tablet_service.cc:1511] Processing CreateTablet for tablet 47151e97222d4a4d979403cd26702b39 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:13.003005 25252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47151e97222d4a4d979403cd26702b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.003780 25325 tablet_service.cc:1511] Processing CreateTablet for tablet 47151e97222d4a4d979403cd26702b39 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:13.005071 25325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47151e97222d4a4d979403cd26702b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.007696 25177 tablet_service.cc:1511] Processing CreateTablet for tablet 16a1aa9aca524f50aa2c1baf3228aa34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:13.007905 25251 tablet_service.cc:1511] Processing CreateTablet for tablet 16a1aa9aca524f50aa2c1baf3228aa34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:13.009009 25177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a1aa9aca524f50aa2c1baf3228aa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.009186 25251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a1aa9aca524f50aa2c1baf3228aa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.014281 25326 tablet_service.cc:1511] Processing CreateTablet for tablet 16a1aa9aca524f50aa2c1baf3228aa34 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=53bd5dd8e4c3420ab12cc56b87b8946f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:13.015654 25326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a1aa9aca524f50aa2c1baf3228aa34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.020679 25377 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Bootstrap starting.
I20260709 13:10:13.026966 25377 tablet_bootstrap.cc:654] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.031708 25375 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: Bootstrap starting.
I20260709 13:10:13.037909 25378 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: Bootstrap starting.
I20260709 13:10:13.044116 25377 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: No bootstrap required, opened a new log
I20260709 13:10:13.044739 25377 ts_tablet_manager.cc:1403] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:10:13.045054 25375 tablet_bootstrap.cc:654] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.046757 25378 tablet_bootstrap.cc:654] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.047852 25377 raft_consensus.cc:359] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.048547 25377 raft_consensus.cc:385] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.048815 25377 raft_consensus.cc:740] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.049510 25377 consensus_queue.cc:260] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.051504 25377 ts_tablet_manager.cc:1434] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:10:13.052666 25377 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: Bootstrap starting.
I20260709 13:10:13.056375 25375 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: No bootstrap required, opened a new log
I20260709 13:10:13.057036 25375 ts_tablet_manager.cc:1403] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.006s
I20260709 13:10:13.057227 25378 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: No bootstrap required, opened a new log
I20260709 13:10:13.057812 25378 ts_tablet_manager.cc:1403] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:10:13.060349 25375 raft_consensus.cc:359] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.060786 25378 raft_consensus.cc:359] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.062139 25375 raft_consensus.cc:385] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.060933 25377 tablet_bootstrap.cc:654] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.062726 25375 raft_consensus.cc:740] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.062259 25378 raft_consensus.cc:385] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.064096 25378 raft_consensus.cc:740] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.065537 25378 consensus_queue.cc:260] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.067905 25378 ts_tablet_manager.cc:1434] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:13.063884 25375 consensus_queue.cc:260] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.070295 25375 ts_tablet_manager.cc:1434] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:10:13.073357 25375 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: Bootstrap starting.
I20260709 13:10:13.082752 25375 tablet_bootstrap.cc:654] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.088522 25378 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: Bootstrap starting.
I20260709 13:10:13.095475 25375 tablet_bootstrap.cc:492] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: No bootstrap required, opened a new log
I20260709 13:10:13.095755 25377 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: No bootstrap required, opened a new log
I20260709 13:10:13.096122 25375 ts_tablet_manager.cc:1403] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:10:13.097596 25378 tablet_bootstrap.cc:654] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:13.098167 25133 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:13.096411 25377 ts_tablet_manager.cc:1403] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.022s
I20260709 13:10:13.099740 25375 raft_consensus.cc:359] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.100601 25375 raft_consensus.cc:385] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.100987 25375 raft_consensus.cc:740] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.101904 25375 consensus_queue.cc:260] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.102159 25377 raft_consensus.cc:359] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.103031 25377 raft_consensus.cc:385] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.103376 25377 raft_consensus.cc:740] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.104269 25377 consensus_queue.cc:260] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.107121 25377 ts_tablet_manager.cc:1434] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:13.104645 25375 ts_tablet_manager.cc:1434] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:13.107854 25378 tablet_bootstrap.cc:492] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: No bootstrap required, opened a new log
I20260709 13:10:13.108392 25378 ts_tablet_manager.cc:1403] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:10:13.111434 25378 raft_consensus.cc:359] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.111971 25378 raft_consensus.cc:385] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.112219 25378 raft_consensus.cc:740] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.113137 25378 consensus_queue.cc:260] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.117930 25378 ts_tablet_manager.cc:1434] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:10:13.149363 25383 raft_consensus.cc:493] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.149856 25383 raft_consensus.cc:515] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.151943 25383 leader_election.cc:290] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:13.152678 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a1aa9aca524f50aa2c1baf3228aa34" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f" is_pre_election: true
I20260709 13:10:13.152937 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a1aa9aca524f50aa2c1baf3228aa34" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09b854015d674042b5557265d9c81cd3" is_pre_election: true
I20260709 13:10:13.153328 25262 raft_consensus.cc:2468] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 0.
I20260709 13:10:13.153550 25336 raft_consensus.cc:2468] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 0.
I20260709 13:10:13.154434 25150 leader_election.cc:304] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:13.155198 25383 raft_consensus.cc:2804] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.155577 25383 raft_consensus.cc:493] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.155856 25383 raft_consensus.cc:3060] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.160807 25383 raft_consensus.cc:515] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.162304 25383 leader_election.cc:290] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 election: Requested vote from peers 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:13.163034 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a1aa9aca524f50aa2c1baf3228aa34" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
I20260709 13:10:13.163354 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a1aa9aca524f50aa2c1baf3228aa34" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09b854015d674042b5557265d9c81cd3"
I20260709 13:10:13.163677 25262 raft_consensus.cc:3060] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.164022 25336 raft_consensus.cc:3060] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.170730 25262 raft_consensus.cc:2468] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 1.
I20260709 13:10:13.170814 25336 raft_consensus.cc:2468] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 1.
I20260709 13:10:13.172101 25150 leader_election.cc:304] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:13.172752 25383 raft_consensus.cc:2804] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.173228 25383 raft_consensus.cc:697] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 LEADER]: Becoming Leader. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Running, Role: LEADER
I20260709 13:10:13.173843 25383 consensus_queue.cc:237] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.180883 25082 catalog_manager.cc:5697] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b reported cstate change: term changed from 0 to 1, leader changed from <none> to 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65). New cstate: current_term: 1 leader_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.224691 25384 raft_consensus.cc:493] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.225273 25384 raft_consensus.cc:515] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.227083 25384 leader_election.cc:290] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:13.238004 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" is_pre_election: true
I20260709 13:10:13.238775 25187 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 0.
I20260709 13:10:13.238829 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09b854015d674042b5557265d9c81cd3" is_pre_election: true
I20260709 13:10:13.239500 25336 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 0.
I20260709 13:10:13.239722 25225 leader_election.cc:304] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:13.240573 25384 raft_consensus.cc:2804] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.240971 25384 raft_consensus.cc:493] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.241245 25384 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.246316 25384 raft_consensus.cc:515] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.247961 25384 leader_election.cc:290] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 1 election: Requested vote from peers 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:13.248804 25187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
I20260709 13:10:13.249019 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09b854015d674042b5557265d9c81cd3"
I20260709 13:10:13.249339 25187 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.249609 25336 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.254148 25187 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 1.
I20260709 13:10:13.254184 25336 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 1.
I20260709 13:10:13.255261 25225 leader_election.cc:304] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:13.256059 25384 raft_consensus.cc:2804] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.257216 25384 raft_consensus.cc:697] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 LEADER]: Becoming Leader. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Running, Role: LEADER
I20260709 13:10:13.258002 25384 consensus_queue.cc:237] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.264490 25082 catalog_manager.cc:5697] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f reported cstate change: term changed from 0 to 1, leader changed from <none> to 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66). New cstate: current_term: 1 leader_uuid: "58c3688d2bcc4f65b75e035e63fe429f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.286989 25379 consensus_queue.cc:1048] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.298061 25336 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0"
dest_uuid: "09b854015d674042b5557265d9c81cd3"
mode: GRACEFUL
new_leader_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
 from {username='slave'} at 127.0.0.1:41852
I20260709 13:10:13.298877 25336 raft_consensus.cc:606] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Received request to transfer leadership to TS 3831c7059d1b43688d5dd3ad8ec7725b
I20260709 13:10:13.307211 25413 consensus_queue.cc:1048] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.321712 25262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47151e97222d4a4d979403cd26702b39"
dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
mode: GRACEFUL
new_leader_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
 from {username='slave'} at 127.0.0.1:50692
I20260709 13:10:13.322218 25262 raft_consensus.cc:606] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 LEADER]: Received request to transfer leadership to TS 3831c7059d1b43688d5dd3ad8ec7725b
I20260709 13:10:13.340291 25413 consensus_queue.cc:1048] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.352557 25390 consensus_queue.cc:1048] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.361124 25379 raft_consensus.cc:993] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: : Instructing follower 3831c7059d1b43688d5dd3ad8ec7725b to start an election
I20260709 13:10:13.361584 25390 raft_consensus.cc:1081] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Signalling peer 3831c7059d1b43688d5dd3ad8ec7725b to start an election
I20260709 13:10:13.365636 25186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0"
dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
 from {username='slave'} at 127.0.0.1:39100
I20260709 13:10:13.366321 25186 raft_consensus.cc:493] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.366714 25186 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.373605 25186 raft_consensus.cc:515] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:13.375892 25186 leader_election.cc:290] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 2 election: Requested vote from peers 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783), 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243)
I20260709 13:10:13.377020 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
I20260709 13:10:13.377705 25262 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.383322 25262 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 2.
I20260709 13:10:13.376057 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3b8aabc8dc3444ba24456c4375db7e0" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09b854015d674042b5557265d9c81cd3"
I20260709 13:10:13.384284 25336 raft_consensus.cc:3055] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.384325 25150 leader_election.cc:304] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3831c7059d1b43688d5dd3ad8ec7725b, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:13.384696 25336 raft_consensus.cc:740] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09b854015d674042b5557265d9c81cd3, State: Running, Role: LEADER
I20260709 13:10:13.385251 25383 raft_consensus.cc:2804] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.385713 25383 raft_consensus.cc:697] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Becoming Leader. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Running, Role: LEADER
I20260709 13:10:13.385596 25336 consensus_queue.cc:260] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:13.386945 25336 raft_consensus.cc:3060] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.386695 25383 consensus_queue.cc:237] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } }
I20260709 13:10:13.393646 25336 raft_consensus.cc:2468] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 2.
I20260709 13:10:13.394191 25084 catalog_manager.cc:5697] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b reported cstate change: term changed from 1 to 2, leader changed from 09b854015d674042b5557265d9c81cd3 (127.14.246.67) to 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65). New cstate: current_term: 2 leader_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.653268 25383 consensus_queue.cc:1048] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.664608 25383 consensus_queue.cc:1048] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.673002 25407 consensus_queue.cc:1048] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [LEADER]: Connected to new peer: Peer: permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.683936 25423 consensus_queue.cc:1048] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.693073 25384 raft_consensus.cc:993] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: : Instructing follower 3831c7059d1b43688d5dd3ad8ec7725b to start an election
I20260709 13:10:13.693516 25423 raft_consensus.cc:1081] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 LEADER]: Signalling peer 3831c7059d1b43688d5dd3ad8ec7725b to start an election
I20260709 13:10:13.695058 25186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47151e97222d4a4d979403cd26702b39"
dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
 from {username='slave'} at 127.0.0.1:39104
I20260709 13:10:13.695562 25186 raft_consensus.cc:493] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:13.695844 25186 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.700543 25186 raft_consensus.cc:515] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.702986 25186 leader_election.cc:290] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 2 election: Requested vote from peers 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66:36243), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:13.703004 25262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
I20260709 13:10:13.703231 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09b854015d674042b5557265d9c81cd3"
I20260709 13:10:13.703816 25262 raft_consensus.cc:3055] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:13.704017 25336 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.704221 25262 raft_consensus.cc:740] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Running, Role: LEADER
I20260709 13:10:13.705287 25262 consensus_queue.cc:260] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.706634 25262 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.709731 25336 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 2.
I20260709 13:10:13.710784 25153 leader_election.cc:304] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 3831c7059d1b43688d5dd3ad8ec7725b; no voters: 
I20260709 13:10:13.711633 25383 raft_consensus.cc:2804] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:13.712098 25383 raft_consensus.cc:697] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Becoming Leader. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Running, Role: LEADER
I20260709 13:10:13.712570 25262 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3831c7059d1b43688d5dd3ad8ec7725b in term 2.
I20260709 13:10:13.712949 25383 consensus_queue.cc:237] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:13.719098 25085 catalog_manager.cc:5697] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b reported cstate change: term changed from 1 to 2, leader changed from 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66) to 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65). New cstate: current_term: 2 leader_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.767040 15321 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:13.768549 15321 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:13.768958 15321 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:13.783902 25186 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47151e97222d4a4d979403cd26702b39"
dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
mode: GRACEFUL
new_leader_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
 from {username='slave'} at 127.0.0.1:39110
I20260709 13:10:13.784539 25186 raft_consensus.cc:606] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Received request to transfer leadership to TS 58c3688d2bcc4f65b75e035e63fe429f
I20260709 13:10:13.785959 15321 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:13.983325 25336 raft_consensus.cc:1275] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Refusing update from remote peer 3831c7059d1b43688d5dd3ad8ec7725b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.984586 25383 consensus_queue.cc:1048] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:13.992969 25262 raft_consensus.cc:1275] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Refusing update from remote peer 3831c7059d1b43688d5dd3ad8ec7725b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:13.994663 25386 consensus_queue.cc:1048] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.127187 25336 raft_consensus.cc:1275] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Refusing update from remote peer 3831c7059d1b43688d5dd3ad8ec7725b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.128444 25386 consensus_queue.cc:1048] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.137169 25262 raft_consensus.cc:1275] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Refusing update from remote peer 3831c7059d1b43688d5dd3ad8ec7725b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.138863 25420 consensus_queue.cc:1048] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [LEADER]: Connected to new peer: Peer: permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.144268 25383 raft_consensus.cc:993] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: : Instructing follower 58c3688d2bcc4f65b75e035e63fe429f to start an election
I20260709 13:10:14.144675 25383 raft_consensus.cc:1081] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Signalling peer 58c3688d2bcc4f65b75e035e63fe429f to start an election
I20260709 13:10:14.146093 25262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47151e97222d4a4d979403cd26702b39"
dest_uuid: "58c3688d2bcc4f65b75e035e63fe429f"
 from {username='slave'} at 127.0.0.1:50688
I20260709 13:10:14.146721 25262 raft_consensus.cc:493] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.147110 25262 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.152818 25262 raft_consensus.cc:515] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:14.155520 25186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3831c7059d1b43688d5dd3ad8ec7725b"
I20260709 13:10:14.155778 25336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47151e97222d4a4d979403cd26702b39" candidate_uuid: "58c3688d2bcc4f65b75e035e63fe429f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09b854015d674042b5557265d9c81cd3"
I20260709 13:10:14.156307 25186 raft_consensus.cc:3055] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.155283 25262 leader_election.cc:290] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 3 election: Requested vote from peers 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147), 09b854015d674042b5557265d9c81cd3 (127.14.246.67:40783)
I20260709 13:10:14.156479 25336 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.156813 25186 raft_consensus.cc:740] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3831c7059d1b43688d5dd3ad8ec7725b, State: Running, Role: LEADER
I20260709 13:10:14.157878 25186 consensus_queue.cc:260] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:14.159307 25186 raft_consensus.cc:3060] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.163034 25336 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 3.
I20260709 13:10:14.164492 25228 leader_election.cc:304] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09b854015d674042b5557265d9c81cd3, 58c3688d2bcc4f65b75e035e63fe429f; no voters: 
I20260709 13:10:14.165390 25423 raft_consensus.cc:2804] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.165506 25186 raft_consensus.cc:2468] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58c3688d2bcc4f65b75e035e63fe429f in term 3.
I20260709 13:10:14.165977 25423 raft_consensus.cc:697] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 LEADER]: Becoming Leader. State: Replica: 58c3688d2bcc4f65b75e035e63fe429f, State: Running, Role: LEADER
I20260709 13:10:14.166918 25423 consensus_queue.cc:237] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } }
I20260709 13:10:14.174751 25085 catalog_manager.cc:5697] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f reported cstate change: term changed from 2 to 3, leader changed from 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65) to 58c3688d2bcc4f65b75e035e63fe429f (127.14.246.66). New cstate: current_term: 3 leader_uuid: "58c3688d2bcc4f65b75e035e63fe429f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3831c7059d1b43688d5dd3ad8ec7725b" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58c3688d2bcc4f65b75e035e63fe429f" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 36243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09b854015d674042b5557265d9c81cd3" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 40783 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.394824 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
I20260709 13:10:14.412586 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.413231 15321 tablet_replica.cc:333] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b: stopping tablet replica
I20260709 13:10:14.413725 15321 raft_consensus.cc:2243] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.414459 15321 raft_consensus.cc:2272] T 16a1aa9aca524f50aa2c1baf3228aa34 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.416451 15321 tablet_replica.cc:333] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b: stopping tablet replica
I20260709 13:10:14.448922 15321 raft_consensus.cc:2243] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.449957 15321 raft_consensus.cc:2272] T 47151e97222d4a4d979403cd26702b39 P 3831c7059d1b43688d5dd3ad8ec7725b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.454984 15321 tablet_replica.cc:333] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b: stopping tablet replica
I20260709 13:10:14.455819 15321 raft_consensus.cc:2243] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.456465 15321 raft_consensus.cc:2272] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 3831c7059d1b43688d5dd3ad8ec7725b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.459209 15321 tablet_replica.cc:333] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b: stopping tablet replica
I20260709 13:10:14.459822 15321 raft_consensus.cc:2243] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.461553 15321 raft_consensus.cc:2272] T f3b8aabc8dc3444ba24456c4375db7e0 P 3831c7059d1b43688d5dd3ad8ec7725b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.494521 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
I20260709 13:10:14.517455 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
I20260709 13:10:14.544935 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.545774 15321 tablet_replica.cc:333] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f: stopping tablet replica
I20260709 13:10:14.546515 15321 raft_consensus.cc:2243] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.547078 15321 raft_consensus.cc:2272] T 16a1aa9aca524f50aa2c1baf3228aa34 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.550248 15321 tablet_replica.cc:333] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: stopping tablet replica
I20260709 13:10:14.550741 15321 raft_consensus.cc:2243] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.551663 15321 pending_rounds.cc:70] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Trying to abort 1 pending ops.
I20260709 13:10:14.551856 15321 pending_rounds.cc:77] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636307638288384 op_type: NO_OP noop_request { }
I20260709 13:10:14.552248 15321 raft_consensus.cc:2889] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:14.552562 15321 raft_consensus.cc:2272] T 47151e97222d4a4d979403cd26702b39 P 58c3688d2bcc4f65b75e035e63fe429f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.555742 15321 tablet_replica.cc:333] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f: stopping tablet replica
I20260709 13:10:14.556232 15321 raft_consensus.cc:2243] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.556738 15321 raft_consensus.cc:2272] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 58c3688d2bcc4f65b75e035e63fe429f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.559197 15321 tablet_replica.cc:333] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f: stopping tablet replica
I20260709 13:10:14.559640 15321 raft_consensus.cc:2243] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.560254 15321 raft_consensus.cc:2272] T f3b8aabc8dc3444ba24456c4375db7e0 P 58c3688d2bcc4f65b75e035e63fe429f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.589067 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
I20260709 13:10:14.608521 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
W20260709 13:10:14.632503 25299 consensus_peers.cc:597] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 -> Peer 3831c7059d1b43688d5dd3ad8ec7725b (127.14.246.65:35147): Couldn't send request to peer 3831c7059d1b43688d5dd3ad8ec7725b. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:35147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.635499 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.636492 15321 tablet_replica.cc:333] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3: stopping tablet replica
I20260709 13:10:14.637250 15321 raft_consensus.cc:2243] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.637910 15321 raft_consensus.cc:2272] T 47151e97222d4a4d979403cd26702b39 P 09b854015d674042b5557265d9c81cd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.641158 15321 tablet_replica.cc:333] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3: stopping tablet replica
I20260709 13:10:14.641758 15321 raft_consensus.cc:2243] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.642356 15321 raft_consensus.cc:2272] T 16a1aa9aca524f50aa2c1baf3228aa34 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.645411 15321 tablet_replica.cc:333] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3: stopping tablet replica
I20260709 13:10:14.645937 15321 raft_consensus.cc:2243] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.646535 15321 raft_consensus.cc:2272] T f3b8aabc8dc3444ba24456c4375db7e0 P 09b854015d674042b5557265d9c81cd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.649206 15321 tablet_replica.cc:333] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3: stopping tablet replica
I20260709 13:10:14.649688 15321 raft_consensus.cc:2243] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.650830 15321 raft_consensus.cc:2272] T 6b87ad57f0864b2fb21d2ff52fc1daa9 P 09b854015d674042b5557265d9c81cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.676901 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:10:14.696141 15321 master.cc:562] Master@127.14.246.126:44029 shutting down...
I20260709 13:10:14.717715 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.718487 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.718830 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P 364edd7159194345b5380bd0a6623f8b: stopping tablet replica
I20260709 13:10:14.740893 15321 master.cc:584] Master@127.14.246.126:44029 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2823 ms)
[----------] 6 tests from LeaderRebalancerTest (288527 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:14.785454 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:38175
I20260709 13:10:14.786626 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.792213 25431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.792482 25432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.793665 25434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.794750 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:14.795629 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.795809 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.795920 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602614795910 us; error 0 us; skew 500 ppm
I20260709 13:10:14.796397 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.798969 15321 webserver.cc:533] Webserver started at http://127.14.246.126:46409/ using document root <none> and password file <none>
I20260709 13:10:14.799417 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.799569 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:14.799782 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:14.800983 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "5cdb7cc8d84641d3a157e5339c0b58bb"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-bhv2"
I20260709 13:10:14.805423 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:14.809116 25439 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.809983 15321 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:10:14.810249 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "5cdb7cc8d84641d3a157e5339c0b58bb"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-bhv2"
I20260709 13:10:14.810549 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.837087 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.838276 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.879051 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:38175
I20260709 13:10:14.879143 25490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:38175 every 8 connection(s)
I20260709 13:10:14.883312 25491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.895540 25491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: Bootstrap starting.
I20260709 13:10:14.900355 25491 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.904613 25491 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: No bootstrap required, opened a new log
I20260709 13:10:14.906843 25491 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER }
I20260709 13:10:14.907240 25491 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.907434 25491 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cdb7cc8d84641d3a157e5339c0b58bb, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.908035 25491 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER }
I20260709 13:10:14.908473 25491 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:14.908661 25491 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:14.908960 25491 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.914026 25491 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER }
I20260709 13:10:14.914547 25491 leader_election.cc:304] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cdb7cc8d84641d3a157e5339c0b58bb; no voters: 
I20260709 13:10:14.915628 25491 leader_election.cc:290] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:14.916124 25494 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.917716 25494 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 1 LEADER]: Becoming Leader. State: Replica: 5cdb7cc8d84641d3a157e5339c0b58bb, State: Running, Role: LEADER
I20260709 13:10:14.918403 25494 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER }
I20260709 13:10:14.918596 25491 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:14.921777 25496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cdb7cc8d84641d3a157e5339c0b58bb. Latest consensus state: current_term: 1 leader_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER } }
I20260709 13:10:14.921769 25495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cdb7cc8d84641d3a157e5339c0b58bb" member_type: VOTER } }
I20260709 13:10:14.922508 25496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:14.922586 25495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:14.925915 25499 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:14.931543 25499 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:14.934861 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:14.941149 25499 catalog_manager.cc:1383] Generated new cluster ID: 792da5ed0c004026920e97f145aaddaa
I20260709 13:10:14.941481 25499 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:14.953672 25499 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:14.955106 25499 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:14.982944 25499 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: Generated new TSK 0
I20260709 13:10:14.983636 25499 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:15.002512 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.009053 25512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.010370 25513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.011837 25515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.012261 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:15.013378 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.013603 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.013818 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602615013772 us; error 0 us; skew 500 ppm
I20260709 13:10:15.014467 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.017056 15321 webserver.cc:533] Webserver started at http://127.14.246.65:39747/ using document root <none> and password file <none>
I20260709 13:10:15.017591 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.017813 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.018116 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.019413 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "2dc839aa4f604ee493132de52806638d"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.024467 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.007s
I20260709 13:10:15.028270 25520 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.029271 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:15.029619 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "2dc839aa4f604ee493132de52806638d"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.029955 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.047240 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.048616 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.050238 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.052676 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:15.052981 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.053275 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:15.053471 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.097074 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:39989
I20260709 13:10:15.097165 25582 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:39989 every 8 connection(s)
I20260709 13:10:15.102349 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.110841 25587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.112586 25588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.115578 25590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.115621 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:15.117914 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.118186 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.118394 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602615118376 us; error 0 us; skew 500 ppm
I20260709 13:10:15.119091 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.120119 25583 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38175
I20260709 13:10:15.120651 25583 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:15.121673 25583 heartbeater.cc:507] Master 127.14.246.126:38175 requested a full tablet report, sending...
I20260709 13:10:15.121974 15321 webserver.cc:533] Webserver started at http://127.14.246.66:45643/ using document root <none> and password file <none>
I20260709 13:10:15.122601 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.122844 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.123179 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.124348 25456 ts_manager.cc:194] Registered new tserver with Master: 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989)
I20260709 13:10:15.124815 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "9995177579524a00a286f7d014d0a249"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.127040 25456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60526
I20260709 13:10:15.130841 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:15.134721 25595 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.135543 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:15.135849 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "9995177579524a00a286f7d014d0a249"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.136137 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.177150 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.178364 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.179839 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.182096 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:15.182329 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.182572 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:15.182744 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.223726 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:45985
I20260709 13:10:15.223834 25657 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:45985 every 8 connection(s)
I20260709 13:10:15.228942 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:15.236963 25661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:15.239799 25662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.241228 15321 server_base.cc:1061] running on GCE node
W20260709 13:10:15.242872 25664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:15.243449 25658 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38175
I20260709 13:10:15.243965 25658 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:15.244148 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:15.244450 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:15.244658 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602615244639 us; error 0 us; skew 500 ppm
I20260709 13:10:15.245007 25658 heartbeater.cc:507] Master 127.14.246.126:38175 requested a full tablet report, sending...
I20260709 13:10:15.245532 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:15.247676 25456 ts_manager.cc:194] Registered new tserver with Master: 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:15.248585 15321 webserver.cc:533] Webserver started at http://127.14.246.67:44761/ using document root <none> and password file <none>
I20260709 13:10:15.249212 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:15.249406 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:15.249435 25456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60536
I20260709 13:10:15.249711 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:15.251452 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "9aa5819cb41245e982bbc556dc0a36b6"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.256235 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:10:15.259714 25669 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.260669 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:15.261034 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "9aa5819cb41245e982bbc556dc0a36b6"
format_stamp: "Formatted at 2026-07-09 13:10:15 on dist-test-slave-bhv2"
I20260709 13:10:15.261296 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:15.269865 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:15.271040 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:15.272539 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:15.274837 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:15.275043 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.275287 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:15.275440 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:15.317559 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:37667
I20260709 13:10:15.317672 25731 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:37667 every 8 connection(s)
I20260709 13:10:15.331907 25732 heartbeater.cc:344] Connected to a master server at 127.14.246.126:38175
I20260709 13:10:15.332389 25732 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:15.333244 25732 heartbeater.cc:507] Master 127.14.246.126:38175 requested a full tablet report, sending...
I20260709 13:10:15.335206 25456 ts_manager.cc:194] Registered new tserver with Master: 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:15.335479 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014531023s
I20260709 13:10:15.337090 25456 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60548
I20260709 13:10:15.361554 25456 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60558:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:15.364408 25456 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:15.450577 25697 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4d5f79bdd482c930bcfd597054306 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.452817 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4d5f79bdd482c930bcfd597054306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.454661 25548 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4d5f79bdd482c930bcfd597054306 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.456231 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4d5f79bdd482c930bcfd597054306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.456118 25547 tablet_service.cc:1511] Processing CreateTablet for tablet 488b8dd8183244ff8de304037a67e0e7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.457841 25547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b8dd8183244ff8de304037a67e0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.459263 25696 tablet_service.cc:1511] Processing CreateTablet for tablet 488b8dd8183244ff8de304037a67e0e7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.461319 25694 tablet_service.cc:1511] Processing CreateTablet for tablet ace9a99cb0cc4d74af0e883b304a6deb (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.462880 25694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace9a99cb0cc4d74af0e883b304a6deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.463099 25618 tablet_service.cc:1511] Processing CreateTablet for tablet d98b8e722d184b05924f020ed53513ac (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.464799 25693 tablet_service.cc:1511] Processing CreateTablet for tablet 57847ad165734a658705ff4fec9429b7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.464994 25689 tablet_service.cc:1511] Processing CreateTablet for tablet d0ffa666437441be80543ad39d6fea18 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.466413 25693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57847ad165734a658705ff4fec9429b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.466063 25616 tablet_service.cc:1511] Processing CreateTablet for tablet 50c7912f33aa4f88ba30bc22f7eab8d2 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.466989 25620 tablet_service.cc:1511] Processing CreateTablet for tablet ace9a99cb0cc4d74af0e883b304a6deb (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.468554 25615 tablet_service.cc:1511] Processing CreateTablet for tablet d0ffa666437441be80543ad39d6fea18 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.469267 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 67aca5375c20499888f54bbe6f02e782 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.470161 25617 tablet_service.cc:1511] Processing CreateTablet for tablet 13321a15eeb44b459fc0df692dfe9666 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.470650 25695 tablet_service.cc:1511] Processing CreateTablet for tablet 67aca5375c20499888f54bbe6f02e782 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.471539 25622 tablet_service.cc:1511] Processing CreateTablet for tablet 488b8dd8183244ff8de304037a67e0e7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.472141 25695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67aca5375c20499888f54bbe6f02e782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.471864 25619 tablet_service.cc:1511] Processing CreateTablet for tablet 57847ad165734a658705ff4fec9429b7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.459467 25623 tablet_service.cc:1511] Processing CreateTablet for tablet 0dc4d5f79bdd482c930bcfd597054306 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.473770 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 50c7912f33aa4f88ba30bc22f7eab8d2 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.474366 25696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b8dd8183244ff8de304037a67e0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.475092 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c7912f33aa4f88ba30bc22f7eab8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.477208 25689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ffa666437441be80543ad39d6fea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.478404 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 13321a15eeb44b459fc0df692dfe9666 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.480156 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13321a15eeb44b459fc0df692dfe9666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.464576 25618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98b8e722d184b05924f020ed53513ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.482344 25692 tablet_service.cc:1511] Processing CreateTablet for tablet d98b8e722d184b05924f020ed53513ac (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.484112 25692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98b8e722d184b05924f020ed53513ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.490271 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dc4d5f79bdd482c930bcfd597054306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.493621 25620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace9a99cb0cc4d74af0e883b304a6deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.497252 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67aca5375c20499888f54bbe6f02e782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.498518 25546 tablet_service.cc:1511] Processing CreateTablet for tablet 67aca5375c20499888f54bbe6f02e782 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.500200 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67aca5375c20499888f54bbe6f02e782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.501252 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488b8dd8183244ff8de304037a67e0e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.505249 25617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13321a15eeb44b459fc0df692dfe9666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.506701 25545 tablet_service.cc:1511] Processing CreateTablet for tablet ace9a99cb0cc4d74af0e883b304a6deb (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.508375 25545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ace9a99cb0cc4d74af0e883b304a6deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.509159 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57847ad165734a658705ff4fec9429b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.513222 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ffa666437441be80543ad39d6fea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.513180 25544 tablet_service.cc:1511] Processing CreateTablet for tablet 57847ad165734a658705ff4fec9429b7 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.514743 25544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57847ad165734a658705ff4fec9429b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.517554 25543 tablet_service.cc:1511] Processing CreateTablet for tablet d98b8e722d184b05924f020ed53513ac (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.518746 25616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c7912f33aa4f88ba30bc22f7eab8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.519078 25543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d98b8e722d184b05924f020ed53513ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.565730 25747 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:15.566242 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 50c7912f33aa4f88ba30bc22f7eab8d2 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.568068 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50c7912f33aa4f88ba30bc22f7eab8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.570331 25540 tablet_service.cc:1511] Processing CreateTablet for tablet d0ffa666437441be80543ad39d6fea18 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.572072 25540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0ffa666437441be80543ad39d6fea18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.572963 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 13321a15eeb44b459fc0df692dfe9666 (DEFAULT_TABLE table=test-workload [id=7317f4f7e41344c7a9568c1fc98ed508]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.574695 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13321a15eeb44b459fc0df692dfe9666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.601953 25748 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.639971 25748 tablet_bootstrap.cc:654] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.649688 25749 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.655982 25749 tablet_bootstrap.cc:654] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.658987 25747 tablet_bootstrap.cc:654] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.660900 25748 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.661509 25748 ts_tablet_manager.cc:1403] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.012s
I20260709 13:10:15.666208 25748 raft_consensus.cc:359] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.667052 25748 raft_consensus.cc:385] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.667725 25748 raft_consensus.cc:740] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.668488 25748 consensus_queue.cc:260] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.671873 25748 ts_tablet_manager.cc:1434] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:10:15.672660 25732 heartbeater.cc:499] Master 127.14.246.126:38175 was elected leader, sending a full tablet report...
I20260709 13:10:15.673069 25748 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.683470 25748 tablet_bootstrap.cc:654] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.688191 25747 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:15.688800 25747 ts_tablet_manager.cc:1403] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.012s
I20260709 13:10:15.689579 25749 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.690351 25749 ts_tablet_manager.cc:1403] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.009s
I20260709 13:10:15.691751 25747 raft_consensus.cc:359] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.692394 25747 raft_consensus.cc:385] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.692662 25747 raft_consensus.cc:740] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.693691 25747 consensus_queue.cc:260] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.695616 25749 raft_consensus.cc:359] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.696537 25749 raft_consensus.cc:385] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.696995 25749 raft_consensus.cc:740] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.697846 25748 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.698496 25748 ts_tablet_manager.cc:1403] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.009s
I20260709 13:10:15.698110 25749 consensus_queue.cc:260] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.701041 25658 heartbeater.cc:499] Master 127.14.246.126:38175 was elected leader, sending a full tablet report...
I20260709 13:10:15.701498 25749 ts_tablet_manager.cc:1434] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:15.702104 25583 heartbeater.cc:499] Master 127.14.246.126:38175 was elected leader, sending a full tablet report...
I20260709 13:10:15.701591 25748 raft_consensus.cc:359] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.702651 25748 raft_consensus.cc:385] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.702917 25749 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.702970 25748 raft_consensus.cc:740] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.704171 25748 consensus_queue.cc:260] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.706404 25748 ts_tablet_manager.cc:1434] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.707522 25748 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.709923 25749 tablet_bootstrap.cc:654] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.701503 25747 ts_tablet_manager.cc:1434] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:10:15.713972 25747 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:15.714351 25748 tablet_bootstrap.cc:654] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.720484 25752 raft_consensus.cc:493] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.721253 25752 raft_consensus.cc:515] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.747059 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
W20260709 13:10:15.749724 25672 leader_election.cc:343] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.751055 25752 leader_election.cc:290] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:15.770673 25747 tablet_bootstrap.cc:654] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.774252 25749 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.776651 25749 ts_tablet_manager.cc:1403] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.074s	user 0.043s	sys 0.028s
I20260709 13:10:15.777133 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:15.778232 25748 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.778849 25748 ts_tablet_manager.cc:1403] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.072s	user 0.035s	sys 0.033s
W20260709 13:10:15.779613 25673 leader_election.cc:343] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.780198 25673 leader_election.cc:304] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:15.780094 25749 raft_consensus.cc:359] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.780920 25749 raft_consensus.cc:385] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.781112 25752 raft_consensus.cc:2749] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.781286 25749 raft_consensus.cc:740] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.781821 25748 raft_consensus.cc:359] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.782550 25748 raft_consensus.cc:385] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.782183 25749 consensus_queue.cc:260] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.782822 25748 raft_consensus.cc:740] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.783526 25747 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:15.783622 25748 consensus_queue.cc:260] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.784161 25747 ts_tablet_manager.cc:1403] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.004s
I20260709 13:10:15.784397 25749 ts_tablet_manager.cc:1434] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:15.785486 25749 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.786020 25748 ts_tablet_manager.cc:1434] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:15.787472 25747 raft_consensus.cc:359] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.788254 25747 raft_consensus.cc:385] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.788585 25747 raft_consensus.cc:740] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.789469 25748 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.789603 25747 consensus_queue.cc:260] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.792143 25749 tablet_bootstrap.cc:654] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.794279 25747 ts_tablet_manager.cc:1434] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:15.795521 25747 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:15.796681 25748 tablet_bootstrap.cc:654] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.805477 25747 tablet_bootstrap.cc:654] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.808574 25748 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.808635 25749 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.809394 25748 ts_tablet_manager.cc:1403] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:10:15.809556 25749 ts_tablet_manager.cc:1403] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.006s
I20260709 13:10:15.812799 25748 raft_consensus.cc:359] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.813752 25748 raft_consensus.cc:385] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.814122 25748 raft_consensus.cc:740] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.813898 25749 raft_consensus.cc:359] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.815187 25749 raft_consensus.cc:385] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.815189 25748 consensus_queue.cc:260] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.815941 25749 raft_consensus.cc:740] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.817000 25749 consensus_queue.cc:260] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.817770 25748 ts_tablet_manager.cc:1434] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.818709 25747 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:15.818931 25748 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.819494 25749 ts_tablet_manager.cc:1434] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:15.819660 25755 raft_consensus.cc:493] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.820173 25755 raft_consensus.cc:515] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.820837 25749 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.826694 25748 tablet_bootstrap.cc:654] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.827339 25755 leader_election.cc:290] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:15.828107 25749 tablet_bootstrap.cc:654] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.831108 25747 ts_tablet_manager.cc:1403] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.013s
I20260709 13:10:15.835892 25747 raft_consensus.cc:359] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.842373 25749 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.843899 25747 raft_consensus.cc:385] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.844164 25749 ts_tablet_manager.cc:1403] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:10:15.844241 25747 raft_consensus.cc:740] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.847703 25749 raft_consensus.cc:359] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.848547 25749 raft_consensus.cc:385] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.849081 25749 raft_consensus.cc:740] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.848596 25747 consensus_queue.cc:260] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.850185 25749 consensus_queue.cc:260] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.859345 25747 ts_tablet_manager.cc:1434] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:10:15.859889 25749 ts_tablet_manager.cc:1434] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:10:15.861023 25749 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.863523 25747 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:15.865303 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:15.866412 25633 raft_consensus.cc:2468] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:15.868136 25524 leader_election.cc:304] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:15.869027 25755 raft_consensus.cc:2804] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.869383 25755 raft_consensus.cc:493] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.869722 25755 raft_consensus.cc:3060] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.869764 25749 tablet_bootstrap.cc:654] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.878182 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
W20260709 13:10:15.879894 25524 leader_election.cc:343] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.880936 25755 raft_consensus.cc:515] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.888541 25749 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.889394 25749 ts_tablet_manager.cc:1403] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:10:15.890499 25755 leader_election.cc:290] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:15.891129 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:15.891543 25748 tablet_bootstrap.cc:492] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.891726 25633 raft_consensus.cc:3060] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.892074 25748 ts_tablet_manager.cc:1403] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.073s	user 0.039s	sys 0.030s
I20260709 13:10:15.892001 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
W20260709 13:10:15.893591 25524 leader_election.cc:343] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.893669 25749 raft_consensus.cc:359] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.894523 25749 raft_consensus.cc:385] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.894795 25749 raft_consensus.cc:740] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.895303 25748 raft_consensus.cc:359] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.895561 25749 consensus_queue.cc:260] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.896042 25748 raft_consensus.cc:385] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.896370 25748 raft_consensus.cc:740] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.897245 25748 consensus_queue.cc:260] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.897927 25749 ts_tablet_manager.cc:1434] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:15.898597 25633 raft_consensus.cc:2468] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:15.898999 25749 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.900277 25747 tablet_bootstrap.cc:654] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.903180 25524 leader_election.cc:304] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:15.904304 25755 raft_consensus.cc:2804] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.905826 25748 ts_tablet_manager.cc:1434] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:10:15.907292 25748 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:15.907565 25749 tablet_bootstrap.cc:654] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.914969 25748 tablet_bootstrap.cc:654] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.920120 25747 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:15.920596 25747 ts_tablet_manager.cc:1403] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.006s
I20260709 13:10:15.920818 25756 raft_consensus.cc:493] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.921355 25756 raft_consensus.cc:515] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.923538 25747 raft_consensus.cc:359] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.924328 25747 raft_consensus.cc:385] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.924934 25747 raft_consensus.cc:740] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.926054 25747 consensus_queue.cc:260] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.928259 25756 leader_election.cc:290] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:15.929013 25756 raft_consensus.cc:493] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.929502 25749 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:15.924220 25755 raft_consensus.cc:697] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:15.929824 25752 raft_consensus.cc:493] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.930632 25752 raft_consensus.cc:515] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.929505 25756 raft_consensus.cc:515] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.930085 25749 ts_tablet_manager.cc:1403] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 13:10:15.934091 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:15.930804 25755 consensus_queue.cc:237] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:15.935473 25752 leader_election.cc:290] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:15.934751 25558 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 0.
I20260709 13:10:15.936494 25756 leader_election.cc:290] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:15.937199 25672 leader_election.cc:304] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
W20260709 13:10:15.929741 25504 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:15.939431 25752 raft_consensus.cc:2804] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.940004 25752 raft_consensus.cc:493] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.940507 25752 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.935181 25749 raft_consensus.cc:359] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.944945 25749 raft_consensus.cc:385] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.945268 25749 raft_consensus.cc:740] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.946691 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:15.947696 25633 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 0.
I20260709 13:10:15.948633 25748 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:15.949174 25748 ts_tablet_manager.cc:1403] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.014s
I20260709 13:10:15.951534 25749 consensus_queue.cc:260] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.953130 25748 raft_consensus.cc:359] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.953871 25748 raft_consensus.cc:385] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.954147 25748 raft_consensus.cc:740] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.954893 25748 consensus_queue.cc:260] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.957371 25747 ts_tablet_manager.cc:1434] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.012s
I20260709 13:10:15.956506 25454 catalog_manager.cc:5697] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.958490 25747 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:15.961206 25749 ts_tablet_manager.cc:1434] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:10:15.962329 25749 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:15.950058 25752 raft_consensus.cc:515] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.966043 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:15.966779 25558 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.967111 25747 tablet_bootstrap.cc:654] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.974673 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:15.974895 25558 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 1.
I20260709 13:10:15.975360 25633 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.976169 25672 leader_election.cc:304] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:15.984063 25633 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 1.
I20260709 13:10:15.986191 25752 leader_election.cc:290] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:15.987191 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:15.990911 25707 raft_consensus.cc:2468] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:15.991084 25752 raft_consensus.cc:2804] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.991621 25752 raft_consensus.cc:697] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:15.992465 25752 consensus_queue.cc:237] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:15.988109 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.000511 25749 tablet_bootstrap.cc:654] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.000969 25775 raft_consensus.cc:493] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.001730 25775 raft_consensus.cc:515] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.001062 25599 leader_election.cc:304] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.008327 25756 raft_consensus.cc:2804] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.009014 25556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.009580 25756 raft_consensus.cc:493] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.006873 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.010099 25556 raft_consensus.cc:2468] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:16.011058 25557 raft_consensus.cc:2393] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9995177579524a00a286f7d014d0a249 in current term 1: Already voted for candidate 9aa5819cb41245e982bbc556dc0a36b6 in this term.
I20260709 13:10:16.010126 25756 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.011775 25598 leader_election.cc:304] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.016584 25775 leader_election.cc:290] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.017467 25775 raft_consensus.cc:2804] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.017920 25775 raft_consensus.cc:493] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.018371 25775 raft_consensus.cc:3060] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.020203 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.021184 25748 ts_tablet_manager.cc:1434] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.072s	user 0.023s	sys 0.021s
W20260709 13:10:16.022214 25599 leader_election.cc:343] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.022447 25455 catalog_manager.cc:5697] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.024807 25756 raft_consensus.cc:515] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.022339 25748 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:16.029211 25752 raft_consensus.cc:493] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.029762 25752 raft_consensus.cc:515] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.031036 25756 leader_election.cc:290] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.020165 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.034091 25752 leader_election.cc:290] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
W20260709 13:10:16.035516 25672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:39989, user_credentials={real_user=slave}} blocked reactor thread for 59432.2us
I20260709 13:10:16.036993 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.037652 25706 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.037762 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
W20260709 13:10:16.039809 25672 leader_election.cc:343] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.043632 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.044649 25748 tablet_bootstrap.cc:654] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.047739 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.048071 25706 raft_consensus.cc:2468] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.049036 25598 leader_election.cc:304] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9995177579524a00a286f7d014d0a249; no voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:16.050153 25599 leader_election.cc:304] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
W20260709 13:10:16.050625 25598 leader_election.cc:343] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.051384 25756 raft_consensus.cc:2749] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:16.051945 25598 leader_election.cc:343] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.052315 25756 raft_consensus.cc:2804] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.053066 25756 raft_consensus.cc:697] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
W20260709 13:10:16.053366 25673 leader_election.cc:343] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.054870 25673 leader_election.cc:304] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.054261 25756 consensus_queue.cc:237] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.056103 25781 raft_consensus.cc:2749] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.059943 25747 tablet_bootstrap.cc:492] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:16.060112 25748 tablet_bootstrap.cc:492] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:16.060536 25747 ts_tablet_manager.cc:1403] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.102s	user 0.029s	sys 0.029s
I20260709 13:10:16.060684 25748 ts_tablet_manager.cc:1403] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.014s
I20260709 13:10:16.065414 25747 raft_consensus.cc:359] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.066033 25747 raft_consensus.cc:385] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.066218 25747 raft_consensus.cc:740] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.066289 25748 raft_consensus.cc:359] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:16.066745 25747 consensus_queue.cc:260] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.067098 25748 raft_consensus.cc:385] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.066483 25456 catalog_manager.cc:5697] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.067433 25748 raft_consensus.cc:740] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.068212 25748 consensus_queue.cc:260] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:16.070551 25748 ts_tablet_manager.cc:1434] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:16.071554 25748 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:16.073047 25775 raft_consensus.cc:515] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.077965 25748 tablet_bootstrap.cc:654] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.079231 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.079890 25558 raft_consensus.cc:3060] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.087800 25558 raft_consensus.cc:2468] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.089879 25598 leader_election.cc:304] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.091076 25756 raft_consensus.cc:2804] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.091666 25756 raft_consensus.cc:697] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.068612 25747 ts_tablet_manager.cc:1434] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:10:16.095824 25747 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:16.093319 25756 consensus_queue.cc:237] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.101783 25775 leader_election.cc:290] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.102689 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
W20260709 13:10:16.104251 25599 leader_election.cc:343] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.104522 25749 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:16.105125 25749 ts_tablet_manager.cc:1403] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.010s
I20260709 13:10:16.108690 25776 raft_consensus.cc:493] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.109230 25776 raft_consensus.cc:515] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.110386 25747 tablet_bootstrap.cc:654] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.111203 25776 leader_election.cc:290] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.114832 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.115492 25633 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:16.116438 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.116565 25524 leader_election.cc:304] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.117460 25776 raft_consensus.cc:2804] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.117810 25776 raft_consensus.cc:493] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.118136 25776 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:16.119900 25524 leader_election.cc:343] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.125804 25776 raft_consensus.cc:515] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.125965 25749 raft_consensus.cc:359] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.128677 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.129592 25749 raft_consensus.cc:385] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.129691 25633 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.129947 25455 catalog_manager.cc:5697] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.132694 25747 tablet_bootstrap.cc:492] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:16.130014 25749 raft_consensus.cc:740] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.133271 25747 ts_tablet_manager.cc:1403] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.012s
I20260709 13:10:16.133699 25749 consensus_queue.cc:260] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.136036 25749 ts_tablet_manager.cc:1434] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:10:16.129104 25748 tablet_bootstrap.cc:492] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:16.136445 25747 raft_consensus.cc:359] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.137091 25748 ts_tablet_manager.cc:1403] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.009s
I20260709 13:10:16.137017 25749 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:16.137326 25747 raft_consensus.cc:385] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.137856 25747 raft_consensus.cc:740] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.138614 25747 consensus_queue.cc:260] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.140976 25747 ts_tablet_manager.cc:1434] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:10:16.142074 25747 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:16.142531 25781 raft_consensus.cc:493] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.143060 25781 raft_consensus.cc:515] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.143474 25748 raft_consensus.cc:359] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.144104 25748 raft_consensus.cc:385] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.144341 25748 raft_consensus.cc:740] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.144949 25748 consensus_queue.cc:260] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.145318 25781 leader_election.cc:290] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:16.147228 25748 ts_tablet_manager.cc:1434] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:16.147004 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.147656 25749 tablet_bootstrap.cc:654] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.148226 25748 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
W20260709 13:10:16.148681 25672 leader_election.cc:343] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.152642 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
W20260709 13:10:16.154801 25673 leader_election.cc:343] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.155258 25673 leader_election.cc:304] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.156370 25752 raft_consensus.cc:2749] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.158856 25776 leader_election.cc:290] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.159086 25749 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:16.159660 25749 ts_tablet_manager.cc:1403] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:10:16.160616 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.152804 25633 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.161269 25706 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.162186 25748 tablet_bootstrap.cc:654] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.162412 25747 tablet_bootstrap.cc:654] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.162318 25749 raft_consensus.cc:359] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.163388 25749 raft_consensus.cc:385] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.163682 25749 raft_consensus.cc:740] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.164435 25749 consensus_queue.cc:260] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.165256 25524 leader_election.cc:304] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.166895 25756 raft_consensus.cc:493] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.167392 25756 raft_consensus.cc:515] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.169356 25776 raft_consensus.cc:2804] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.169531 25756 leader_election.cc:290] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.169922 25776 raft_consensus.cc:697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.170787 25776 consensus_queue.cc:237] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.171167 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.171792 25707 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:16.173084 25599 leader_election.cc:304] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.176085 25749 ts_tablet_manager.cc:1434] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:16.177592 25756 raft_consensus.cc:2804] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.178006 25756 raft_consensus.cc:493] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.178042 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.178462 25756 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.178756 25558 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:16.186074 25749 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:16.188350 25752 raft_consensus.cc:493] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.188889 25752 raft_consensus.cc:515] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.191197 25706 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.191629 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
W20260709 13:10:16.193110 25672 leader_election.cc:343] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.194136 25752 leader_election.cc:290] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:16.195930 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
W20260709 13:10:16.197537 25673 leader_election.cc:343] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.197996 25673 leader_election.cc:304] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.197718 25756 raft_consensus.cc:515] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.199184 25752 raft_consensus.cc:2749] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.200675 25749 tablet_bootstrap.cc:654] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.201118 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.201753 25558 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.202458 25748 tablet_bootstrap.cc:492] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:16.202958 25748 ts_tablet_manager.cc:1403] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.004s
I20260709 13:10:16.203264 25747 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:16.203963 25747 ts_tablet_manager.cc:1403] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.062s	user 0.029s	sys 0.013s
I20260709 13:10:16.208165 25747 raft_consensus.cc:359] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.209121 25755 raft_consensus.cc:493] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.209319 25747 raft_consensus.cc:385] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.209992 25747 raft_consensus.cc:740] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.209861 25755 raft_consensus.cc:515] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.208953 25748 raft_consensus.cc:359] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.210949 25748 raft_consensus.cc:385] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.211225 25748 raft_consensus.cc:740] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.211673 25747 consensus_queue.cc:260] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.213022 25755 leader_election.cc:290] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.213235 25748 consensus_queue.cc:260] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.215276 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.215677 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.215986 25633 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:16.216374 25706 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:16.216540 25747 ts_tablet_manager.cc:1434] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:10:16.217396 25524 leader_election.cc:304] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.217897 25747 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:16.218237 25755 raft_consensus.cc:2804] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.218667 25755 raft_consensus.cc:493] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.219017 25755 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.220170 25749 tablet_bootstrap.cc:492] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:16.220665 25749 ts_tablet_manager.cc:1403] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.004s
I20260709 13:10:16.223521 25749 raft_consensus.cc:359] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.224009 25748 ts_tablet_manager.cc:1434] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:10:16.224195 25749 raft_consensus.cc:385] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.224586 25749 raft_consensus.cc:740] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.225607 25747 tablet_bootstrap.cc:654] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.225323 25749 consensus_queue.cc:260] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.225924 25558 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.227207 25598 leader_election.cc:304] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.227445 25749 ts_tablet_manager.cc:1434] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:16.228670 25775 raft_consensus.cc:2804] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.229187 25775 raft_consensus.cc:697] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.230046 25775 consensus_queue.cc:237] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.230623 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.231279 25706 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.243340 25454 catalog_manager.cc:5697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.244939 25756 leader_election.cc:290] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.247519 25755 raft_consensus.cc:515] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.249703 25755 leader_election.cc:290] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.252677 25706 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.253149 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.253985 25633 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.255820 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.256428 25706 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.260969 25633 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.261957 25752 raft_consensus.cc:493] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.263653 25524 leader_election.cc:304] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.262696 25752 raft_consensus.cc:515] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } } peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } }
I20260709 13:10:16.266996 25747 tablet_bootstrap.cc:492] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:16.267516 25747 ts_tablet_manager.cc:1403] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.021s
I20260709 13:10:16.268303 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.268563 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dc4d5f79bdd482c930bcfd597054306" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.269194 25633 raft_consensus.cc:2393] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aa5819cb41245e982bbc556dc0a36b6 in current term 1: Already voted for candidate 2dc839aa4f604ee493132de52806638d in this term.
I20260709 13:10:16.270499 25747 raft_consensus.cc:359] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.271219 25747 raft_consensus.cc:385] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.271662 25747 raft_consensus.cc:740] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.271154 25454 catalog_manager.cc:5697] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.272328 25747 consensus_queue.cc:260] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.266870 25752 leader_election.cc:290] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989)
I20260709 13:10:16.274156 25672 leader_election.cc:304] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.264817 25755 raft_consensus.cc:2804] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.274875 25747 ts_tablet_manager.cc:1434] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:10:16.275342 25755 raft_consensus.cc:697] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.275465 25752 raft_consensus.cc:3060] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.276007 25747 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:16.276396 25706 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.276196 25755 consensus_queue.cc:237] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.281952 25752 raft_consensus.cc:2749] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.283296 25747 tablet_bootstrap.cc:654] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.287879 25747 tablet_bootstrap.cc:492] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:16.288383 25747 ts_tablet_manager.cc:1403] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:10:16.290721 25747 raft_consensus.cc:359] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.291209 25747 raft_consensus.cc:385] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.291430 25747 raft_consensus.cc:740] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.291988 25747 consensus_queue.cc:260] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.293928 25747 ts_tablet_manager.cc:1434] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:16.294533 25454 catalog_manager.cc:5697] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.312361 25755 raft_consensus.cc:493] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.312960 25755 raft_consensus.cc:515] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.315390 25755 leader_election.cc:290] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.316615 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.316623 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.317646 25633 raft_consensus.cc:2468] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:16.317680 25706 raft_consensus.cc:2468] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:16.318699 25752 raft_consensus.cc:493] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.318944 25524 leader_election.cc:304] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.319221 25752 raft_consensus.cc:515] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.319797 25755 raft_consensus.cc:2804] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.320294 25755 raft_consensus.cc:493] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.320619 25755 raft_consensus.cc:3060] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.321172 25752 leader_election.cc:290] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:16.321873 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.322530 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d98b8e722d184b05924f020ed53513ac" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:16.322755 25558 raft_consensus.cc:2393] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9aa5819cb41245e982bbc556dc0a36b6 in current term 1: Already voted for candidate 9995177579524a00a286f7d014d0a249 in this term.
I20260709 13:10:16.323908 25673 leader_election.cc:304] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.324542 25752 raft_consensus.cc:3060] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.328207 25755 raft_consensus.cc:515] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.330530 25755 leader_election.cc:290] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.331739 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.332010 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67aca5375c20499888f54bbe6f02e782" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.332365 25633 raft_consensus.cc:3060] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.332705 25706 raft_consensus.cc:3060] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.333442 25752 raft_consensus.cc:2749] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.337641 25633 raft_consensus.cc:2468] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.338075 25706 raft_consensus.cc:2468] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:16.338802 25524 leader_election.cc:304] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.339555 25755 raft_consensus.cc:2804] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.340019 25755 raft_consensus.cc:697] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.340899 25755 consensus_queue.cc:237] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.348613 25454 catalog_manager.cc:5697] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.451192 25775 raft_consensus.cc:493] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.451759 25775 raft_consensus.cc:515] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.453426 25775 leader_election.cc:290] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.454275 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:16.454478 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:16.455014 25558 raft_consensus.cc:2468] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:16.455051 25706 raft_consensus.cc:2468] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:16.456125 25599 leader_election.cc:304] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.456813 25775 raft_consensus.cc:2804] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.457166 25775 raft_consensus.cc:493] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.457469 25775 raft_consensus.cc:3060] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.457459 25755 consensus_queue.cc:1048] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.464047 25775 raft_consensus.cc:515] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.466332 25775 leader_election.cc:290] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.466917 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.467657 25707 raft_consensus.cc:3060] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.470412 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57847ad165734a658705ff4fec9429b7" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.471036 25558 raft_consensus.cc:3060] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.477130 25558 raft_consensus.cc:2468] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.478380 25598 leader_election.cc:304] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.479173 25775 raft_consensus.cc:2804] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.480351 25775 raft_consensus.cc:697] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.480973 25776 consensus_queue.cc:1048] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.481127 25707 raft_consensus.cc:2468] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:16.482434 25775 consensus_queue.cc:237] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.490862 25454 catalog_manager.cc:5697] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.495348 25775 consensus_queue.cc:1048] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.495582 25558 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.505227 25756 consensus_queue.cc:1048] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.540297 25752 consensus_queue.cc:1048] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.550428 25752 consensus_queue.cc:1048] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.589071 25707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
mode: GRACEFUL
new_leader_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:41306
I20260709 13:10:16.589623 25707 raft_consensus.cc:606] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Received request to transfer leadership to TS 2dc839aa4f604ee493132de52806638d
I20260709 13:10:16.605595 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb"
dest_uuid: "9995177579524a00a286f7d014d0a249"
mode: GRACEFUL
new_leader_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:58478
I20260709 13:10:16.606132 25633 raft_consensus.cc:606] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Received request to transfer leadership to TS 2dc839aa4f604ee493132de52806638d
I20260709 13:10:16.624696 25558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:10:16.625278 25558 raft_consensus.cc:606] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Received request to transfer leadership to TS 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.630236 25558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:10:16.630713 25558 raft_consensus.cc:606] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Received request to transfer leadership to TS 9995177579524a00a286f7d014d0a249
I20260709 13:10:16.635564 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18"
dest_uuid: "9995177579524a00a286f7d014d0a249"
mode: GRACEFUL
new_leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:58478
I20260709 13:10:16.636045 25633 raft_consensus.cc:606] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Received request to transfer leadership to TS 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:16.660337 25756 consensus_queue.cc:1048] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.667399 25776 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.673743 25775 consensus_queue.cc:1048] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.676811 25776 consensus_queue.cc:1048] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.686915 25755 raft_consensus.cc:993] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:16.687410 25755 raft_consensus.cc:1081] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Signalling peer 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:16.689620 25632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2"
dest_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:10:16.690318 25632 raft_consensus.cc:493] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.690728 25632 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.702948 25755 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.702893 25632 raft_consensus.cc:515] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.703461 25770 consensus_queue.cc:1048] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.708094 25632 leader_election.cc:290] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.708185 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.709004 25558 raft_consensus.cc:3055] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.709712 25558 raft_consensus.cc:740] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.710723 25558 consensus_queue.cc:260] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.711444 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.711911 25558 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.722543 25776 raft_consensus.cc:993] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:16.723166 25755 raft_consensus.cc:1081] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Signalling peer 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:16.723760 25558 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:16.724987 25633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666"
dest_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:10:16.725656 25633 raft_consensus.cc:493] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.725688 25598 leader_election.cc:304] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:16.726150 25633 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.726667 25775 raft_consensus.cc:2804] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.727226 25775 raft_consensus.cc:697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.728161 25775 consensus_queue.cc:237] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.730630 25755 consensus_queue.cc:1048] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.736644 25633 raft_consensus.cc:515] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.739784 25783 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.739915 25633 leader_election.cc:290] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.741412 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.742054 25707 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.744755 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13321a15eeb44b459fc0df692dfe9666" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.745478 25558 raft_consensus.cc:3055] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.745783 25558 raft_consensus.cc:740] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.746677 25558 consensus_queue.cc:260] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.751919 25707 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:16.753363 25599 leader_election.cc:304] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.754222 25756 raft_consensus.cc:2804] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.754884 25756 raft_consensus.cc:697] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.747792 25558 raft_consensus.cc:3060] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.755721 25756 consensus_queue.cc:237] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.757615 25456 catalog_manager.cc:5697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 1 to 2, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.764261 25558 raft_consensus.cc:2468] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:16.765725 25775 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.769922 25755 consensus_queue.cc:1048] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.779071 25756 raft_consensus.cc:993] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: : Instructing follower 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:16.779620 25756 raft_consensus.cc:1081] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Signalling peer 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:16.781972 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:38020
I20260709 13:10:16.782807 25558 raft_consensus.cc:493] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.783404 25558 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.783368 25455 catalog_manager.cc:5697] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 1 to 2, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.792138 25558 raft_consensus.cc:515] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.794250 25558 leader_election.cc:290] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.795029 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.795334 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.795732 25632 raft_consensus.cc:3055] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.795876 25706 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.796109 25632 raft_consensus.cc:740] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.797003 25632 consensus_queue.cc:260] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.798116 25632 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.804340 25706 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:16.805562 25632 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:16.805680 25524 leader_election.cc:304] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:16.806646 25776 raft_consensus.cc:2804] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.807196 25776 raft_consensus.cc:697] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.807986 25776 consensus_queue.cc:237] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.814456 25455 catalog_manager.cc:5697] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 1 to 2, leader changed from 9995177579524a00a286f7d014d0a249 (127.14.246.66) to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 2 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.939785 25813 raft_consensus.cc:993] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: : Instructing follower 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:16.940375 25752 raft_consensus.cc:1081] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Signalling peer 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:16.942052 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:38010
I20260709 13:10:16.942633 25558 raft_consensus.cc:493] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.942965 25558 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.948156 25558 raft_consensus.cc:515] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.949973 25558 leader_election.cc:290] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:16.950958 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.951156 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "488b8dd8183244ff8de304037a67e0e7" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:16.951769 25706 raft_consensus.cc:3055] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.951740 25632 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.952417 25706 raft_consensus.cc:740] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:16.953397 25706 consensus_queue.cc:260] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.954797 25706 raft_consensus.cc:3060] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.960103 25632 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:16.961484 25524 leader_election.cc:304] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:16.962215 25776 raft_consensus.cc:2804] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.962455 25706 raft_consensus.cc:2468] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:16.962613 25776 raft_consensus.cc:697] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:16.963660 25776 consensus_queue.cc:237] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.969642 25455 catalog_manager.cc:5697] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 1 to 2, leader changed from 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67) to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 2 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.986486 25756 raft_consensus.cc:993] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: : Instructing follower 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:16.986931 25775 raft_consensus.cc:1081] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Signalling peer 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:16.988543 25706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:41296
I20260709 13:10:16.989066 25706 raft_consensus.cc:493] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.989344 25706 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.993964 25706 raft_consensus.cc:515] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:16.995457 25706 leader_election.cc:290] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:16.996441 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:16.996713 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0ffa666437441be80543ad39d6fea18" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:16.997270 25558 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.997499 25632 raft_consensus.cc:3055] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.997933 25632 raft_consensus.cc:740] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:16.998842 25632 consensus_queue.cc:260] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:17.000258 25632 raft_consensus.cc:3060] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.005000 25558 raft_consensus.cc:2468] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:17.006455 25672 leader_election.cc:304] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:17.007169 25752 raft_consensus.cc:2804] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.007733 25752 raft_consensus.cc:697] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:17.007849 25632 raft_consensus.cc:2468] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:17.008744 25752 consensus_queue.cc:237] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:17.015395 25455 catalog_manager.cc:5697] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 1 to 2, leader changed from 9995177579524a00a286f7d014d0a249 (127.14.246.66) to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.101454 25775 consensus_queue.cc:1048] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.113785 25830 consensus_queue.cc:1048] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.205011 25706 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.210127 25706 raft_consensus.cc:1275] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.211483 25830 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.219151 25558 raft_consensus.cc:1275] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.220574 25810 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.241420 25706 raft_consensus.cc:1275] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.242933 25810 consensus_queue.cc:1048] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.246742 25707 raft_consensus.cc:1275] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.248375 25776 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:17.257856 25558 raft_consensus.cc:1275] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.260277 25783 consensus_queue.cc:1048] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.262041 25632 raft_consensus.cc:1275] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.263978 25755 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.350920 25707 raft_consensus.cc:1275] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.352080 25755 consensus_queue.cc:1048] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.359797 25632 raft_consensus.cc:1275] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.361315 25776 consensus_queue.cc:1048] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.421707 25558 raft_consensus.cc:1275] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.423100 25752 consensus_queue.cc:1048] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.431645 25632 raft_consensus.cc:1275] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.433332 25752 consensus_queue.cc:1048] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.745329 25454 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60562:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:19.748018 25454 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:19.802249 25546 tablet_service.cc:1511] Processing CreateTablet for tablet cb76089717f2414ba870a1354bfaf33e (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.803539 25546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76089717f2414ba870a1354bfaf33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.803534 25619 tablet_service.cc:1511] Processing CreateTablet for tablet cb76089717f2414ba870a1354bfaf33e (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.805404 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76089717f2414ba870a1354bfaf33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.806600 25692 tablet_service.cc:1511] Processing CreateTablet for tablet cb76089717f2414ba870a1354bfaf33e (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.807907 25692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb76089717f2414ba870a1354bfaf33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.816072 25690 tablet_service.cc:1511] Processing CreateTablet for tablet 00598a9298e84d98a3ab2d3f66478671 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.816512 25618 tablet_service.cc:1511] Processing CreateTablet for tablet 00598a9298e84d98a3ab2d3f66478671 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.817608 25690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00598a9298e84d98a3ab2d3f66478671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.817765 25618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00598a9298e84d98a3ab2d3f66478671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.820628 25697 tablet_service.cc:1511] Processing CreateTablet for tablet 0be441787fec46019d9c28a166906f5d (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.822036 25697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be441787fec46019d9c28a166906f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.821776 25621 tablet_service.cc:1511] Processing CreateTablet for tablet 0be441787fec46019d9c28a166906f5d (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.823060 25621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be441787fec46019d9c28a166906f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.825743 25689 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9276a806f84d93aac577885a367327 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.827222 25689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9276a806f84d93aac577885a367327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.830735 25623 tablet_service.cc:1511] Processing CreateTablet for tablet 321da1503f4341fabeb8f01d2501d75a (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.832037 25623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321da1503f4341fabeb8f01d2501d75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.825742 25617 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9276a806f84d93aac577885a367327 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.833796 25616 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe4ad9501db4257a237dc09db23b516 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.835224 25617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9276a806f84d93aac577885a367327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.836948 25696 tablet_service.cc:1511] Processing CreateTablet for tablet 321da1503f4341fabeb8f01d2501d75a (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.837443 25616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe4ad9501db4257a237dc09db23b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.838235 25696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321da1503f4341fabeb8f01d2501d75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.841797 25693 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe4ad9501db4257a237dc09db23b516 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.843098 25693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe4ad9501db4257a237dc09db23b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.843858 25620 tablet_service.cc:1511] Processing CreateTablet for tablet 8af6f01db673458a895653978a156ab4 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.845533 25620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af6f01db673458a895653978a156ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.847131 25622 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8c67aaafb24ece8c59c7038b1326ed (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.848395 25622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c67aaafb24ece8c59c7038b1326ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.849750 25615 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd1e17ddaf44938afc28dc0cf2785c0 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.851001 25615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1e17ddaf44938afc28dc0cf2785c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.845717 25695 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd1e17ddaf44938afc28dc0cf2785c0 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.854305 25695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1e17ddaf44938afc28dc0cf2785c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.859078 25544 tablet_service.cc:1511] Processing CreateTablet for tablet 0be441787fec46019d9c28a166906f5d (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.859741 25540 tablet_service.cc:1511] Processing CreateTablet for tablet 00598a9298e84d98a3ab2d3f66478671 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.860401 25544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be441787fec46019d9c28a166906f5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.861447 25540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00598a9298e84d98a3ab2d3f66478671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.862114 25541 tablet_service.cc:1511] Processing CreateTablet for tablet 5c9276a806f84d93aac577885a367327 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.862826 25545 tablet_service.cc:1511] Processing CreateTablet for tablet 5fe4ad9501db4257a237dc09db23b516 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.863392 25541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c9276a806f84d93aac577885a367327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.864042 25545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fe4ad9501db4257a237dc09db23b516. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.865255 25542 tablet_service.cc:1511] Processing CreateTablet for tablet 321da1503f4341fabeb8f01d2501d75a (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.866490 25542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 321da1503f4341fabeb8f01d2501d75a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.868019 25543 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8c67aaafb24ece8c59c7038b1326ed (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.866122 25547 tablet_service.cc:1511] Processing CreateTablet for tablet 5bd1e17ddaf44938afc28dc0cf2785c0 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.869271 25543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c67aaafb24ece8c59c7038b1326ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.869863 25547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1e17ddaf44938afc28dc0cf2785c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.871717 25548 tablet_service.cc:1511] Processing CreateTablet for tablet 8af6f01db673458a895653978a156ab4 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.872906 25548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af6f01db673458a895653978a156ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.878621 25691 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8c67aaafb24ece8c59c7038b1326ed (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.879937 25691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8c67aaafb24ece8c59c7038b1326ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.882085 25694 tablet_service.cc:1511] Processing CreateTablet for tablet 8af6f01db673458a895653978a156ab4 (DEFAULT_TABLE table=soft_deleted_table [id=f83c35fbcc074e13942b77a087959623]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.883332 25694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8af6f01db673458a895653978a156ab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.916819 25854 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:19.952891 25854 tablet_bootstrap.cc:654] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:19.929836 25524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:37667, user_credentials={real_user=slave}} blocked reactor thread for 55185.2us
I20260709 13:10:19.990291 25857 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.002533 25856 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.003611 25854 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.004230 25854 ts_tablet_manager.cc:1403] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.005s
I20260709 13:10:20.007396 25854 raft_consensus.cc:359] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.008227 25854 raft_consensus.cc:385] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.008590 25854 raft_consensus.cc:740] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.999909 25857 tablet_bootstrap.cc:654] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.009406 25854 consensus_queue.cc:260] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.010035 25856 tablet_bootstrap.cc:654] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.012409 25854 ts_tablet_manager.cc:1434] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:20.013504 25854 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.024719 25854 tablet_bootstrap.cc:654] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.025882 25856 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.026479 25856 ts_tablet_manager.cc:1403] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:10:20.029584 25856 raft_consensus.cc:359] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.030265 25856 raft_consensus.cc:385] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.030520 25856 raft_consensus.cc:740] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.031132 25856 consensus_queue.cc:260] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.032996 25856 ts_tablet_manager.cc:1434] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:20.034021 25856 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.034840 25857 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.035604 25857 ts_tablet_manager.cc:1403] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.009s
I20260709 13:10:20.041759 25856 tablet_bootstrap.cc:654] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.039980 25857 raft_consensus.cc:359] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.043915 25857 raft_consensus.cc:385] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.044294 25857 raft_consensus.cc:740] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.045123 25857 consensus_queue.cc:260] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.045782 25854 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.046358 25854 ts_tablet_manager.cc:1403] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.007s
I20260709 13:10:20.047567 25857 ts_tablet_manager.cc:1434] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:20.049484 25854 raft_consensus.cc:359] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.050048 25857 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.050360 25854 raft_consensus.cc:385] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.050727 25854 raft_consensus.cc:740] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.051628 25854 consensus_queue.cc:260] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.057483 25857 tablet_bootstrap.cc:654] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.058097 25854 ts_tablet_manager.cc:1434] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:20.060024 25854 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.060343 25856 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.060992 25856 ts_tablet_manager.cc:1403] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 13:10:20.063937 25856 raft_consensus.cc:359] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.064747 25856 raft_consensus.cc:385] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.065176 25856 raft_consensus.cc:740] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.069264 25854 tablet_bootstrap.cc:654] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.070806 25857 tablet_bootstrap.cc:492] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.071419 25857 ts_tablet_manager.cc:1403] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:10:20.069027 25856 consensus_queue.cc:260] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.074227 25856 ts_tablet_manager.cc:1434] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:20.075556 25856 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.077819 25857 raft_consensus.cc:359] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.078830 25857 raft_consensus.cc:385] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.079161 25857 raft_consensus.cc:740] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.080000 25857 consensus_queue.cc:260] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.082338 25857 ts_tablet_manager.cc:1434] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:10:20.083282 25857 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.085798 25854 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.086383 25854 ts_tablet_manager.cc:1403] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.003s
I20260709 13:10:20.090032 25857 tablet_bootstrap.cc:654] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.089637 25854 raft_consensus.cc:359] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.090512 25854 raft_consensus.cc:385] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.090843 25854 raft_consensus.cc:740] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.090977 25856 tablet_bootstrap.cc:654] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.091682 25854 consensus_queue.cc:260] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.094643 25854 ts_tablet_manager.cc:1434] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:20.096298 25854 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.102003 25857 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.102564 25857 ts_tablet_manager.cc:1403] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.016s
I20260709 13:10:20.103536 25854 tablet_bootstrap.cc:654] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.106639 25857 raft_consensus.cc:359] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.107491 25857 raft_consensus.cc:385] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.107861 25857 raft_consensus.cc:740] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.108860 25857 consensus_queue.cc:260] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.111977 25857 ts_tablet_manager.cc:1434] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:20.114077 25857 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.115931 25856 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.116505 25856 ts_tablet_manager.cc:1403] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.009s
I20260709 13:10:20.119856 25856 raft_consensus.cc:359] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.120674 25856 raft_consensus.cc:385] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.121011 25856 raft_consensus.cc:740] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.123047 25857 tablet_bootstrap.cc:654] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.123596 25856 consensus_queue.cc:260] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.143167 25854 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.143167 25857 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.144019 25854 ts_tablet_manager.cc:1403] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.024s
I20260709 13:10:20.144019 25857 ts_tablet_manager.cc:1403] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260709 13:10:20.144889 25856 ts_tablet_manager.cc:1434] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:10:20.145922 25856 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.147500 25857 raft_consensus.cc:359] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.147714 25854 raft_consensus.cc:359] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.148371 25857 raft_consensus.cc:385] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.148531 25854 raft_consensus.cc:385] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.148847 25857 raft_consensus.cc:740] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.148974 25854 raft_consensus.cc:740] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.149892 25857 consensus_queue.cc:260] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.151085 25854 consensus_queue.cc:260] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.151697 25857 ts_tablet_manager.cc:1434] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:20.153172 25857 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.153656 25854 ts_tablet_manager.cc:1434] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:20.154457 25856 tablet_bootstrap.cc:654] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.154830 25854 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.160277 25857 tablet_bootstrap.cc:654] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.162178 25854 tablet_bootstrap.cc:654] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.168653 25856 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.169183 25856 ts_tablet_manager.cc:1403] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 13:10:20.173389 25857 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.174046 25857 ts_tablet_manager.cc:1403] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 13:10:20.176482 25854 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.176177 25856 raft_consensus.cc:359] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.177022 25856 raft_consensus.cc:385] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.177170 25854 ts_tablet_manager.cc:1403] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:10:20.177345 25856 raft_consensus.cc:740] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.180128 25854 raft_consensus.cc:359] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.180757 25854 raft_consensus.cc:385] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.181141 25854 raft_consensus.cc:740] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.177359 25857 raft_consensus.cc:359] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.181874 25857 raft_consensus.cc:385] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.182197 25857 raft_consensus.cc:740] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.182044 25854 consensus_queue.cc:260] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.183084 25857 consensus_queue.cc:260] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.184525 25854 ts_tablet_manager.cc:1434] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:20.185595 25854 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.186038 25857 ts_tablet_manager.cc:1434] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:10:20.187052 25857 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.180351 25856 consensus_queue.cc:260] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.191069 25856 ts_tablet_manager.cc:1434] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
W20260709 13:10:20.191627 25504 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:20.192240 25856 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.193395 25857 tablet_bootstrap.cc:654] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.193691 25854 tablet_bootstrap.cc:654] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.204433 25856 tablet_bootstrap.cc:654] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.205808 25854 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.206063 25857 tablet_bootstrap.cc:492] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.206406 25854 ts_tablet_manager.cc:1403] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:10:20.206604 25857 ts_tablet_manager.cc:1403] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:10:20.209844 25857 raft_consensus.cc:359] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.210150 25854 raft_consensus.cc:359] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.210602 25857 raft_consensus.cc:385] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.211313 25854 raft_consensus.cc:385] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.211380 25857 raft_consensus.cc:740] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.211719 25854 raft_consensus.cc:740] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.212284 25857 consensus_queue.cc:260] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.212534 25854 consensus_queue.cc:260] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
W20260709 13:10:20.214344 25579 debug-util.cc:398] Leaking SignalData structure 0x7b08002113e0 after lost signal to thread 15324
I20260709 13:10:20.214736 25857 ts_tablet_manager.cc:1434] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:20.215657 25854 ts_tablet_manager.cc:1434] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:20.215708 25857 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.216715 25854 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.218294 25856 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
W20260709 13:10:20.216737 25579 debug-util.cc:398] Leaking SignalData structure 0x7b0800151fa0 after lost signal to thread 25582
I20260709 13:10:20.219046 25856 ts_tablet_manager.cc:1403] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
W20260709 13:10:20.219960 25579 debug-util.cc:398] Leaking SignalData structure 0x7b080038ad00 after lost signal to thread 25657
W20260709 13:10:20.221546 25579 debug-util.cc:398] Leaking SignalData structure 0x7b080008e9e0 after lost signal to thread 25731
I20260709 13:10:20.222610 25856 raft_consensus.cc:359] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.223608 25856 raft_consensus.cc:385] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.224088 25854 tablet_bootstrap.cc:654] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.223688 25857 tablet_bootstrap.cc:654] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.224037 25856 raft_consensus.cc:740] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.228293 25856 consensus_queue.cc:260] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.232194 25855 raft_consensus.cc:493] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.232745 25855 raft_consensus.cc:515] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.236601 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00598a9298e84d98a3ab2d3f66478671" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.237411 25707 raft_consensus.cc:2468] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.234951 25855 leader_election.cc:290] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.239473 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00598a9298e84d98a3ab2d3f66478671" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.240152 25631 raft_consensus.cc:2468] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.241443 25524 leader_election.cc:304] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.243062 25855 raft_consensus.cc:2804] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.243418 25855 raft_consensus.cc:493] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.243736 25855 raft_consensus.cc:3060] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.256567 25855 raft_consensus.cc:515] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.232229 25856 ts_tablet_manager.cc:1434] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:10:20.259624 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00598a9298e84d98a3ab2d3f66478671" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.260576 25631 raft_consensus.cc:3060] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.261019 25856 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.266530 25776 raft_consensus.cc:493] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.267154 25776 raft_consensus.cc:515] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.270370 25776 leader_election.cc:290] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.271142 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.271535 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
W20260709 13:10:20.272636 25524 leader_election.cc:343] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.273028 25857 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.273600 25857 ts_tablet_manager.cc:1403] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.020s
I20260709 13:10:20.273052 25855 leader_election.cc:290] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
W20260709 13:10:20.273869 25524 leader_election.cc:343] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.274521 25855 raft_consensus.cc:493] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.274600 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00598a9298e84d98a3ab2d3f66478671" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.275069 25855 raft_consensus.cc:515] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.275432 25707 raft_consensus.cc:3060] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.276537 25841 raft_consensus.cc:493] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.276466 25857 raft_consensus.cc:359] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.278252 25857 raft_consensus.cc:385] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.278007 25841 raft_consensus.cc:515] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.278553 25857 raft_consensus.cc:740] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.279206 25854 tablet_bootstrap.cc:492] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.279762 25854 ts_tablet_manager.cc:1403] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.063s	user 0.025s	sys 0.026s
I20260709 13:10:20.279302 25857 consensus_queue.cc:260] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.274561 25524 leader_election.cc:304] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2dc839aa4f604ee493132de52806638d; no voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:20.281455 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.288525 25855 leader_election.cc:290] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
W20260709 13:10:20.289961 25673 leader_election.cc:343] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.281747 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
W20260709 13:10:20.292269 25672 leader_election.cc:343] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.293043 25672 leader_election.cc:304] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9aa5819cb41245e982bbc556dc0a36b6; no voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249
I20260709 13:10:20.280349 25841 leader_election.cc:290] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:20.294697 25855 raft_consensus.cc:2749] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.295049 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.273787 25631 raft_consensus.cc:2468] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.287699 25707 raft_consensus.cc:2468] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.292107 25854 raft_consensus.cc:359] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.287508 25856 tablet_bootstrap.cc:654] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.298563 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.299425 25706 raft_consensus.cc:2468] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.300480 25854 raft_consensus.cc:385] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.300846 25854 raft_consensus.cc:740] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.301647 25854 consensus_queue.cc:260] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.304502 25841 raft_consensus.cc:2749] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.307514 25854 ts_tablet_manager.cc:1434] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:10:20.308693 25854 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.311247 25856 tablet_bootstrap.cc:492] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.311743 25856 ts_tablet_manager.cc:1403] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.005s
I20260709 13:10:20.314795 25856 raft_consensus.cc:359] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.315502 25854 tablet_bootstrap.cc:654] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.315496 25856 raft_consensus.cc:385] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.316138 25856 raft_consensus.cc:740] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.316972 25856 consensus_queue.cc:260] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.319101 25524 leader_election.cc:304] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.322008 25855 raft_consensus.cc:2804] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.322554 25855 raft_consensus.cc:697] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:20.323397 25855 consensus_queue.cc:237] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.326954 25776 raft_consensus.cc:493] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.327493 25776 raft_consensus.cc:515] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.329545 25776 leader_election.cc:290] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.322139 25524 leader_election.cc:304] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.319382 25857 ts_tablet_manager.cc:1434] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.045s	user 0.013s	sys 0.007s
I20260709 13:10:20.331457 25776 raft_consensus.cc:2804] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.331581 25856 ts_tablet_manager.cc:1434] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:10:20.340293 25854 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.332006 25776 raft_consensus.cc:493] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.340036 25857 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.354054 25854 ts_tablet_manager.cc:1403] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.009s
I20260709 13:10:20.354054 25776 raft_consensus.cc:3060] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.357095 25854 raft_consensus.cc:359] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
W20260709 13:10:20.346093 25672 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:39989, user_credentials={real_user=slave}} blocked reactor thread for 53884.5us
W20260709 13:10:20.331581 25524 leader_election.cc:343] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.357815 25854 raft_consensus.cc:385] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.349561 25456 catalog_manager.cc:5697] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.363947 25857 tablet_bootstrap.cc:654] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.360370 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.363999 25776 raft_consensus.cc:515] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.364807 25631 raft_consensus.cc:2468] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.360800 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.366540 25776 leader_election.cc:290] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.360373 25854 raft_consensus.cc:740] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.369112 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.369302 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.368089 25854 consensus_queue.cc:260] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.369921 25857 tablet_bootstrap.cc:492] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.369915 25706 raft_consensus.cc:3060] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.371112 25854 ts_tablet_manager.cc:1434] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:20.372052 25857 ts_tablet_manager.cc:1403] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 13:10:20.372581 25854 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: Bootstrap starting.
I20260709 13:10:20.374974 25857 raft_consensus.cc:359] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.359488 25856 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.377763 25854 tablet_bootstrap.cc:654] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.375634 25857 raft_consensus.cc:385] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.378198 25857 raft_consensus.cc:740] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.378978 25706 raft_consensus.cc:2468] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
W20260709 13:10:20.377094 25524 leader_election.cc:343] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.378988 25857 consensus_queue.cc:260] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.380141 25524 leader_election.cc:304] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:20.380949 25776 raft_consensus.cc:2804] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.381696 25857 ts_tablet_manager.cc:1434] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:20.382103 25776 raft_consensus.cc:493] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.382475 25776 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.382994 25857 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: Bootstrap starting.
I20260709 13:10:20.381608 25756 raft_consensus.cc:493] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.385784 25756 raft_consensus.cc:515] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
W20260709 13:10:20.397552 25524 leader_election.cc:343] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.407884 25855 raft_consensus.cc:493] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.408783 25878 raft_consensus.cc:493] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.408607 25855 raft_consensus.cc:515] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.409382 25878 raft_consensus.cc:515] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.410844 25855 leader_election.cc:290] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.411571 25878 leader_election.cc:290] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:20.414453 25886 raft_consensus.cc:493] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.412680 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.413123 25857 tablet_bootstrap.cc:654] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.415537 25706 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.415645 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.413187 25756 leader_election.cc:290] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.413913 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.417732 25558 raft_consensus.cc:2468] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 0.
I20260709 13:10:20.417062 25599 leader_election.cc:304] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.418977 25672 leader_election.cc:304] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.420141 25878 raft_consensus.cc:2804] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.420519 25878 raft_consensus.cc:493] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.420974 25878 raft_consensus.cc:3060] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.421325 25856 tablet_bootstrap.cc:654] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.424646 25756 raft_consensus.cc:2804] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.429131 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.430437 25558 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.434324 25878 raft_consensus.cc:515] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.437081 25524 leader_election.cc:304] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 9995177579524a00a286f7d014d0a249
I20260709 13:10:20.437909 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:20.438601 25558 raft_consensus.cc:3060] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.439664 25756 raft_consensus.cc:493] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.439870 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.440126 25756 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.440526 25706 raft_consensus.cc:2468] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.441037 25855 raft_consensus.cc:2804] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.414937 25886 raft_consensus.cc:515] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.443675 25631 raft_consensus.cc:2468] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 0.
I20260709 13:10:20.451386 25558 raft_consensus.cc:2468] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 1.
I20260709 13:10:20.414077 25776 raft_consensus.cc:515] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.455662 25886 leader_election.cc:290] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.456143 25672 leader_election.cc:304] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.456897 25854 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: No bootstrap required, opened a new log
I20260709 13:10:20.457198 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.457412 25854 ts_tablet_manager.cc:1403] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.013s
I20260709 13:10:20.458029 25706 raft_consensus.cc:2393] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9995177579524a00a286f7d014d0a249 in current term 1: Already voted for candidate 9aa5819cb41245e982bbc556dc0a36b6 in this term.
I20260709 13:10:20.458904 25877 raft_consensus.cc:2804] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.459038 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.459429 25877 raft_consensus.cc:697] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:20.461498 25854 raft_consensus.cc:359] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.461670 25877 consensus_queue.cc:237] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.462249 25854 raft_consensus.cc:385] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.462571 25854 raft_consensus.cc:740] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.463204 25854 consensus_queue.cc:260] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.465229 25854 ts_tablet_manager.cc:1434] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:20.465976 25886 raft_consensus.cc:493] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.461676 25630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.467108 25886 raft_consensus.cc:515] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.469367 25857 tablet_bootstrap.cc:492] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: No bootstrap required, opened a new log
I20260709 13:10:20.469872 25886 leader_election.cc:290] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.469918 25857 ts_tablet_manager.cc:1403] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.021s
I20260709 13:10:20.474184 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "321da1503f4341fabeb8f01d2501d75a" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.474707 25857 raft_consensus.cc:359] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.475107 25706 raft_consensus.cc:2468] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.475970 25887 raft_consensus.cc:493] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.476611 25887 raft_consensus.cc:515] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.477303 25599 leader_election.cc:304] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.478642 25886 raft_consensus.cc:2804] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.479187 25886 raft_consensus.cc:493] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.465106 25524 leader_election.cc:304] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.479712 25886 raft_consensus.cc:3060] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.480557 25881 raft_consensus.cc:2804] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.475674 25857 raft_consensus.cc:385] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.480993 25881 raft_consensus.cc:493] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.481083 25857 raft_consensus.cc:740] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.481439 25881 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.481850 25857 consensus_queue.cc:260] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.483979 25857 ts_tablet_manager.cc:1434] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:10:20.484565 25524 leader_election.cc:343] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.486299 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8af6f01db673458a895653978a156ab4" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.486981 25558 raft_consensus.cc:2393] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9995177579524a00a286f7d014d0a249 in current term 1: Already voted for candidate 9aa5819cb41245e982bbc556dc0a36b6 in this term.
I20260709 13:10:20.489041 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.489214 25598 leader_election.cc:304] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9995177579524a00a286f7d014d0a249; no voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:20.489961 25557 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.488185 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.490491 25881 raft_consensus.cc:515] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.491501 25706 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.492817 25881 leader_election.cc:290] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.488250 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "321da1503f4341fabeb8f01d2501d75a" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.493964 25558 raft_consensus.cc:2468] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 0.
I20260709 13:10:20.479497 25887 leader_election.cc:290] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.460137 25878 leader_election.cc:290] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:20.496652 25855 raft_consensus.cc:697] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:20.495256 25887 raft_consensus.cc:3060] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.495345 25599 leader_election.cc:304] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.499307 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.500171 25855 consensus_queue.cc:237] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.494371 25776 leader_election.cc:290] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.508635 25886 raft_consensus.cc:515] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.509399 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.509994 25633 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.510787 25886 leader_election.cc:290] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.511667 25856 tablet_bootstrap.cc:492] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.512172 25856 ts_tablet_manager.cc:1403] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.003s
I20260709 13:10:20.515194 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.516310 25706 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.517511 25856 raft_consensus.cc:359] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.518575 25856 raft_consensus.cc:385] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.518945 25856 raft_consensus.cc:740] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.520058 25856 consensus_queue.cc:260] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.517984 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "321da1503f4341fabeb8f01d2501d75a" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.524415 25707 raft_consensus.cc:3060] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.527542 25704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.528411 25704 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.531289 25706 raft_consensus.cc:2468] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.508235 25756 raft_consensus.cc:515] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.533255 25891 raft_consensus.cc:2804] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.533703 25891 raft_consensus.cc:493] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.534034 25891 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.534631 25756 leader_election.cc:290] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.537925 25887 raft_consensus.cc:2749] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.544281 25707 raft_consensus.cc:2468] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.544827 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.547122 25706 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.547060 25599 leader_election.cc:304] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.547612 25633 raft_consensus.cc:2468] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.547993 25756 raft_consensus.cc:2804] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.548365 25524 leader_election.cc:304] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.548501 25756 raft_consensus.cc:697] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:20.549233 25855 raft_consensus.cc:2804] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.549844 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "321da1503f4341fabeb8f01d2501d75a" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
W20260709 13:10:20.550100 25524 leader_election.cc:343] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.549927 25855 raft_consensus.cc:697] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:20.549489 25756 consensus_queue.cc:237] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.561651 25524 leader_election.cc:304] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:20.550969 25558 raft_consensus.cc:3060] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.563301 25890 raft_consensus.cc:2804] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.563809 25890 raft_consensus.cc:697] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:20.550153 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:20.564424 25557 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.564591 25890 consensus_queue.cc:237] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.568676 25558 raft_consensus.cc:2468] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.561792 25855 consensus_queue.cc:237] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.561765 25704 raft_consensus.cc:2468] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.571269 25856 ts_tablet_manager.cc:1434] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:10:20.576591 25856 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.583295 25454 catalog_manager.cc:5697] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 1 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.585656 25706 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.588984 25599 leader_election.cc:304] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.589756 25856 tablet_bootstrap.cc:654] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.594121 25887 raft_consensus.cc:2804] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.596524 25887 raft_consensus.cc:697] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:20.597671 25887 consensus_queue.cc:237] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.601351 25891 raft_consensus.cc:515] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.604602 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.605150 25706 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.610643 25706 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.617163 25557 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.615994 25599 leader_election.cc:304] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.612571 25891 leader_election.cc:290] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.622889 25891 raft_consensus.cc:2804] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.623653 25891 raft_consensus.cc:697] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:20.624830 25891 consensus_queue.cc:237] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.628109 25455 catalog_manager.cc:5697] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.630797 25455 catalog_manager.cc:5697] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.642668 25455 catalog_manager.cc:5697] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:20.658196 25598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:39989, user_credentials={real_user=slave}} blocked reactor thread for 62823.5us
I20260709 13:10:20.663569 25454 catalog_manager.cc:5697] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.683239 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:20.683943 25557 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.684517 25856 tablet_bootstrap.cc:492] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.685050 25856 ts_tablet_manager.cc:1403] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.111s	user 0.033s	sys 0.029s
I20260709 13:10:20.687696 25856 raft_consensus.cc:359] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.688315 25856 raft_consensus.cc:385] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.688555 25856 raft_consensus.cc:740] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.689226 25856 consensus_queue.cc:260] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.691205 25856 ts_tablet_manager.cc:1434] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:20.691989 25856 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Bootstrap starting.
I20260709 13:10:20.692317 25557 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 1.
I20260709 13:10:20.697484 25856 tablet_bootstrap.cc:654] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.697726 25454 catalog_manager.cc:5697] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.699419 25454 catalog_manager.cc:5697] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 1 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.702796 25856 tablet_bootstrap.cc:492] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: No bootstrap required, opened a new log
I20260709 13:10:20.703270 25856 ts_tablet_manager.cc:1403] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:20.706548 25855 raft_consensus.cc:493] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.706507 25856 raft_consensus.cc:359] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.707216 25856 raft_consensus.cc:385] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.707078 25855 raft_consensus.cc:515] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.707482 25856 raft_consensus.cc:740] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.708115 25856 consensus_queue.cc:260] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.709148 25855 leader_election.cc:290] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.710141 25856 ts_tablet_manager.cc:1434] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:20.711473 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.712077 25706 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.712932 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249" is_pre_election: true
I20260709 13:10:20.713153 25524 leader_election.cc:304] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:20.713577 25633 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 0.
I20260709 13:10:20.714468 25855 raft_consensus.cc:2804] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.714931 25855 raft_consensus.cc:493] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.715332 25855 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.724267 25855 raft_consensus.cc:515] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.726804 25855 leader_election.cc:290] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.727732 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:20.728091 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:20.728389 25633 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.728677 25706 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.734071 25886 raft_consensus.cc:493] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.734737 25886 raft_consensus.cc:515] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.735128 25706 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.735211 25633 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 1.
I20260709 13:10:20.736536 25524 leader_election.cc:304] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 
I20260709 13:10:20.737483 25855 raft_consensus.cc:2804] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.738525 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.738019 25886 leader_election.cc:290] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.738934 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c9276a806f84d93aac577885a367327" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.738013 25855 raft_consensus.cc:697] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:20.739737 25706 raft_consensus.cc:2393] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9995177579524a00a286f7d014d0a249 in current term 1: Already voted for candidate 2dc839aa4f604ee493132de52806638d in this term.
I20260709 13:10:20.740738 25599 leader_election.cc:304] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9995177579524a00a286f7d014d0a249; no voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:20.740649 25855 consensus_queue.cc:237] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.741576 25886 raft_consensus.cc:3060] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.748454 25886 raft_consensus.cc:2749] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.751613 25855 consensus_queue.cc:1048] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.751195 25454 catalog_manager.cc:5697] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 1 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.770429 25855 consensus_queue.cc:1048] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.827992 25886 raft_consensus.cc:493] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.828684 25886 raft_consensus.cc:515] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.831525 25886 leader_election.cc:290] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:20.831802 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2dc839aa4f604ee493132de52806638d" is_pre_election: true
I20260709 13:10:20.832156 25706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6" is_pre_election: true
I20260709 13:10:20.832921 25706 raft_consensus.cc:2393] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9995177579524a00a286f7d014d0a249 in current term 1: Already voted for candidate 2dc839aa4f604ee493132de52806638d in this term.
I20260709 13:10:20.833786 25599 leader_election.cc:304] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9995177579524a00a286f7d014d0a249; no voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:20.834468 25886 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.841027 25886 raft_consensus.cc:2749] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.913213 25633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be441787fec46019d9c28a166906f5d"
dest_uuid: "9995177579524a00a286f7d014d0a249"
mode: GRACEFUL
new_leader_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:58478
I20260709 13:10:20.913926 25633 raft_consensus.cc:606] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Received request to transfer leadership to TS 2dc839aa4f604ee493132de52806638d
I20260709 13:10:20.928413 25557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:10:20.929131 25557 raft_consensus.cc:606] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Received request to transfer leadership to TS 9995177579524a00a286f7d014d0a249
I20260709 13:10:20.935053 25855 consensus_queue.cc:1048] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.935076 25557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:38024
I20260709 13:10:20.935931 25557 raft_consensus.cc:606] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Received request to transfer leadership to TS 9995177579524a00a286f7d014d0a249
I20260709 13:10:20.954893 25881 consensus_queue.cc:1048] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.974144 25776 consensus_queue.cc:1048] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.984359 25881 raft_consensus.cc:993] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:20.984947 25881 raft_consensus.cc:1081] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Signalling peer 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:20.986719 25633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0"
dest_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:10:20.987376 25633 raft_consensus.cc:493] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.987762 25633 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.994992 25881 consensus_queue.cc:1048] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.995994 25633 raft_consensus.cc:515] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:20.999408 25557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:21.000000 25557 raft_consensus.cc:3055] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.999889 25704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bd1e17ddaf44938afc28dc0cf2785c0" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:21.000615 25557 raft_consensus.cc:740] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:21.001966 25633 leader_election.cc:290] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:21.001569 25557 consensus_queue.cc:260] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.003355 25557 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.005046 25630 raft_consensus.cc:1240] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Rejecting Update request from peer 2dc839aa4f604ee493132de52806638d for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:21.014039 25877 consensus_queue.cc:1048] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.015785 25557 raft_consensus.cc:2468] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:21.017184 25598 leader_election.cc:304] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9995177579524a00a286f7d014d0a249; no voters: 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:21.018360 25756 raft_consensus.cc:2804] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.018884 25756 raft_consensus.cc:697] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:21.019773 25756 consensus_queue.cc:237] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.030026 25454 catalog_manager.cc:5697] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 1 to 2, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.040036 25886 consensus_queue.cc:1048] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.045364 25886 consensus_queue.cc:1048] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.074672 25877 consensus_queue.cc:1048] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.095799 25886 consensus_queue.cc:1048] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.111172 25881 consensus_queue.cc:1048] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.128919 25756 consensus_queue.cc:1048] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:21.137352 25886 consensus_queue.cc:1048] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.156730 25881 consensus_queue.cc:1048] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.165081 25776 consensus_queue.cc:1048] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.179554 25886 consensus_queue.cc:1048] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.224818 25881 consensus_queue.cc:1048] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.226715 25886 raft_consensus.cc:993] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: : Instructing follower 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:21.227252 25886 raft_consensus.cc:1081] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Signalling peer 2dc839aa4f604ee493132de52806638d to start an election
I20260709 13:10:21.229128 25558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0be441787fec46019d9c28a166906f5d"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
 from {username='slave'} at 127.0.0.1:38020
I20260709 13:10:21.229655 25558 raft_consensus.cc:493] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.236620 25558 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.245361 25776 raft_consensus.cc:993] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:21.245962 25890 raft_consensus.cc:1081] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Signalling peer 9995177579524a00a286f7d014d0a249 to start an election
I20260709 13:10:21.245538 25558 raft_consensus.cc:515] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.248225 25630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed"
dest_uuid: "9995177579524a00a286f7d014d0a249"
 from {username='slave'} at 127.0.0.1:58476
I20260709 13:10:21.248471 25558 leader_election.cc:290] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Requested vote from peers 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:21.248876 25630 raft_consensus.cc:493] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.249260 25630 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.250463 25633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:21.251147 25633 raft_consensus.cc:3055] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.251204 25704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be441787fec46019d9c28a166906f5d" candidate_uuid: "2dc839aa4f604ee493132de52806638d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:21.251595 25633 raft_consensus.cc:740] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:21.251924 25704 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.252562 25633 consensus_queue.cc:260] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.254006 25633 raft_consensus.cc:3060] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.256644 25630 raft_consensus.cc:515] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.259289 25630 leader_election.cc:290] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67:37667)
I20260709 13:10:21.260494 25707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
I20260709 13:10:21.261284 25707 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.260574 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8c67aaafb24ece8c59c7038b1326ed" candidate_uuid: "9995177579524a00a286f7d014d0a249" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:21.261931 25558 raft_consensus.cc:3055] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.262248 25558 raft_consensus.cc:740] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:21.262977 25558 consensus_queue.cc:260] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.264025 25558 raft_consensus.cc:3060] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.268538 25707 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:21.269974 25599 leader_election.cc:304] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:21.270504 25558 raft_consensus.cc:2468] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9995177579524a00a286f7d014d0a249 in term 2.
I20260709 13:10:21.270879 25756 raft_consensus.cc:2804] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.271471 25756 raft_consensus.cc:697] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Becoming Leader. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:21.272351 25756 consensus_queue.cc:237] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.261302 25704 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:21.274907 25524 leader_election.cc:304] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:21.275761 25881 raft_consensus.cc:2804] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.276221 25881 raft_consensus.cc:697] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Becoming Leader. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:21.268590 25633 raft_consensus.cc:2468] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dc839aa4f604ee493132de52806638d in term 2.
I20260709 13:10:21.277052 25881 consensus_queue.cc:237] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:21.283075 25453 catalog_manager.cc:5697] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 reported cstate change: term changed from 1 to 2, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9995177579524a00a286f7d014d0a249 (127.14.246.66). New cstate: current_term: 2 leader_uuid: "9995177579524a00a286f7d014d0a249" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.285374 25456 catalog_manager.cc:5697] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d reported cstate change: term changed from 1 to 2, leader changed from 9995177579524a00a286f7d014d0a249 (127.14.246.66) to 2dc839aa4f604ee493132de52806638d (127.14.246.65). New cstate: current_term: 2 leader_uuid: "2dc839aa4f604ee493132de52806638d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.490417 25558 raft_consensus.cc:1275] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.491888 25756 consensus_queue.cc:1048] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.500000 25704 raft_consensus.cc:3060] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.509910 25704 raft_consensus.cc:1275] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.511473 25901 consensus_queue.cc:1048] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.659737 25704 raft_consensus.cc:1275] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.661234 25891 consensus_queue.cc:1048] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.672019 25558 raft_consensus.cc:1275] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9995177579524a00a286f7d014d0a249: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.677832 25901 consensus_queue.cc:1048] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.742153 25704 raft_consensus.cc:1275] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.743945 25776 consensus_queue.cc:1048] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.752090 25633 raft_consensus.cc:1275] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 2dc839aa4f604ee493132de52806638d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.755213 25881 consensus_queue.cc:1048] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.972278 25453 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60562:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:23.995033 25453 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60562:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:24.097455 25957 tablet.cc:1724] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.092978 25959 tablet.cc:1724] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.165411 25584 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:cb76089717f2414ba870a1354bfaf33e)
W20260709 13:10:24.172422 25584 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:cb76089717f2414ba870a1354bfaf33e)
W20260709 13:10:24.173544 25584 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:cb76089717f2414ba870a1354bfaf33e)
W20260709 13:10:24.222190 25952 log.cc:927] Time spent T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:10:24.233789 25965 tablet.cc:1724] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.259266 25959 tablet.cc:1724] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.282732 25957 tablet.cc:1724] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.327570 15321 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:10:24.284855 25524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:45985, user_credentials={real_user=slave}} blocked reactor thread for 52834.1us
I20260709 13:10:24.272600 25970 tablet.cc:1724] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.504437 25965 tablet.cc:1724] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.527305 25974 tablet.cc:1724] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.556967 25942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.159s	sys 0.212s
W20260709 13:10:24.557525 25942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.159s	sys 0.212s
I20260709 13:10:24.559809 25957 tablet.cc:1724] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.564956 25983 log.cc:927] Time spent T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Append to log took a long time: real 0.055s	user 0.000s	sys 0.005s
I20260709 13:10:24.580888 25992 tablet.cc:1724] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.610565 25487 debug-util.cc:398] Leaking SignalData structure 0x7b0800127000 after lost signal to thread 15324
W20260709 13:10:24.615540 25487 debug-util.cc:398] Leaking SignalData structure 0x7b080007dfa0 after lost signal to thread 25490
W20260709 13:10:24.618646 25487 debug-util.cc:398] Leaking SignalData structure 0x7b0800038520 after lost signal to thread 25582
W20260709 13:10:24.621804 25487 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5980 after lost signal to thread 25657
W20260709 13:10:24.625123 25487 debug-util.cc:398] Leaking SignalData structure 0x7b08001360a0 after lost signal to thread 25731
W20260709 13:10:24.639923 25945 log.cc:927] Time spent T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:24.646565 25959 tablet.cc:1724] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.580829 25990 tablet.cc:1724] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.693392 25995 tablet.cc:1724] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.698141 25965 tablet.cc:1724] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.713608 25996 tablet.cc:1724] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.736344 25598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:39989, user_credentials={real_user=slave}} blocked reactor thread for 237036us
W20260709 13:10:24.744762 25599 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:37667, user_credentials={real_user=slave}} blocked reactor thread for 67649.8us
I20260709 13:10:24.743705 25959 tablet.cc:1724] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.745447 25974 tablet.cc:1724] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.751137 25990 tablet.cc:1724] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.761117 25997 tablet.cc:1724] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.792452 25992 tablet.cc:1724] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.805534 25996 tablet.cc:1724] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.817351 25970 tablet.cc:1724] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.839872 25959 tablet.cc:1724] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.878809 25631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516"
dest_uuid: "9995177579524a00a286f7d014d0a249"
mode: GRACEFUL
new_leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:39882
I20260709 13:10:24.879951 25631 raft_consensus.cc:606] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Received request to transfer leadership to TS 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:24.895761 25957 tablet.cc:1724] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.913272 26005 tablet.cc:1724] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.917860 25974 tablet.cc:1724] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:24.925387 25673 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.66:45985, user_credentials={real_user=slave}} blocked reactor thread for 55820.1us
I20260709 13:10:24.942052 25957 tablet.cc:1724] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.968274 25555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:38144
I20260709 13:10:24.969074 25555 raft_consensus.cc:606] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Received request to transfer leadership to TS 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:24.971060 15321 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:24.972450 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:24.972793 25455 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: soft_deleted_table [id=f83c35fbcc074e13942b77a087959623] alter complete (version 1)
I20260709 13:10:24.995424 25631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2"
dest_uuid: "9995177579524a00a286f7d014d0a249"
mode: GRACEFUL
new_leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:39882
I20260709 13:10:24.996171 25631 raft_consensus.cc:606] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Received request to transfer leadership to TS 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:24.999495 25558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb"
dest_uuid: "2dc839aa4f604ee493132de52806638d"
mode: GRACEFUL
new_leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:38144
I20260709 13:10:25.000144 25558 raft_consensus.cc:606] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Received request to transfer leadership to TS 9aa5819cb41245e982bbc556dc0a36b6
I20260709 13:10:25.001745 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:25.002476 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.109480 25931 raft_consensus.cc:993] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.110212 25933 raft_consensus.cc:1081] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Signalling peer 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.110710 25999 raft_consensus.cc:993] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: : Instructing follower 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.111465 25999 raft_consensus.cc:1081] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Signalling peer 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.112756 25702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:10:25.113583 25702 raft_consensus.cc:493] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.114073 25702 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.114189 25703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:41292
I20260709 13:10:25.115072 25703 raft_consensus.cc:493] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.115902 25703 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.129051 25702 raft_consensus.cc:515] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.133169 25555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:25.133909 25702 leader_election.cc:290] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 3 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:25.134073 25555 raft_consensus.cc:3055] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:25.134649 25555 raft_consensus.cc:740] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:25.135798 25555 consensus_queue.cc:260] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.136588 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ace9a99cb0cc4d74af0e883b304a6deb" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:25.137673 25631 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.133188 25703 raft_consensus.cc:515] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.141319 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:25.142001 25632 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.143556 25558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb76089717f2414ba870a1354bfaf33e" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:25.144235 25558 raft_consensus.cc:3055] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:25.144532 25558 raft_consensus.cc:740] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2dc839aa4f604ee493132de52806638d, State: Running, Role: LEADER
I20260709 13:10:25.145596 25558 consensus_queue.cc:260] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.147009 25558 raft_consensus.cc:3060] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.152262 25555 raft_consensus.cc:3060] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.153033 25632 raft_consensus.cc:2468] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:25.154680 25673 leader_election.cc:304] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:25.155962 26002 raft_consensus.cc:2804] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:25.156534 26002 raft_consensus.cc:697] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:25.157720 26002 consensus_queue.cc:237] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.150466 25703 leader_election.cc:290] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:25.169694 25631 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 3.
I20260709 13:10:25.171378 25673 leader_election.cc:304] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9995177579524a00a286f7d014d0a249, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:25.172508 26002 raft_consensus.cc:2804] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.173216 26002 raft_consensus.cc:697] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:25.172279 25455 catalog_manager.cc:5697] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 1 to 2, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.174409 26002 consensus_queue.cc:237] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.180190 25998 raft_consensus.cc:993] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: : Instructing follower 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.180788 25998 raft_consensus.cc:1081] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Signalling peer 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.185020 25707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:41296
I20260709 13:10:25.185632 25707 raft_consensus.cc:493] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.186012 25707 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.193655 25558 raft_consensus.cc:2468] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:25.196983 25555 raft_consensus.cc:2468] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 3.
I20260709 13:10:25.203482 25707 raft_consensus.cc:515] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.207010 25555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:25.207839 25555 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.214713 25455 catalog_manager.cc:5697] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 2 to 3, leader changed from 2dc839aa4f604ee493132de52806638d (127.14.246.65) to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.224189 25555 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:25.225940 25672 leader_election.cc:304] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:25.227161 25918 raft_consensus.cc:2804] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:25.234411 25631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fe4ad9501db4257a237dc09db23b516" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:25.235205 25631 raft_consensus.cc:3055] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:25.235579 25631 raft_consensus.cc:740] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:25.236977 25631 consensus_queue.cc:260] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.238607 25631 raft_consensus.cc:3060] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:25.248890 25707 leader_election.cc:290] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 2 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:25.251477 25631 raft_consensus.cc:2468] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 2.
I20260709 13:10:25.240532 25918 raft_consensus.cc:697] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:25.256330 25918 consensus_queue.cc:237] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.266959 25455 catalog_manager.cc:5697] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 1 to 2, leader changed from 9995177579524a00a286f7d014d0a249 (127.14.246.66) to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 2 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.459713 25994 raft_consensus.cc:993] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: : Instructing follower 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.460224 25934 raft_consensus.cc:1081] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Signalling peer 9aa5819cb41245e982bbc556dc0a36b6 to start an election
I20260709 13:10:25.461855 25707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2"
dest_uuid: "9aa5819cb41245e982bbc556dc0a36b6"
 from {username='slave'} at 127.0.0.1:41296
I20260709 13:10:25.462368 25707 raft_consensus.cc:493] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.462710 25707 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.468024 25707 raft_consensus.cc:515] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.470404 25707 leader_election.cc:290] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 3 election: Requested vote from peers 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989), 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985)
I20260709 13:10:25.471524 25632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9995177579524a00a286f7d014d0a249"
I20260709 13:10:25.472342 25632 raft_consensus.cc:3055] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:25.472797 25632 raft_consensus.cc:740] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9995177579524a00a286f7d014d0a249, State: Running, Role: LEADER
I20260709 13:10:25.472893 25555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50c7912f33aa4f88ba30bc22f7eab8d2" candidate_uuid: "9aa5819cb41245e982bbc556dc0a36b6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2dc839aa4f604ee493132de52806638d"
I20260709 13:10:25.473403 25555 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.473873 25632 consensus_queue.cc:260] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.475601 25632 raft_consensus.cc:3060] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:25.478713 25555 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 3.
I20260709 13:10:25.479862 25672 leader_election.cc:304] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dc839aa4f604ee493132de52806638d, 9aa5819cb41245e982bbc556dc0a36b6; no voters: 
I20260709 13:10:25.480688 25918 raft_consensus.cc:2804] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:25.481160 25918 raft_consensus.cc:697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 LEADER]: Becoming Leader. State: Replica: 9aa5819cb41245e982bbc556dc0a36b6, State: Running, Role: LEADER
I20260709 13:10:25.481982 25918 consensus_queue.cc:237] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } }
I20260709 13:10:25.489562 25632 raft_consensus.cc:2468] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9aa5819cb41245e982bbc556dc0a36b6 in term 3.
I20260709 13:10:25.496518 25455 catalog_manager.cc:5697] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 reported cstate change: term changed from 2 to 3, leader changed from 9995177579524a00a286f7d014d0a249 (127.14.246.66) to 9aa5819cb41245e982bbc556dc0a36b6 (127.14.246.67). New cstate: current_term: 3 leader_uuid: "9aa5819cb41245e982bbc556dc0a36b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa5819cb41245e982bbc556dc0a36b6" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 37667 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.620015 25555 raft_consensus.cc:1275] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:25.620121 25632 raft_consensus.cc:1275] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:25.621791 25918 consensus_queue.cc:1048] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.622669 26010 consensus_queue.cc:1048] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.712905 25632 raft_consensus.cc:1275] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.714141 25918 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.725231 25555 raft_consensus.cc:1275] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.728809 25918 consensus_queue.cc:1048] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.825788 25555 raft_consensus.cc:1275] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:25.827099 25918 consensus_queue.cc:1048] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.835933 25632 raft_consensus.cc:1275] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:25.837603 26010 consensus_queue.cc:1048] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.921023 25632 raft_consensus.cc:1275] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.922245 26010 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9995177579524a00a286f7d014d0a249" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 45985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.931519 25555 raft_consensus.cc:1275] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Refusing update from remote peer 9aa5819cb41245e982bbc556dc0a36b6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:25.934211 26002 consensus_queue.cc:1048] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2dc839aa4f604ee493132de52806638d" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 39989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:26.071580 15321 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:26.080119 15321 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:26.080693 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:26.088320 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:26.088871 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:27.125602 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
I20260709 13:10:27.172317 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.173230 15321 tablet_replica.cc:333] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.174170 15321 raft_consensus.cc:2243] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.174760 15321 raft_consensus.cc:2272] T 3e8c67aaafb24ece8c59c7038b1326ed P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.177304 15321 tablet_replica.cc:333] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.177928 15321 raft_consensus.cc:2243] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.178440 15321 raft_consensus.cc:2272] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.180663 15321 tablet_replica.cc:333] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.181308 15321 raft_consensus.cc:2243] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.181833 15321 raft_consensus.cc:2272] T 321da1503f4341fabeb8f01d2501d75a P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.184187 15321 tablet_replica.cc:333] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.184834 15321 raft_consensus.cc:2243] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.185690 15321 raft_consensus.cc:2272] T 0be441787fec46019d9c28a166906f5d P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.187952 15321 tablet_replica.cc:333] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.188629 15321 raft_consensus.cc:2243] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.189090 15321 raft_consensus.cc:2272] T cb76089717f2414ba870a1354bfaf33e P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.191200 15321 tablet_replica.cc:333] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.191762 15321 raft_consensus.cc:2243] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.192582 15321 raft_consensus.cc:2272] T 00598a9298e84d98a3ab2d3f66478671 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.194828 15321 tablet_replica.cc:333] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.195444 15321 raft_consensus.cc:2243] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.195878 15321 raft_consensus.cc:2272] T d0ffa666437441be80543ad39d6fea18 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.198271 15321 tablet_replica.cc:333] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.198845 15321 raft_consensus.cc:2243] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.199311 15321 raft_consensus.cc:2272] T 57847ad165734a658705ff4fec9429b7 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.201609 15321 tablet_replica.cc:333] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.202169 15321 raft_consensus.cc:2243] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.203048 15321 raft_consensus.cc:2272] T 67aca5375c20499888f54bbe6f02e782 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.205338 15321 tablet_replica.cc:333] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.205839 15321 raft_consensus.cc:2243] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.206358 15321 raft_consensus.cc:2272] T 13321a15eeb44b459fc0df692dfe9666 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.208622 15321 tablet_replica.cc:333] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.209204 15321 raft_consensus.cc:2243] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.209676 15321 raft_consensus.cc:2272] T d98b8e722d184b05924f020ed53513ac P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.212124 15321 tablet_replica.cc:333] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.212917 15321 raft_consensus.cc:2243] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.213331 15321 raft_consensus.cc:2272] T 5fe4ad9501db4257a237dc09db23b516 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.215291 15321 tablet_replica.cc:333] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.215896 15321 raft_consensus.cc:2243] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.216300 15321 raft_consensus.cc:2272] T ace9a99cb0cc4d74af0e883b304a6deb P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.218822 15321 tablet_replica.cc:333] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.219673 15321 raft_consensus.cc:2243] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.220252 15321 raft_consensus.cc:2272] T 8af6f01db673458a895653978a156ab4 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.223397 15321 tablet_replica.cc:333] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
W20260709 13:10:27.223459 25672 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 15 similar messages]
I20260709 13:10:27.224282 15321 raft_consensus.cc:2243] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.225628 15321 raft_consensus.cc:2272] T 0dc4d5f79bdd482c930bcfd597054306 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.229851 15321 tablet_replica.cc:333] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.230885 15321 raft_consensus.cc:2243] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.232254 15321 raft_consensus.cc:2272] T 488b8dd8183244ff8de304037a67e0e7 P 2dc839aa4f604ee493132de52806638d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.236286 15321 tablet_replica.cc:333] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
I20260709 13:10:27.237402 15321 raft_consensus.cc:2243] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:10:27.238601 25672 consensus_peers.cc:597] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.238745 15321 raft_consensus.cc:2272] T 5c9276a806f84d93aac577885a367327 P 2dc839aa4f604ee493132de52806638d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.242205 15321 tablet_replica.cc:333] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d: stopping tablet replica
W20260709 13:10:27.242268 25598 consensus_peers.cc:597] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.242893 15321 raft_consensus.cc:2243] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.243371 15321 raft_consensus.cc:2272] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 2dc839aa4f604ee493132de52806638d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:27.295002 25672 consensus_peers.cc:597] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:27.297861 25672 consensus_peers.cc:597] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:27.302904 25598 consensus_peers.cc:597] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.314260 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
I20260709 13:10:27.355242 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
W20260709 13:10:27.393860 25598 consensus_peers.cc:597] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.409379 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.410584 15321 tablet_replica.cc:333] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.411602 15321 raft_consensus.cc:2243] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.412457 15321 raft_consensus.cc:2272] T 3e8c67aaafb24ece8c59c7038b1326ed P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.414997 15321 tablet_replica.cc:333] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.415701 15321 raft_consensus.cc:2243] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.416522 15321 raft_consensus.cc:2272] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.418815 15321 tablet_replica.cc:333] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.419478 15321 raft_consensus.cc:2243] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.420359 15321 raft_consensus.cc:2272] T 321da1503f4341fabeb8f01d2501d75a P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.422566 15321 tablet_replica.cc:333] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.423139 15321 raft_consensus.cc:2243] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.423591 15321 raft_consensus.cc:2272] T cb76089717f2414ba870a1354bfaf33e P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.425671 15321 tablet_replica.cc:333] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.426255 15321 raft_consensus.cc:2243] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.426769 15321 raft_consensus.cc:2272] T 00598a9298e84d98a3ab2d3f66478671 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.429257 15321 tablet_replica.cc:333] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.429913 15321 raft_consensus.cc:2243] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.430574 15321 raft_consensus.cc:2272] T 0be441787fec46019d9c28a166906f5d P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:27.431803 25673 consensus_peers.cc:597] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Couldn't send request to peer 9995177579524a00a286f7d014d0a249. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.433174 15321 tablet_replica.cc:333] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.433857 15321 raft_consensus.cc:2243] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.434729 15321 raft_consensus.cc:2272] T 57847ad165734a658705ff4fec9429b7 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.437397 15321 tablet_replica.cc:333] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.438213 15321 raft_consensus.cc:2243] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.438865 15321 raft_consensus.cc:2272] T d0ffa666437441be80543ad39d6fea18 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:27.441125 25672 consensus_peers.cc:597] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.441787 15321 tablet_replica.cc:333] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.442484 15321 raft_consensus.cc:2243] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.442973 15321 raft_consensus.cc:2272] T 8af6f01db673458a895653978a156ab4 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.445111 15321 tablet_replica.cc:333] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.445632 15321 raft_consensus.cc:2243] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.446071 15321 raft_consensus.cc:2272] T 0dc4d5f79bdd482c930bcfd597054306 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.448879 15321 tablet_replica.cc:333] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.449774 15321 raft_consensus.cc:2243] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.450476 15321 raft_consensus.cc:2272] T 488b8dd8183244ff8de304037a67e0e7 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.453970 15321 tablet_replica.cc:333] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.454746 15321 raft_consensus.cc:2243] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.455314 15321 raft_consensus.cc:2272] T 67aca5375c20499888f54bbe6f02e782 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.458124 15321 tablet_replica.cc:333] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.458673 15321 raft_consensus.cc:2243] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.459497 15321 raft_consensus.cc:2272] T 13321a15eeb44b459fc0df692dfe9666 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.461669 15321 tablet_replica.cc:333] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.462224 15321 raft_consensus.cc:2243] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.463047 15321 raft_consensus.cc:2272] T d98b8e722d184b05924f020ed53513ac P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.465207 15321 tablet_replica.cc:333] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.465713 15321 raft_consensus.cc:2243] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.466109 15321 raft_consensus.cc:2272] T 5fe4ad9501db4257a237dc09db23b516 P 9995177579524a00a286f7d014d0a249 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.468200 15321 tablet_replica.cc:333] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.468719 15321 raft_consensus.cc:2243] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.469280 15321 raft_consensus.cc:2272] T ace9a99cb0cc4d74af0e883b304a6deb P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.471760 15321 tablet_replica.cc:333] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.472503 15321 raft_consensus.cc:2243] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.473084 15321 raft_consensus.cc:2272] T 5c9276a806f84d93aac577885a367327 P 9995177579524a00a286f7d014d0a249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.475426 15321 tablet_replica.cc:333] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249: stopping tablet replica
I20260709 13:10:27.475922 15321 raft_consensus.cc:2243] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.476341 15321 raft_consensus.cc:2272] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9995177579524a00a286f7d014d0a249 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:27.502689 25672 consensus_peers.cc:597] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.509985 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
W20260709 13:10:27.517869 25673 consensus_peers.cc:597] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Couldn't send request to peer 9995177579524a00a286f7d014d0a249. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:45985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:27.539166 25672 consensus_peers.cc:597] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 2dc839aa4f604ee493132de52806638d (127.14.246.65:39989): Couldn't send request to peer 2dc839aa4f604ee493132de52806638d. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:39989: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:27.542973 25673 consensus_peers.cc:597] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Couldn't send request to peer 9995177579524a00a286f7d014d0a249. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:45985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.564561 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
W20260709 13:10:27.588726 25673 consensus_peers.cc:597] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 -> Peer 9995177579524a00a286f7d014d0a249 (127.14.246.66:45985): Couldn't send request to peer 9995177579524a00a286f7d014d0a249. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.66:45985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.609059 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:27.609858 15321 tablet_replica.cc:333] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.610558 15321 raft_consensus.cc:2243] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.611122 15321 raft_consensus.cc:2272] T 0be441787fec46019d9c28a166906f5d P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.613394 15321 tablet_replica.cc:333] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.613976 15321 raft_consensus.cc:2243] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.614456 15321 raft_consensus.cc:2272] T 321da1503f4341fabeb8f01d2501d75a P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.616463 15321 tablet_replica.cc:333] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.617092 15321 raft_consensus.cc:2243] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.617553 15321 raft_consensus.cc:2272] T 5bd1e17ddaf44938afc28dc0cf2785c0 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.619639 15321 tablet_replica.cc:333] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.620289 15321 raft_consensus.cc:2243] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.621150 15321 raft_consensus.cc:2272] T cb76089717f2414ba870a1354bfaf33e P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.623296 15321 tablet_replica.cc:333] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.623862 15321 raft_consensus.cc:2243] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.624329 15321 raft_consensus.cc:2272] T 00598a9298e84d98a3ab2d3f66478671 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.626461 15321 tablet_replica.cc:333] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.627000 15321 raft_consensus.cc:2243] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.627426 15321 raft_consensus.cc:2272] T 3e8c67aaafb24ece8c59c7038b1326ed P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.629623 15321 tablet_replica.cc:333] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.630191 15321 raft_consensus.cc:2243] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.630607 15321 raft_consensus.cc:2272] T 5c9276a806f84d93aac577885a367327 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.632566 15321 tablet_replica.cc:333] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.633140 15321 raft_consensus.cc:2243] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.633865 15321 raft_consensus.cc:2272] T 50c7912f33aa4f88ba30bc22f7eab8d2 P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.635967 15321 tablet_replica.cc:333] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.636492 15321 raft_consensus.cc:2243] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.637346 15321 raft_consensus.cc:2272] T d0ffa666437441be80543ad39d6fea18 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.639371 15321 tablet_replica.cc:333] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.639890 15321 raft_consensus.cc:2243] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.640678 15321 raft_consensus.cc:2272] T 8af6f01db673458a895653978a156ab4 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.642807 15321 tablet_replica.cc:333] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.643323 15321 raft_consensus.cc:2243] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.643718 15321 raft_consensus.cc:2272] T 0dc4d5f79bdd482c930bcfd597054306 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.645830 15321 tablet_replica.cc:333] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.646373 15321 raft_consensus.cc:2243] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.646827 15321 raft_consensus.cc:2272] T 488b8dd8183244ff8de304037a67e0e7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.648970 15321 tablet_replica.cc:333] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.649502 15321 raft_consensus.cc:2243] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.649914 15321 raft_consensus.cc:2272] T 57847ad165734a658705ff4fec9429b7 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.651824 15321 tablet_replica.cc:333] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.652297 15321 raft_consensus.cc:2243] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.652745 15321 raft_consensus.cc:2272] T d98b8e722d184b05924f020ed53513ac P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.654888 15321 tablet_replica.cc:333] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.655416 15321 raft_consensus.cc:2243] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.655908 15321 raft_consensus.cc:2272] T 13321a15eeb44b459fc0df692dfe9666 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.657999 15321 tablet_replica.cc:333] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.658510 15321 raft_consensus.cc:2243] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.659680 15321 raft_consensus.cc:2272] T 5fe4ad9501db4257a237dc09db23b516 P 9aa5819cb41245e982bbc556dc0a36b6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.662210 15321 tablet_replica.cc:333] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.662787 15321 raft_consensus.cc:2243] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.663641 15321 raft_consensus.cc:2272] T ace9a99cb0cc4d74af0e883b304a6deb P 9aa5819cb41245e982bbc556dc0a36b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.666004 15321 tablet_replica.cc:333] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6: stopping tablet replica
I20260709 13:10:27.666553 15321 raft_consensus.cc:2243] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.667062 15321 raft_consensus.cc:2272] T 67aca5375c20499888f54bbe6f02e782 P 9aa5819cb41245e982bbc556dc0a36b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.712183 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:10:27.753537 15321 master.cc:562] Master@127.14.246.126:38175 shutting down...
I20260709 13:10:27.779738 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:27.780445 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.780907 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5cdb7cc8d84641d3a157e5339c0b58bb: stopping tablet replica
I20260709 13:10:28.315995 15321 master.cc:584] Master@127.14.246.126:38175 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13585 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:28.370823 15321 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.246.126:41945
I20260709 13:10:28.371932 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.377475 26028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.378667 26029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.379241 26031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.379887 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:28.380872 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.381070 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.381228 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602628381197 us; error 0 us; skew 500 ppm
I20260709 13:10:28.381737 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.384066 15321 webserver.cc:533] Webserver started at http://127.14.246.126:32955/ using document root <none> and password file <none>
I20260709 13:10:28.384547 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.384730 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.385059 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.386221 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/master-0-root/instance:
uuid: "3a97ca84e7374773a1cc943b7eb9300e"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.390656 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:10:28.393944 26036 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.394688 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:28.395002 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/master-0-root
uuid: "3a97ca84e7374773a1cc943b7eb9300e"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.395269 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.414441 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.415654 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.453491 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.126:41945
I20260709 13:10:28.453619 26087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.126:41945 every 8 connection(s)
I20260709 13:10:28.457419 26088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.468708 26088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: Bootstrap starting.
I20260709 13:10:28.473591 26088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.477722 26088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: No bootstrap required, opened a new log
I20260709 13:10:28.479796 26088 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER }
I20260709 13:10:28.480155 26088 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.480324 26088 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a97ca84e7374773a1cc943b7eb9300e, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.480923 26088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER }
I20260709 13:10:28.481321 26088 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:28.481501 26088 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:28.481710 26088 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.486618 26088 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER }
I20260709 13:10:28.487062 26088 leader_election.cc:304] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a97ca84e7374773a1cc943b7eb9300e; no voters: 
I20260709 13:10:28.488107 26088 leader_election.cc:290] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:28.488608 26091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.490196 26091 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 1 LEADER]: Becoming Leader. State: Replica: 3a97ca84e7374773a1cc943b7eb9300e, State: Running, Role: LEADER
I20260709 13:10:28.490993 26088 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:28.490976 26091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER }
I20260709 13:10:28.496243 26093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a97ca84e7374773a1cc943b7eb9300e. Latest consensus state: current_term: 1 leader_uuid: "3a97ca84e7374773a1cc943b7eb9300e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER } }
I20260709 13:10:28.496254 26092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a97ca84e7374773a1cc943b7eb9300e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a97ca84e7374773a1cc943b7eb9300e" member_type: VOTER } }
I20260709 13:10:28.497069 26093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:28.497133 26092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:28.502388 26099 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:28.509941 26099 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:28.510854 15321 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:28.519109 26099 catalog_manager.cc:1383] Generated new cluster ID: 7b87fbd5d0cd4308a30920c54eb0b39b
I20260709 13:10:28.519429 26099 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:28.532387 26099 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:28.533677 26099 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:28.548750 26099 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: Generated new TSK 0
I20260709 13:10:28.549371 26099 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:28.578027 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.584102 26109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.584988 26110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.586206 26112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.587604 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:28.588609 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.588847 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.589021 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602628589005 us; error 0 us; skew 500 ppm
I20260709 13:10:28.589535 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.591759 15321 webserver.cc:533] Webserver started at http://127.14.246.65:45135/ using document root <none> and password file <none>
I20260709 13:10:28.592284 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.592485 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.592751 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.594009 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-0-root/instance:
uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.598347 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:28.601608 26117 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.602476 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:28.602770 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-0-root
uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.603065 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.614650 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.615899 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.617456 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.619653 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.619874 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.620126 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.620316 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.660291 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.65:43643
I20260709 13:10:28.660418 26179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.65:43643 every 8 connection(s)
I20260709 13:10:28.665405 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.672541 26184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.674326 26185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.676753 26187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.677098 15321 server_base.cc:1061] running on GCE node
I20260709 13:10:28.678098 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.678319 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.678529 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602628678510 us; error 0 us; skew 500 ppm
I20260709 13:10:28.679152 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.681998 15321 webserver.cc:533] Webserver started at http://127.14.246.66:33631/ using document root <none> and password file <none>
I20260709 13:10:28.682571 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.682758 26180 heartbeater.cc:344] Connected to a master server at 127.14.246.126:41945
I20260709 13:10:28.682785 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.683360 26180 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.683434 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.684337 26180 heartbeater.cc:507] Master 127.14.246.126:41945 requested a full tablet report, sending...
I20260709 13:10:28.685107 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-1-root/instance:
uuid: "37b7ac6292c746b38781ce11b74917db"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.686728 26053 ts_manager.cc:194] Registered new tserver with Master: 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643)
I20260709 13:10:28.688517 26053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39526
I20260709 13:10:28.690315 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:28.694176 26192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.694963 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:28.695236 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-1-root
uuid: "37b7ac6292c746b38781ce11b74917db"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.695468 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.710956 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.712090 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.713528 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.715687 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.715890 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.716167 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.716327 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.756497 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.66:43947
I20260709 13:10:28.756606 26254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.66:43947 every 8 connection(s)
I20260709 13:10:28.761396 15321 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:28.768158 26258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:28.768863 26259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.771648 15321 server_base.cc:1061] running on GCE node
W20260709 13:10:28.772519 26261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:28.772840 26255 heartbeater.cc:344] Connected to a master server at 127.14.246.126:41945
I20260709 13:10:28.773380 26255 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.773746 15321 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:28.774049 15321 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:28.774266 15321 hybrid_clock.cc:648] HybridClock initialized: now 1783602628774246 us; error 0 us; skew 500 ppm
I20260709 13:10:28.774305 26255 heartbeater.cc:507] Master 127.14.246.126:41945 requested a full tablet report, sending...
I20260709 13:10:28.775102 15321 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:28.776505 26053 ts_manager.cc:194] Registered new tserver with Master: 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:28.777810 26053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39528
I20260709 13:10:28.780200 15321 webserver.cc:533] Webserver started at http://127.14.246.67:40915/ using document root <none> and password file <none>
I20260709 13:10:28.780820 15321 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:28.781026 15321 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:28.781288 15321 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:28.782407 15321 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-2-root/instance:
uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.786916 15321 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:28.790357 26266 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.791123 15321 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:28.791437 15321 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-2-root
uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
format_stamp: "Formatted at 2026-07-09 13:10:28 on dist-test-slave-bhv2"
I20260709 13:10:28.791759 15321 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskcMVw_H/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602326091027-15321-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:28.804931 15321 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:28.806164 15321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:28.807646 15321 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:28.809913 15321 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:28.810139 15321 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.810375 15321 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:28.810551 15321 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:28.850129 15321 rpc_server.cc:307] RPC server started. Bound to: 127.14.246.67:38621
I20260709 13:10:28.850236 26328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.246.67:38621 every 8 connection(s)
I20260709 13:10:28.863665 26329 heartbeater.cc:344] Connected to a master server at 127.14.246.126:41945
I20260709 13:10:28.864130 26329 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:28.864863 26329 heartbeater.cc:507] Master 127.14.246.126:41945 requested a full tablet report, sending...
I20260709 13:10:28.866714 26053 ts_manager.cc:194] Registered new tserver with Master: 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:28.866941 15321 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013656831s
I20260709 13:10:28.868577 26053 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39536
I20260709 13:10:28.891965 26053 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39548:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:28.895058 26053 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:28.964277 26293 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf046f457e3473492627a8b7bbe4ea9 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:28.964458 26292 tablet_service.cc:1511] Processing CreateTablet for tablet edfeaebc4f8942379cec35617f35c50d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:28.965920 26293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf046f457e3473492627a8b7bbe4ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.966687 26292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfeaebc4f8942379cec35617f35c50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.968191 26294 tablet_service.cc:1511] Processing CreateTablet for tablet 996fc0d8b9e54101b9d7dd4b438d8d62 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:28.969588 26294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996fc0d8b9e54101b9d7dd4b438d8d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.982393 26291 tablet_service.cc:1511] Processing CreateTablet for tablet e47c79eadaad407c86a85cc76539943f (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:28.983946 26291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c79eadaad407c86a85cc76539943f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.990433 26290 tablet_service.cc:1511] Processing CreateTablet for tablet c2bbbc80ec2342d4893b3ff2e474a8f5 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:28.991886 26290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bbbc80ec2342d4893b3ff2e474a8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:28.996961 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 996fc0d8b9e54101b9d7dd4b438d8d62 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:28.998415 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996fc0d8b9e54101b9d7dd4b438d8d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.002228 26144 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf046f457e3473492627a8b7bbe4ea9 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.003027 26289 tablet_service.cc:1511] Processing CreateTablet for tablet cf04949c6a9c4f32902c05199aa81aa1 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.003638 26144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf046f457e3473492627a8b7bbe4ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.006110 26220 tablet_service.cc:1511] Processing CreateTablet for tablet 996fc0d8b9e54101b9d7dd4b438d8d62 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:29.007964 26220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 996fc0d8b9e54101b9d7dd4b438d8d62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.009428 26215 tablet_service.cc:1511] Processing CreateTablet for tablet cf04949c6a9c4f32902c05199aa81aa1 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.010749 26215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf04949c6a9c4f32902c05199aa81aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.010326 26219 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf046f457e3473492627a8b7bbe4ea9 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:29.013875 26142 tablet_service.cc:1511] Processing CreateTablet for tablet e47c79eadaad407c86a85cc76539943f (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.014320 26217 tablet_service.cc:1511] Processing CreateTablet for tablet e47c79eadaad407c86a85cc76539943f (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:29.015283 26142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c79eadaad407c86a85cc76539943f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.016181 26217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e47c79eadaad407c86a85cc76539943f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.017179 26218 tablet_service.cc:1511] Processing CreateTablet for tablet edfeaebc4f8942379cec35617f35c50d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.018482 26218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfeaebc4f8942379cec35617f35c50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.007639 26216 tablet_service.cc:1511] Processing CreateTablet for tablet c2bbbc80ec2342d4893b3ff2e474a8f5 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.021883 26216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bbbc80ec2342d4893b3ff2e474a8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.006359 26143 tablet_service.cc:1511] Processing CreateTablet for tablet edfeaebc4f8942379cec35617f35c50d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:29.024003 26143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfeaebc4f8942379cec35617f35c50d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.022384 26141 tablet_service.cc:1511] Processing CreateTablet for tablet c2bbbc80ec2342d4893b3ff2e474a8f5 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:29.024699 26140 tablet_service.cc:1511] Processing CreateTablet for tablet cf04949c6a9c4f32902c05199aa81aa1 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:29.026022 26141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bbbc80ec2342d4893b3ff2e474a8f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.026908 26140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf04949c6a9c4f32902c05199aa81aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.029277 26219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf046f457e3473492627a8b7bbe4ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.035941 26139 tablet_service.cc:1511] Processing CreateTablet for tablet 01ecba4da8f04d858fe6223bea97c85d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.037511 26139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ecba4da8f04d858fe6223bea97c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.049228 26214 tablet_service.cc:1511] Processing CreateTablet for tablet 01ecba4da8f04d858fe6223bea97c85d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.051126 26214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ecba4da8f04d858fe6223bea97c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.065480 26289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf04949c6a9c4f32902c05199aa81aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.086900 26288 tablet_service.cc:1511] Processing CreateTablet for tablet 01ecba4da8f04d858fe6223bea97c85d (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:29.089504 26288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ecba4da8f04d858fe6223bea97c85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.109433 26344 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.109892 26213 tablet_service.cc:1511] Processing CreateTablet for tablet fa01dddbf9f54f318bff64aafc28a008 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.111295 26213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa01dddbf9f54f318bff64aafc28a008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.113513 26345 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.121829 26291 tablet_service.cc:1511] Processing CreateTablet for tablet fa01dddbf9f54f318bff64aafc28a008 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.128110 26291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa01dddbf9f54f318bff64aafc28a008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.128008 26220 tablet_service.cc:1511] Processing CreateTablet for tablet ed04677ca4544014a160876e304b6fed (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.122587 26344 tablet_bootstrap.cc:654] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.126053 26142 tablet_service.cc:1511] Processing CreateTablet for tablet ed04677ca4544014a160876e304b6fed (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.129987 26142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed04677ca4544014a160876e304b6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.126760 26139 tablet_service.cc:1511] Processing CreateTablet for tablet fa01dddbf9f54f318bff64aafc28a008 (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:29.133580 26139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa01dddbf9f54f318bff64aafc28a008. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.134600 26220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed04677ca4544014a160876e304b6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.139127 26346 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.141681 26345 tablet_bootstrap.cc:654] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.159353 26289 tablet_service.cc:1511] Processing CreateTablet for tablet ed04677ca4544014a160876e304b6fed (DEFAULT_TABLE table=test-workload [id=94e7d60e26214659b3b9a8dfc200aa3a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:29.160686 26289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed04677ca4544014a160876e304b6fed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.168449 26346 tablet_bootstrap.cc:654] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.178545 26344 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.179116 26344 ts_tablet_manager.cc:1403] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.006s
I20260709 13:10:29.183274 26344 raft_consensus.cc:359] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.187650 26344 raft_consensus.cc:385] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.188088 26345 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.188124 26344 raft_consensus.cc:740] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.188687 26345 ts_tablet_manager.cc:1403] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.018s
I20260709 13:10:29.189603 26344 consensus_queue.cc:260] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.191342 26345 raft_consensus.cc:359] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.192188 26345 raft_consensus.cc:385] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.192305 26329 heartbeater.cc:499] Master 127.14.246.126:41945 was elected leader, sending a full tablet report...
I20260709 13:10:29.192534 26345 raft_consensus.cc:740] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.192998 26344 ts_tablet_manager.cc:1434] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:10:29.193966 26346 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.193591 26345 consensus_queue.cc:260] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.194159 26344 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.194505 26346 ts_tablet_manager.cc:1403] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.007s
I20260709 13:10:29.197786 26346 raft_consensus.cc:359] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.198565 26346 raft_consensus.cc:385] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.198854 26346 raft_consensus.cc:740] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.199687 26346 consensus_queue.cc:260] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.201203 26344 tablet_bootstrap.cc:654] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.209388 26346 ts_tablet_manager.cc:1434] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:10:29.210374 26255 heartbeater.cc:499] Master 127.14.246.126:41945 was elected leader, sending a full tablet report...
I20260709 13:10:29.220166 26346 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.228698 26180 heartbeater.cc:499] Master 127.14.246.126:41945 was elected leader, sending a full tablet report...
I20260709 13:10:29.229200 26345 ts_tablet_manager.cc:1434] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.040s	user 0.020s	sys 0.019s
I20260709 13:10:29.230342 26345 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.238210 26345 tablet_bootstrap.cc:654] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.242261 26346 tablet_bootstrap.cc:654] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.244721 26344 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.245453 26344 ts_tablet_manager.cc:1403] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.052s	user 0.037s	sys 0.008s
I20260709 13:10:29.247171 26345 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.247678 26345 ts_tablet_manager.cc:1403] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 13:10:29.248240 26346 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.248865 26346 ts_tablet_manager.cc:1403] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:10:29.248548 26344 raft_consensus.cc:359] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.249336 26344 raft_consensus.cc:385] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.249666 26344 raft_consensus.cc:740] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.250295 26345 raft_consensus.cc:359] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.250612 26344 consensus_queue.cc:260] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.251088 26345 raft_consensus.cc:385] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.251531 26345 raft_consensus.cc:740] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.252331 26345 consensus_queue.cc:260] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.252866 26344 ts_tablet_manager.cc:1434] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:29.253938 26344 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.254607 26345 ts_tablet_manager.cc:1434] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:29.255576 26345 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.255528 26346 raft_consensus.cc:359] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.256544 26346 raft_consensus.cc:385] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.256913 26346 raft_consensus.cc:740] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.257903 26346 consensus_queue.cc:260] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.260368 26346 ts_tablet_manager.cc:1434] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:29.260944 26344 tablet_bootstrap.cc:654] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.261469 26346 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.262771 26345 tablet_bootstrap.cc:654] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:29.267163 26256 tablet.cc:2406] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:29.270001 26346 tablet_bootstrap.cc:654] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.276635 26344 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.277261 26344 ts_tablet_manager.cc:1403] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:10:29.277823 26345 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.278267 26345 ts_tablet_manager.cc:1403] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:10:29.280828 26346 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.280525 26344 raft_consensus.cc:359] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.281322 26344 raft_consensus.cc:385] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.281435 26346 ts_tablet_manager.cc:1403] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:10:29.281644 26344 raft_consensus.cc:740] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.282065 26345 raft_consensus.cc:359] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.282826 26345 raft_consensus.cc:385] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.282495 26344 consensus_queue.cc:260] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.283144 26345 raft_consensus.cc:740] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.284027 26345 consensus_queue.cc:260] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.284888 26346 raft_consensus.cc:359] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.285689 26346 raft_consensus.cc:385] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.286024 26346 raft_consensus.cc:740] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.286908 26346 consensus_queue.cc:260] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.287485 26344 ts_tablet_manager.cc:1434] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:29.289655 26344 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.291080 26345 ts_tablet_manager.cc:1434] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:29.291898 26346 ts_tablet_manager.cc:1434] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:29.292124 26345 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.293112 26346 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.296232 26344 tablet_bootstrap.cc:654] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.298542 26345 tablet_bootstrap.cc:654] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.299213 26350 raft_consensus.cc:493] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.299760 26350 raft_consensus.cc:515] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.301148 26346 tablet_bootstrap.cc:654] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.307824 26344 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.308367 26344 ts_tablet_manager.cc:1403] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:10:29.311395 26344 raft_consensus.cc:359] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.312115 26344 raft_consensus.cc:385] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.312394 26344 raft_consensus.cc:740] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.312883 26350 leader_election.cc:290] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.313701 26344 consensus_queue.cc:260] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.315305 26346 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.315850 26346 ts_tablet_manager.cc:1403] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:10:29.316030 26344 ts_tablet_manager.cc:1434] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:29.317045 26344 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.317857 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.318773 26346 raft_consensus.cc:359] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
W20260709 13:10:29.319507 26270 leader_election.cc:343] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.320441 26346 raft_consensus.cc:385] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.320794 26346 raft_consensus.cc:740] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.325346 26346 consensus_queue.cc:260] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.327574 26346 ts_tablet_manager.cc:1434] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:29.324542 26344 tablet_bootstrap.cc:654] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.332580 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.333336 26155 raft_consensus.cc:2468] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:29.334834 26346 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.334851 26267 leader_election.cc:304] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:29.336390 26350 raft_consensus.cc:2804] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.336746 26350 raft_consensus.cc:493] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.337191 26350 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.343819 26346 tablet_bootstrap.cc:654] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.344534 26350 raft_consensus.cc:515] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.346002 26345 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.346585 26345 ts_tablet_manager.cc:1403] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 13:10:29.347622 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.348263 26155 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.349704 26345 raft_consensus.cc:359] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.350481 26345 raft_consensus.cc:385] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.350773 26345 raft_consensus.cc:740] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.353561 26345 consensus_queue.cc:260] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.355952 26345 ts_tablet_manager.cc:1434] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:29.357009 26345 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.359755 26346 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.360594 26346 ts_tablet_manager.cc:1403] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 13:10:29.363380 26345 tablet_bootstrap.cc:654] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.364894 26346 raft_consensus.cc:359] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.366046 26346 raft_consensus.cc:385] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.366506 26346 raft_consensus.cc:740] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.367705 26346 consensus_queue.cc:260] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.373553 26346 ts_tablet_manager.cc:1434] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:29.375125 26346 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.379040 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
W20260709 13:10:29.381249 26270 leader_election.cc:343] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.383908 26346 tablet_bootstrap.cc:654] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.384835 26350 leader_election.cc:290] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.398007 26346 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.398537 26346 ts_tablet_manager.cc:1403] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.010s
I20260709 13:10:29.383528 26155 raft_consensus.cc:2468] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:29.400470 26344 tablet_bootstrap.cc:492] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.401095 26344 ts_tablet_manager.cc:1403] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.084s	user 0.041s	sys 0.038s
I20260709 13:10:29.401446 26346 raft_consensus.cc:359] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.402383 26346 raft_consensus.cc:385] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.402846 26267 leader_election.cc:304] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:29.404167 26344 raft_consensus.cc:359] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.404327 26352 raft_consensus.cc:493] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.402825 26346 raft_consensus.cc:740] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.405066 26344 raft_consensus.cc:385] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.405536 26344 raft_consensus.cc:740] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.405287 26352 raft_consensus.cc:515] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.405779 26345 tablet_bootstrap.cc:492] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.406272 26345 ts_tablet_manager.cc:1403] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.020s
I20260709 13:10:29.406047 26346 consensus_queue.cc:260] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.406394 26344 consensus_queue.cc:260] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.408007 26351 raft_consensus.cc:493] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.404373 26350 raft_consensus.cc:2804] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.408519 26351 raft_consensus.cc:515] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.413916 26344 ts_tablet_manager.cc:1434] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:10:29.416818 26351 leader_election.cc:290] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.423259 26344 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.418006 26352 leader_election.cc:290] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621), 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643)
I20260709 13:10:29.433051 26346 ts_tablet_manager.cc:1434] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.015s
I20260709 13:10:29.434329 26346 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.435492 26345 raft_consensus.cc:359] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.438145 26345 raft_consensus.cc:385] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.439514 26345 raft_consensus.cc:740] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.440464 26344 tablet_bootstrap.cc:654] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.451218 26345 consensus_queue.cc:260] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.453627 26345 ts_tablet_manager.cc:1434] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 13:10:29.442011 26346 tablet_bootstrap.cc:654] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.454960 26350 raft_consensus.cc:697] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:29.455951 26350 consensus_queue.cc:237] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.457407 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.458086 26230 raft_consensus.cc:2468] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 0.
I20260709 13:10:29.459095 26345 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.461550 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.459354 26121 leader_election.cc:304] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.464264 26351 raft_consensus.cc:2804] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:29.464318 26119 leader_election.cc:343] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.464823 26351 raft_consensus.cc:493] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.465068 26344 tablet_bootstrap.cc:492] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.465291 26351 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.465693 26344 ts_tablet_manager.cc:1403] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.011s
I20260709 13:10:29.468034 26345 tablet_bootstrap.cc:654] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.475142 26351 raft_consensus.cc:515] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.479296 26344 raft_consensus.cc:359] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.480104 26344 raft_consensus.cc:385] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.480409 26344 raft_consensus.cc:740] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.481158 26367 raft_consensus.cc:493] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.481652 26367 raft_consensus.cc:515] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.482019 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:29.482843 26230 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.483820 26367 leader_election.cc:290] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.485354 26370 raft_consensus.cc:493] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.485816 26370 raft_consensus.cc:515] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.488101 26370 leader_election.cc:290] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.490188 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.489207 26344 consensus_queue.cc:260] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.491103 26229 raft_consensus.cc:2468] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:29.492893 26344 ts_tablet_manager.cc:1434] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:10:29.493511 26270 leader_election.cc:304] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:29.494050 26344 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
W20260709 13:10:29.505016 26101 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:29.497944 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.507454 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.508175 26304 raft_consensus.cc:2468] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 0.
W20260709 13:10:29.509567 26267 leader_election.cc:343] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.511507 26344 tablet_bootstrap.cc:654] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.511812 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.512579 26345 tablet_bootstrap.cc:492] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.513206 26345 ts_tablet_manager.cc:1403] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.031s
I20260709 13:10:29.513875 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.514606 26155 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 0.
W20260709 13:10:29.516028 26193 leader_election.cc:343] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.516709 26345 raft_consensus.cc:359] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.517571 26345 raft_consensus.cc:385] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.517647 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.517966 26345 raft_consensus.cc:740] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.518318 26304 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 0.
I20260709 13:10:29.518924 26345 consensus_queue.cc:260] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.520341 26194 leader_election.cc:304] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:29.522132 26367 raft_consensus.cc:2804] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.516747 26193 leader_election.cc:304] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.522680 26367 raft_consensus.cc:493] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.523298 26367 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.523510 26352 raft_consensus.cc:2804] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.524093 26352 raft_consensus.cc:493] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.524528 26352 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.528637 26345 ts_tablet_manager.cc:1434] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:10:29.531697 26345 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.532948 26367 raft_consensus.cc:515] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.536131 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
W20260709 13:10:29.537642 26193 leader_election.cc:343] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.537751 26367 leader_election.cc:290] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Requested vote from peers 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621), 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643)
I20260709 13:10:29.539786 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:29.540668 26304 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.541801 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:29.542456 26303 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.545076 26370 raft_consensus.cc:2804] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.545612 26370 raft_consensus.cc:493] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.546056 26370 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.549552 26303 raft_consensus.cc:2468] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 1.
I20260709 13:10:29.550504 26345 tablet_bootstrap.cc:654] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.550837 26194 leader_election.cc:304] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:29.532351 26352 raft_consensus.cc:515] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.536152 26230 raft_consensus.cc:2468] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:29.538280 26351 leader_election.cc:290] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.552404 26304 raft_consensus.cc:2468] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:29.560129 26119 leader_election.cc:304] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.561075 26351 raft_consensus.cc:2804] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.561614 26346 tablet_bootstrap.cc:492] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.562178 26346 ts_tablet_manager.cc:1403] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.030s
I20260709 13:10:29.562335 26351 raft_consensus.cc:697] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:29.563308 26351 consensus_queue.cc:237] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.565598 26346 raft_consensus.cc:359] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.566071 26352 leader_election.cc:290] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.566401 26346 raft_consensus.cc:385] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.554440 26367 raft_consensus.cc:2804] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.568236 26367 raft_consensus.cc:697] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:29.569128 26367 consensus_queue.cc:237] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.571339 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.572083 26155 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.566831 26346 raft_consensus.cc:740] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.575306 26346 consensus_queue.cc:260] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.587903 26346 ts_tablet_manager.cc:1434] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:10:29.597386 26346 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.605298 26350 raft_consensus.cc:493] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.606138 26350 raft_consensus.cc:515] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.595985 26370 raft_consensus.cc:515] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.611263 26344 tablet_bootstrap.cc:492] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.611915 26344 ts_tablet_manager.cc:1403] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.034s
I20260709 13:10:29.612452 26345 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.613062 26345 ts_tablet_manager.cc:1403] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.082s	user 0.032s	sys 0.012s
I20260709 13:10:29.611881 26052 catalog_manager.cc:5697] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.614315 26154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.615074 26154 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.615722 26344 raft_consensus.cc:359] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.616566 26344 raft_consensus.cc:385] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.617156 26344 raft_consensus.cc:740] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.618105 26344 consensus_queue.cc:260] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.616321 26345 raft_consensus.cc:359] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.619508 26345 raft_consensus.cc:385] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.619958 26345 raft_consensus.cc:740] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.620617 26379 raft_consensus.cc:493] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.620947 26345 consensus_queue.cc:260] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.621217 26379 raft_consensus.cc:515] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.624065 26346 tablet_bootstrap.cc:654] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.624222 26379 leader_election.cc:290] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.624948 26344 ts_tablet_manager.cc:1434] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:29.625121 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.625826 26230 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 0.
I20260709 13:10:29.626243 26344 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.626036 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.627110 26304 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 0.
I20260709 13:10:29.627346 26121 leader_election.cc:304] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.628537 26379 raft_consensus.cc:2804] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.628981 26379 raft_consensus.cc:493] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.629462 26379 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.632217 26154 raft_consensus.cc:2468] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:29.641510 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.642577 26153 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:29.643441 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.644443 26229 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:29.644706 26267 leader_election.cc:304] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.646139 26267 leader_election.cc:304] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.647396 26350 leader_election.cc:290] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.647644 26368 raft_consensus.cc:2804] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.636116 26344 tablet_bootstrap.cc:654] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.648401 26368 raft_consensus.cc:697] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:29.649798 26368 consensus_queue.cc:237] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.636507 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:29.636955 26370 leader_election.cc:290] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
W20260709 13:10:29.638316 26194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.67:38621, user_credentials={real_user=slave}} blocked reactor thread for 87603.8us
I20260709 13:10:29.638407 26155 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 1.
I20260709 13:10:29.653983 26193 leader_election.cc:304] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.655800 26384 raft_consensus.cc:2804] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.657090 26384 raft_consensus.cc:697] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:29.658353 26384 consensus_queue.cc:237] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.648301 26350 raft_consensus.cc:2804] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.665899 26350 raft_consensus.cc:493] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.666429 26350 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.670697 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:29.671399 26304 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.678011 26379 raft_consensus.cc:515] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.682163 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:29.683070 26229 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.664992 26230 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.671581 26053 catalog_manager.cc:5697] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 0 to 1, leader changed from <none> to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 1 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.694470 26379 leader_election.cc:290] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
W20260709 13:10:29.695333 26267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.246.65:43643, user_credentials={real_user=slave}} blocked reactor thread for 49305.4us
I20260709 13:10:29.703130 26345 ts_tablet_manager.cc:1434] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.090s	user 0.024s	sys 0.022s
I20260709 13:10:29.703930 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:29.704375 26345 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.704664 26303 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.711288 26346 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.711861 26346 ts_tablet_manager.cc:1403] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.016s
I20260709 13:10:29.715034 26229 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:29.714939 26346 raft_consensus.cc:359] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.716125 26346 raft_consensus.cc:385] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.716233 26304 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 1.
I20260709 13:10:29.716475 26346 raft_consensus.cc:740] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.717027 26121 leader_election.cc:304] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.718240 26386 raft_consensus.cc:2804] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.718665 26344 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.719249 26344 ts_tablet_manager.cc:1403] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.007s
I20260709 13:10:29.719146 26386 raft_consensus.cc:697] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:29.720386 26386 consensus_queue.cc:237] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.722344 26344 raft_consensus.cc:359] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.723222 26344 raft_consensus.cc:385] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.723536 26344 raft_consensus.cc:740] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.724329 26344 consensus_queue.cc:260] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.725533 26346 consensus_queue.cc:260] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.735059 26303 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:29.731066 26050 catalog_manager.cc:5697] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.726514 26230 raft_consensus.cc:2468] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:29.736719 26350 raft_consensus.cc:515] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.737466 26344 ts_tablet_manager.cc:1434] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:10:29.738814 26345 tablet_bootstrap.cc:654] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.742036 26344 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:29.743012 26346 ts_tablet_manager.cc:1434] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:10:29.744110 26346 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:29.744884 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.745601 26155 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.753448 26346 tablet_bootstrap.cc:654] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.757361 26386 raft_consensus.cc:493] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.757722 26155 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:29.759248 26267 leader_election.cc:304] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.760686 26389 raft_consensus.cc:2804] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.757994 26386 raft_consensus.cc:515] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.761420 26389 raft_consensus.cc:697] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:29.762246 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:29.763005 26230 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.762687 26389 consensus_queue.cc:237] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.764559 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
W20260709 13:10:29.766292 26119 leader_election.cc:343] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.767976 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.769311 26386 leader_election.cc:290] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
W20260709 13:10:29.769793 26121 leader_election.cc:343] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.777338 26344 tablet_bootstrap.cc:654] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.777737 26346 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:29.778291 26346 ts_tablet_manager.cc:1403] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 13:10:29.774926 26121 leader_election.cc:304] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:29.775547 26350 leader_election.cc:290] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.780630 26370 raft_consensus.cc:493] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.784117 26370 raft_consensus.cc:515] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.782106 26386 raft_consensus.cc:2749] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.787384 26370 leader_election.cc:290] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.788391 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.789100 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.789829 26229 raft_consensus.cc:2468] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:29.790387 26230 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
W20260709 13:10:29.790867 26267 leader_election.cc:343] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.791016 26346 raft_consensus.cc:359] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.791795 26346 raft_consensus.cc:385] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.791651 26270 leader_election.cc:304] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:29.792135 26346 raft_consensus.cc:740] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.793244 26346 consensus_queue.cc:260] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.793715 26345 tablet_bootstrap.cc:492] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.793785 26370 raft_consensus.cc:2804] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.794425 26370 raft_consensus.cc:493] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.794497 26345 ts_tablet_manager.cc:1403] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.012s
I20260709 13:10:29.794934 26370 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.795848 26346 ts_tablet_manager.cc:1434] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:10:29.797828 26345 raft_consensus.cc:359] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.798553 26345 raft_consensus.cc:385] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.798817 26345 raft_consensus.cc:740] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.799793 26345 consensus_queue.cc:260] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.801278 26344 tablet_bootstrap.cc:492] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:29.801857 26344 ts_tablet_manager.cc:1403] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.003s
I20260709 13:10:29.802838 26345 ts_tablet_manager.cc:1434] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:29.803159 26370 raft_consensus.cc:515] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.804224 26345 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:29.805112 26344 raft_consensus.cc:359] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.805902 26344 raft_consensus.cc:385] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.806247 26344 raft_consensus.cc:740] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.807195 26344 consensus_queue.cc:260] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.808939 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.809547 26344 ts_tablet_manager.cc:1434] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:10:29.810488 26267 leader_election.cc:343] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:29.813287 26345 tablet_bootstrap.cc:654] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:29.815567 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:29.816268 26230 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.820923 26370 leader_election.cc:290] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.826514 26230 raft_consensus.cc:2468] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:29.826785 26345 tablet_bootstrap.cc:492] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:29.827359 26345 ts_tablet_manager.cc:1403] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:10:29.827759 26270 leader_election.cc:304] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:29.829063 26370 raft_consensus.cc:2804] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.829582 26370 raft_consensus.cc:697] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:29.829908 26345 raft_consensus.cc:359] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.830618 26345 raft_consensus.cc:385] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:29.830950 26345 raft_consensus.cc:740] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:29.830430 26370 consensus_queue.cc:237] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.832938 26384 raft_consensus.cc:493] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.835759 26384 raft_consensus.cc:515] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.838094 26384 leader_election.cc:290] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.831575 26345 consensus_queue.cc:260] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.834422 26052 catalog_manager.cc:5697] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.839344 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:29.840026 26345 ts_tablet_manager.cc:1434] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:29.840346 26155 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 0.
I20260709 13:10:29.840979 26052 catalog_manager.cc:5697] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.842136 26193 leader_election.cc:304] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:29.844039 26384 raft_consensus.cc:2804] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.844427 26384 raft_consensus.cc:493] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.844535 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.844904 26384 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.845364 26303 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 0.
I20260709 13:10:29.852692 26384 raft_consensus.cc:515] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.853770 26050 catalog_manager.cc:5697] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 0 to 1, leader changed from <none> to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 1 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.857338 26384 leader_election.cc:290] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:29.857596 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:29.857826 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:29.858271 26303 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.858559 26155 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.866253 26303 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 1.
I20260709 13:10:29.866444 26155 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 1.
I20260709 13:10:29.866000 26053 catalog_manager.cc:5697] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.867497 26194 leader_election.cc:304] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:29.868957 26384 raft_consensus.cc:2804] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.869457 26384 raft_consensus.cc:697] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:29.870364 26384 consensus_queue.cc:237] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:29.873606 26052 catalog_manager.cc:5697] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.880460 26050 catalog_manager.cc:5697] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 0 to 1, leader changed from <none> to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 1 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.954931 26230 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.961804 26370 consensus_queue.cc:1048] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.963985 26386 raft_consensus.cc:493] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.964536 26386 raft_consensus.cc:515] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:29.966894 26386 leader_election.cc:290] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:29.968461 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:29.969470 26303 raft_consensus.cc:2393] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6cdb83b3d7be4f21b426daee419bcfe4 in current term 1: Already voted for candidate 37b7ac6292c746b38781ce11b74917db in this term.
I20260709 13:10:29.969292 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:29.972187 26121 leader_election.cc:304] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:29.974256 26379 consensus_queue.cc:1048] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.975059 26386 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.982687 26386 raft_consensus.cc:2749] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:29.984503 26370 consensus_queue.cc:1048] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.998924 26409 consensus_queue.cc:1048] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.042836 26384 consensus_queue.cc:1048] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.043498 26367 consensus_queue.cc:1048] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.065047 26370 consensus_queue.cc:1048] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.076503 26368 consensus_queue.cc:1048] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.110879 26230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:53892
I20260709 13:10:30.111469 26230 raft_consensus.cc:606] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:30.125736 26303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:30.126340 26303 raft_consensus.cc:606] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:30.131860 26230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:53892
I20260709 13:10:30.132438 26230 raft_consensus.cc:606] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:30.138000 26303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:30.138581 26303 raft_consensus.cc:606] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:30.144297 26303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:30.144913 26303 raft_consensus.cc:606] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:30.158566 26155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:34932
I20260709 13:10:30.159065 26155 raft_consensus.cc:606] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:30.164886 26155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:34932
I20260709 13:10:30.165369 26155 raft_consensus.cc:606] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:30.170958 26303 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:30.171623 26303 raft_consensus.cc:606] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:30.177939 26230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed04677ca4544014a160876e304b6fed"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
mode: GRACEFUL
new_leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:53892
I20260709 13:10:30.178711 26230 raft_consensus.cc:606] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Received request to transfer leadership to TS 34bd6ed366aa48a99dd05b93a3e2819f
I20260709 13:10:30.187450 26370 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.195490 26367 consensus_queue.cc:1048] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.197290 26367 consensus_queue.cc:1048] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.200342 26370 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.214046 26409 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.226349 26384 raft_consensus.cc:993] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.226819 26384 raft_consensus.cc:1081] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.227605 26370 raft_consensus.cc:993] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.228175 26370 raft_consensus.cc:1081] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.232738 26152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:30.233079 26155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:10:30.233464 26152 raft_consensus.cc:493] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.233875 26155 raft_consensus.cc:493] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.234107 26152 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.234411 26155 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.235864 26379 raft_consensus.cc:993] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.236446 26379 raft_consensus.cc:1081] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.242642 26409 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.243034 26152 raft_consensus.cc:515] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.243175 26155 raft_consensus.cc:515] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.245710 26152 leader_election.cc:290] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.245786 26155 leader_election.cc:290] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.247051 26230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53878
I20260709 13:10:30.247682 26230 raft_consensus.cc:493] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.248099 26230 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.248174 26304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.248531 26229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edfeaebc4f8942379cec35617f35c50d" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:30.248929 26304 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.249264 26229 raft_consensus.cc:3055] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.249651 26229 raft_consensus.cc:740] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.250474 26229 consensus_queue.cc:260] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.251662 26229 raft_consensus.cc:3060] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.254195 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.254927 26302 raft_consensus.cc:3055] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.255237 26302 raft_consensus.cc:740] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:30.256104 26302 consensus_queue.cc:260] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.257037 26304 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.257503 26302 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.258687 26119 leader_election.cc:304] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:30.259893 26409 raft_consensus.cc:2804] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.260808 26409 raft_consensus.cc:697] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.261910 26409 consensus_queue.cc:237] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.268090 26302 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.268815 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:30.267146 26230 raft_consensus.cc:515] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.269500 26228 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.269991 26119 leader_election.cc:304] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:30.271059 26409 raft_consensus.cc:2804] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.271651 26409 raft_consensus.cc:697] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.272535 26409 consensus_queue.cc:237] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.275285 26229 raft_consensus.cc:2468] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.280289 26230 leader_election.cc:290] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.281355 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.282033 26302 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.283639 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:30.284618 26228 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.284308 26155 raft_consensus.cc:3055] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.285672 26155 raft_consensus.cc:740] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.284305 26052 catalog_manager.cc:5697] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.286640 26155 consensus_queue.cc:260] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.287827 26155 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.289708 26302 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.289183 26052 catalog_manager.cc:5697] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 37b7ac6292c746b38781ce11b74917db (127.14.246.66) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.290928 26194 leader_election.cc:304] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:30.291826 26367 raft_consensus.cc:2804] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.293241 26367 raft_consensus.cc:697] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.294965 26367 consensus_queue.cc:237] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.298338 26155 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.298933 26352 consensus_queue.cc:1048] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.302848 26370 consensus_queue.cc:1048] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.307075 26052 catalog_manager.cc:5697] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.310535 26367 raft_consensus.cc:993] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: : Instructing follower 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:30.311120 26367 raft_consensus.cc:1081] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Signalling peer 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:30.314056 26409 raft_consensus.cc:493] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:30.314646 26409 raft_consensus.cc:515] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.315071 26302 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed04677ca4544014a160876e304b6fed"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:60840
I20260709 13:10:30.315716 26302 raft_consensus.cc:493] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.316067 26302 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.315964 26367 consensus_queue.cc:1048] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:30.316743 26409 leader_election.cc:290] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.318380 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:30.319314 26368 raft_consensus.cc:993] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.319789 26368 raft_consensus.cc:1081] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.321393 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:30.323382 26121 leader_election.cc:304] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:30.324916 26409 raft_consensus.cc:2749] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:30.325742 26228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:10:30.326364 26228 raft_consensus.cc:493] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.326753 26228 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.332712 26302 raft_consensus.cc:515] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.333359 26152 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:30.333765 26228 raft_consensus.cc:515] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.336180 26228 leader_election.cc:290] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.336664 26230 raft_consensus.cc:1240] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Rejecting Update request from peer 34bd6ed366aa48a99dd05b93a3e2819f for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.336931 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:30.338282 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa01dddbf9f54f318bff64aafc28a008" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.338907 26303 raft_consensus.cc:3055] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.339232 26303 raft_consensus.cc:740] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:30.340098 26303 consensus_queue.cc:260] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.341054 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:30.341266 26303 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.342304 26302 leader_election.cc:290] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:30.346696 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed04677ca4544014a160876e304b6fed" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:30.347388 26228 raft_consensus.cc:3055] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.347842 26228 raft_consensus.cc:740] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.348913 26228 consensus_queue.cc:260] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.350281 26228 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.350783 26303 raft_consensus.cc:2468] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.351979 26155 raft_consensus.cc:3060] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.352324 26194 leader_election.cc:304] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:30.353193 26367 raft_consensus.cc:2804] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.353717 26367 raft_consensus.cc:697] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.354537 26367 consensus_queue.cc:237] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.357780 26228 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 2.
I20260709 13:10:30.359045 26270 leader_election.cc:304] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:30.359150 26155 raft_consensus.cc:2468] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 2.
I20260709 13:10:30.359907 26368 raft_consensus.cc:2804] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.360452 26368 raft_consensus.cc:697] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:30.361300 26368 consensus_queue.cc:237] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.361598 26053 catalog_manager.cc:5697] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.370229 26050 catalog_manager.cc:5697] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 1 to 2, leader changed from 37b7ac6292c746b38781ce11b74917db (127.14.246.66) to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 2 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.426864 26370 raft_consensus.cc:993] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.427356 26368 raft_consensus.cc:1081] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.429123 26155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:30.429723 26155 raft_consensus.cc:493] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.430117 26155 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.435185 26155 raft_consensus.cc:515] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.436986 26155 leader_election.cc:290] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.437680 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:30.437922 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf046f457e3473492627a8b7bbe4ea9" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.438414 26228 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.438508 26303 raft_consensus.cc:3055] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.438925 26303 raft_consensus.cc:740] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:30.439548 26303 consensus_queue.cc:260] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.440475 26303 raft_consensus.cc:3060] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.443441 26228 raft_consensus.cc:2468] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.444484 26121 leader_election.cc:304] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:30.445220 26409 raft_consensus.cc:2804] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.445400 26303 raft_consensus.cc:2468] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.445607 26409 raft_consensus.cc:697] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.446491 26409 consensus_queue.cc:237] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.452759 26050 catalog_manager.cc:5697] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.497293 26370 raft_consensus.cc:993] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.497810 26368 raft_consensus.cc:1081] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.499473 26228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:10:30.500067 26228 raft_consensus.cc:493] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.500470 26228 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.505631 26228 raft_consensus.cc:515] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.507297 26228 leader_election.cc:290] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.508100 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:30.508463 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bbbc80ec2342d4893b3ff2e474a8f5" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.508920 26155 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.509100 26303 raft_consensus.cc:3055] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.509512 26303 raft_consensus.cc:740] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:30.510318 26303 consensus_queue.cc:260] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.511584 26303 raft_consensus.cc:3060] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.516247 26155 raft_consensus.cc:2468] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.517526 26193 leader_election.cc:304] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:30.518353 26367 raft_consensus.cc:2804] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.518886 26303 raft_consensus.cc:2468] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.518882 26367 raft_consensus.cc:697] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.520200 26367 consensus_queue.cc:237] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.526481 26050 catalog_manager.cc:5697] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.596252 26386 raft_consensus.cc:993] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.596765 26409 raft_consensus.cc:1081] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:30.598342 26228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53878
I20260709 13:10:30.598896 26228 raft_consensus.cc:493] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.599218 26228 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.604065 26228 raft_consensus.cc:515] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.605839 26228 leader_election.cc:290] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:30.606745 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:30.606839 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf04949c6a9c4f32902c05199aa81aa1" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.607563 26155 raft_consensus.cc:3055] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.607735 26303 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.607883 26155 raft_consensus.cc:740] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.608721 26155 consensus_queue.cc:260] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.609759 26155 raft_consensus.cc:3060] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.616510 26303 raft_consensus.cc:2468] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.616984 26367 raft_consensus.cc:993] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.617539 26352 raft_consensus.cc:1081] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:30.617879 26194 leader_election.cc:304] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:30.618693 26352 raft_consensus.cc:2804] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.618858 26155 raft_consensus.cc:2468] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:30.619202 26152 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34922
I20260709 13:10:30.619825 26152 raft_consensus.cc:493] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.619216 26352 raft_consensus.cc:697] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.620245 26152 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.620940 26352 consensus_queue.cc:237] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:30.627409 26152 raft_consensus.cc:515] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:30.629217 26152 leader_election.cc:290] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:30.628546 26050 catalog_manager.cc:5697] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.630059 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:30.630282 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "996fc0d8b9e54101b9d7dd4b438d8d62" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:30.630707 26303 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.630903 26228 raft_consensus.cc:3055] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.631323 26228 raft_consensus.cc:740] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:30.632092 26228 consensus_queue.cc:260] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:30.633497 26228 raft_consensus.cc:3060] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.636979 26303 raft_consensus.cc:2468] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.638468 26119 leader_election.cc:304] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:30.639321 26409 raft_consensus.cc:2804] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:30.639812 26409 raft_consensus.cc:697] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:30.640209 26228 raft_consensus.cc:2468] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:30.640668 26409 consensus_queue.cc:237] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } }
I20260709 13:10:30.647225 26050 catalog_manager.cc:5697] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 37b7ac6292c746b38781ce11b74917db (127.14.246.66) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.687361 26228 raft_consensus.cc:1275] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.688515 26409 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.692373 26152 raft_consensus.cc:1275] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.693703 26352 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.695317 26303 raft_consensus.cc:1275] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.697187 26379 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.701879 26302 raft_consensus.cc:1275] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.705271 26352 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.800221 26152 raft_consensus.cc:3060] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.800328 26228 raft_consensus.cc:1275] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.802021 26368 consensus_queue.cc:1048] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.807264 26152 raft_consensus.cc:1275] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.811028 26352 consensus_queue.cc:1048] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:30.811637 26152 raft_consensus.cc:1275] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.813082 26368 consensus_queue.cc:1048] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.825096 26303 raft_consensus.cc:1275] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.828644 26352 consensus_queue.cc:1048] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.865438 26303 raft_consensus.cc:1275] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.866796 26379 consensus_queue.cc:1048] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.869437 26228 raft_consensus.cc:1275] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.870752 26379 consensus_queue.cc:1048] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.887339 26228 raft_consensus.cc:1275] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.888649 26379 consensus_queue.cc:1048] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.889115 26303 raft_consensus.cc:1275] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.890537 26379 consensus_queue.cc:1048] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.928320 26155 raft_consensus.cc:1275] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.929716 26352 consensus_queue.cc:1048] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.937219 26302 raft_consensus.cc:1275] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.939181 26384 consensus_queue.cc:1048] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.075109 26302 raft_consensus.cc:1275] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.076598 26379 consensus_queue.cc:1048] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.085139 26228 raft_consensus.cc:1275] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.086710 26379 consensus_queue.cc:1048] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.101063 26153 raft_consensus.cc:1275] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.102356 26384 consensus_queue.cc:1048] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:31.112360 26302 raft_consensus.cc:1275] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:31.113889 26352 consensus_queue.cc:1048] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.207821 26050 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53218:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:33.210703 26050 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:33.272048 26139 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7329e11d5f4704a7c18d0d5dd15218 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:33.273417 26139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7329e11d5f4704a7c18d0d5dd15218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.273397 26220 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7329e11d5f4704a7c18d0d5dd15218 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:33.274520 26289 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7329e11d5f4704a7c18d0d5dd15218 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:33.274891 26220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7329e11d5f4704a7c18d0d5dd15218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.275817 26289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7329e11d5f4704a7c18d0d5dd15218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.281550 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 76810b43da7144fbb0bfdd79693a0e2a (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:33.282948 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76810b43da7144fbb0bfdd79693a0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.286602 26291 tablet_service.cc:1511] Processing CreateTablet for tablet 76810b43da7144fbb0bfdd79693a0e2a (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:33.286911 26142 tablet_service.cc:1511] Processing CreateTablet for tablet cd98a793a05c40deb19393eb2fd98cf6 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:33.287875 26213 tablet_service.cc:1511] Processing CreateTablet for tablet 76810b43da7144fbb0bfdd79693a0e2a (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:33.288369 26291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76810b43da7144fbb0bfdd79693a0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.289326 26213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76810b43da7144fbb0bfdd79693a0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.288388 26142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd98a793a05c40deb19393eb2fd98cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.308862 26219 tablet_service.cc:1511] Processing CreateTablet for tablet cd98a793a05c40deb19393eb2fd98cf6 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:33.310431 26219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd98a793a05c40deb19393eb2fd98cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.327734 26448 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.333982 26448 tablet_bootstrap.cc:654] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.337941 26447 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.341908 26288 tablet_service.cc:1511] Processing CreateTablet for tablet cd98a793a05c40deb19393eb2fd98cf6 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:33.343475 26288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd98a793a05c40deb19393eb2fd98cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.359221 26447 tablet_bootstrap.cc:654] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.360745 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 0af6bcc892d74e578b1a7595b83a85c2 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:33.362572 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af6bcc892d74e578b1a7595b83a85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.365510 26448 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.366055 26448 ts_tablet_manager.cc:1403] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.025s
I20260709 13:10:33.369572 26216 tablet_service.cc:1511] Processing CreateTablet for tablet 0af6bcc892d74e578b1a7595b83a85c2 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:33.370952 26216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af6bcc892d74e578b1a7595b83a85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.371011 26291 tablet_service.cc:1511] Processing CreateTablet for tablet 0af6bcc892d74e578b1a7595b83a85c2 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:33.372496 26291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0af6bcc892d74e578b1a7595b83a85c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.377534 26447 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.378170 26447 ts_tablet_manager.cc:1403] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 13:10:33.381541 26447 raft_consensus.cc:359] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.382305 26447 raft_consensus.cc:385] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.382630 26447 raft_consensus.cc:740] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.383248 26448 raft_consensus.cc:359] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.384007 26448 raft_consensus.cc:385] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.384300 26448 raft_consensus.cc:740] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.386247 26450 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:33.388991 26448 consensus_queue.cc:260] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.393185 26447 consensus_queue.cc:260] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.394827 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab4f3a3593541528b67044e2c186a37 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:33.398255 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab4f3a3593541528b67044e2c186a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.397219 26448 ts_tablet_manager.cc:1434] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:10:33.401157 26448 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.403309 26447 ts_tablet_manager.cc:1434] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:10:33.404529 26447 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.404343 26289 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab4f3a3593541528b67044e2c186a37 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:33.405704 26289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab4f3a3593541528b67044e2c186a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.411897 26447 tablet_bootstrap.cc:654] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.413667 26213 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab4f3a3593541528b67044e2c186a37 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:33.415546 26450 tablet_bootstrap.cc:654] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.426056 26447 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.426072 26142 tablet_service.cc:1511] Processing CreateTablet for tablet 262b161b97674fdabce1d7b3e572c578 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:33.426899 26447 ts_tablet_manager.cc:1403] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:10:33.427774 26142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262b161b97674fdabce1d7b3e572c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.425719 26448 tablet_bootstrap.cc:654] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.417946 26213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab4f3a3593541528b67044e2c186a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.430565 26447 raft_consensus.cc:359] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.439558 26447 raft_consensus.cc:385] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.439888 26447 raft_consensus.cc:740] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.434592 26288 tablet_service.cc:1511] Processing CreateTablet for tablet 262b161b97674fdabce1d7b3e572c578 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:33.440721 26447 consensus_queue.cc:260] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.441869 26288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262b161b97674fdabce1d7b3e572c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.443482 26447 ts_tablet_manager.cc:1434] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:10:33.444661 26447 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.458187 26447 tablet_bootstrap.cc:654] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.438426 26139 tablet_service.cc:1511] Processing CreateTablet for tablet 783071ecb7344b7c8da936e4d130b3cb (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:33.463006 26139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783071ecb7344b7c8da936e4d130b3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.463071 26450 tablet_bootstrap.cc:492] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:33.463733 26450 ts_tablet_manager.cc:1403] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.006s
I20260709 13:10:33.466929 26450 raft_consensus.cc:359] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.467684 26450 raft_consensus.cc:385] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.472967 26450 raft_consensus.cc:740] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.475065 26220 tablet_service.cc:1511] Processing CreateTablet for tablet 783071ecb7344b7c8da936e4d130b3cb (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:33.438237 26216 tablet_service.cc:1511] Processing CreateTablet for tablet 262b161b97674fdabce1d7b3e572c578 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:33.476496 26220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783071ecb7344b7c8da936e4d130b3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.477155 26216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 262b161b97674fdabce1d7b3e572c578. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.478502 26289 tablet_service.cc:1511] Processing CreateTablet for tablet 783071ecb7344b7c8da936e4d130b3cb (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:33.479853 26289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783071ecb7344b7c8da936e4d130b3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.485824 26436 raft_consensus.cc:493] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.484786 26219 tablet_service.cc:1511] Processing CreateTablet for tablet 65c8f4c5c14d4d938c27eacdc27f0c21 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:33.486439 26436 raft_consensus.cc:515] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.487390 26219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c8f4c5c14d4d938c27eacdc27f0c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.489964 26436 leader_election.cc:290] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.493692 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:33.494431 26448 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.495035 26448 ts_tablet_manager.cc:1403] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.006s
I20260709 13:10:33.495864 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.473742 26450 consensus_queue.cc:260] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.484786 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 65c8f4c5c14d4d938c27eacdc27f0c21 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:33.501731 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c8f4c5c14d4d938c27eacdc27f0c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.496695 26153 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.505375 26228 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.505964 26448 raft_consensus.cc:359] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.506840 26448 raft_consensus.cc:385] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.507136 26448 raft_consensus.cc:740] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.508142 26448 consensus_queue.cc:260] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.513813 26267 leader_election.cc:304] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:33.521078 26436 raft_consensus.cc:2804] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.528492 26436 raft_consensus.cc:493] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.529049 26436 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.534581 26288 tablet_service.cc:1511] Processing CreateTablet for tablet 65c8f4c5c14d4d938c27eacdc27f0c21 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:33.535981 26288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c8f4c5c14d4d938c27eacdc27f0c21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:33.547922 26101 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:33.556922 26448 ts_tablet_manager.cc:1434] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.000s
I20260709 13:10:33.558473 26448 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.572503 26213 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5f0fdeaf0b4e4091702d26ee49c341 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:33.572726 26436 raft_consensus.cc:515] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.573951 26213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5f0fdeaf0b4e4091702d26ee49c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.574820 26450 ts_tablet_manager.cc:1434] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.111s	user 0.026s	sys 0.010s
I20260709 13:10:33.575935 26450 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:33.576210 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:33.576879 26228 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.578552 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.578861 26145 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5f0fdeaf0b4e4091702d26ee49c341 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:33.580236 26145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5f0fdeaf0b4e4091702d26ee49c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.581539 26153 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.583007 26436 leader_election.cc:290] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.572966 26288 tablet_service.cc:1511] Processing CreateTablet for tablet 3f5f0fdeaf0b4e4091702d26ee49c341 (DEFAULT_TABLE table=soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:33.584508 26288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5f0fdeaf0b4e4091702d26ee49c341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.585281 26228 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.586510 26270 leader_election.cc:304] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:33.587352 26436 raft_consensus.cc:2804] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.590834 26153 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.598287 26450 tablet_bootstrap.cc:654] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.610141 26458 raft_consensus.cc:493] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.610776 26458 raft_consensus.cc:515] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.612582 26448 tablet_bootstrap.cc:654] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.631629 26447 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.632865 26447 ts_tablet_manager.cc:1403] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.188s	user 0.043s	sys 0.039s
I20260709 13:10:33.633466 26436 raft_consensus.cc:697] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:33.634478 26436 consensus_queue.cc:237] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.638439 26447 raft_consensus.cc:359] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.639302 26447 raft_consensus.cc:385] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.639382 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.643184 26153 raft_consensus.cc:2468] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.641183 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
W20260709 13:10:33.646548 26270 leader_election.cc:343] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.648159 26267 leader_election.cc:304] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:33.642234 26447 raft_consensus.cc:740] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.649652 26459 raft_consensus.cc:2804] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.650190 26459 raft_consensus.cc:493] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.650707 26459 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.650228 26447 consensus_queue.cc:260] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.654537 26447 ts_tablet_manager.cc:1434] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:10:33.655932 26447 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.667042 26448 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.667659 26448 ts_tablet_manager.cc:1403] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.032s
I20260709 13:10:33.667928 26447 tablet_bootstrap.cc:654] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.671315 26448 raft_consensus.cc:359] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.672379 26448 raft_consensus.cc:385] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.672935 26448 raft_consensus.cc:740] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.673967 26448 consensus_queue.cc:260] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.684618 26447 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.685511 26447 ts_tablet_manager.cc:1403] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.008s
I20260709 13:10:33.682093 26465 raft_consensus.cc:493] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.688972 26465 raft_consensus.cc:515] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.692977 26458 leader_election.cc:290] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.693195 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.694669 26153 raft_consensus.cc:2468] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.696364 26267 leader_election.cc:304] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:33.699781 26450 tablet_bootstrap.cc:492] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:33.700455 26458 raft_consensus.cc:2804] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.701476 26458 raft_consensus.cc:493] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.702101 26458 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.702513 26447 raft_consensus.cc:359] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.703742 26447 raft_consensus.cc:385] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.704197 26447 raft_consensus.cc:740] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.705942 26465 leader_election.cc:290] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.707010 26447 consensus_queue.cc:260] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.707589 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
W20260709 13:10:33.709913 26270 leader_election.cc:343] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.710526 26447 ts_tablet_manager.cc:1434] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:10:33.711333 26450 ts_tablet_manager.cc:1403] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.136s	user 0.014s	sys 0.007s
I20260709 13:10:33.711826 26447 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.726583 26447 tablet_bootstrap.cc:654] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.691900 26459 raft_consensus.cc:515] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.739635 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.739886 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:33.740636 26153 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:33.742394 26270 leader_election.cc:343] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.747325 26450 raft_consensus.cc:359] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.758204 26450 raft_consensus.cc:385] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.755158 26447 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.762210 26447 ts_tablet_manager.cc:1403] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.001s
I20260709 13:10:33.762858 26448 ts_tablet_manager.cc:1434] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.095s	user 0.024s	sys 0.065s
I20260709 13:10:33.764110 26448 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.763983 26458 raft_consensus.cc:515] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.764755 26053 catalog_manager.cc:5697] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.761560 26450 raft_consensus.cc:740] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.772749 26448 tablet_bootstrap.cc:654] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.770956 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:33.748600 26459 leader_election.cc:290] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.775849 26450 consensus_queue.cc:260] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.765712 26447 raft_consensus.cc:359] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.768471 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.776937 26228 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.777122 26155 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.778355 26450 ts_tablet_manager.cc:1434] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.004s
I20260709 13:10:33.779435 26450 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:33.781214 26447 raft_consensus.cc:385] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.781786 26447 raft_consensus.cc:740] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.786023 26450 tablet_bootstrap.cc:654] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.769586 26458 leader_election.cc:290] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.759718 26153 raft_consensus.cc:2468] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.788650 26267 leader_election.cc:304] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:33.789283 26447 consensus_queue.cc:260] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.790136 26458 raft_consensus.cc:2804] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.790699 26458 raft_consensus.cc:697] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:33.792069 26447 ts_tablet_manager.cc:1434] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:10:33.791636 26458 consensus_queue.cc:237] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.793970 26447 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.788683 26228 raft_consensus.cc:2468] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.797896 26270 leader_election.cc:304] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:33.799747 26155 raft_consensus.cc:2468] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.802497 26459 raft_consensus.cc:2804] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.803258 26459 raft_consensus.cc:697] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:33.812021 26447 tablet_bootstrap.cc:654] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.804338 26459 consensus_queue.cc:237] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.816990 26448 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.817834 26448 ts_tablet_manager.cc:1403] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.013s
I20260709 13:10:33.821808 26448 raft_consensus.cc:359] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.822607 26448 raft_consensus.cc:385] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.822914 26448 raft_consensus.cc:740] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.823693 26448 consensus_queue.cc:260] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.829135 26448 ts_tablet_manager.cc:1434] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:10:33.830206 26448 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.843257 26448 tablet_bootstrap.cc:654] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.849889 26459 raft_consensus.cc:493] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.852066 26459 raft_consensus.cc:515] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.861433 26447 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.862241 26447 ts_tablet_manager.cc:1403] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.004s
I20260709 13:10:33.866757 26447 raft_consensus.cc:359] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.867659 26448 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.867849 26447 raft_consensus.cc:385] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.868954 26447 raft_consensus.cc:740] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.869863 26447 consensus_queue.cc:260] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.870800 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.871584 26155 raft_consensus.cc:2468] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.872494 26447 ts_tablet_manager.cc:1434] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:33.873230 26267 leader_election.cc:304] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:33.873739 26447 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.874650 26459 leader_election.cc:290] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.875283 26459 raft_consensus.cc:2804] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.875624 26459 raft_consensus.cc:493] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.875979 26459 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.876958 26448 ts_tablet_manager.cc:1403] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.008s
I20260709 13:10:33.880445 26448 raft_consensus.cc:359] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.880646 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:33.881260 26448 raft_consensus.cc:385] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.881675 26448 raft_consensus.cc:740] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
W20260709 13:10:33.885715 26270 leader_election.cc:343] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.888564 26450 tablet_bootstrap.cc:492] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:33.882694 26448 consensus_queue.cc:260] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.889650 26458 raft_consensus.cc:493] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.889392 26051 catalog_manager.cc:5697] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.890127 26458 raft_consensus.cc:515] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.890555 26447 tablet_bootstrap.cc:654] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.891626 26448 ts_tablet_manager.cc:1434] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:33.889174 26450 ts_tablet_manager.cc:1403] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.110s	user 0.036s	sys 0.062s
I20260709 13:10:33.893057 26448 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.894915 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.895548 26155 raft_consensus.cc:2468] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.895921 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:33.897644 26267 leader_election.cc:304] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:33.898543 26464 raft_consensus.cc:2804] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:33.898629 26270 leader_election.cc:343] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.894037 26459 raft_consensus.cc:515] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.899044 26464 raft_consensus.cc:493] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.899762 26464 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.899344 26450 raft_consensus.cc:359] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.900300 26450 raft_consensus.cc:385] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.900650 26450 raft_consensus.cc:740] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.901654 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.902208 26155 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.902678 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:33.901407 26450 consensus_queue.cc:260] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
W20260709 13:10:33.904230 26270 leader_election.cc:343] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.904891 26459 leader_election.cc:290] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.891319 26051 catalog_manager.cc:5697] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.906909 26450 ts_tablet_manager.cc:1434] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:33.907941 26458 leader_election.cc:290] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.908875 26155 raft_consensus.cc:2468] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.907987 26450 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:33.913689 26267 leader_election.cc:304] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:33.915073 26458 raft_consensus.cc:2804] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.915565 26458 raft_consensus.cc:697] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:33.916637 26464 raft_consensus.cc:515] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.917601 26448 tablet_bootstrap.cc:654] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.917863 26450 tablet_bootstrap.cc:654] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.920392 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.920822 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:33.921211 26153 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:33.922851 26270 leader_election.cc:343] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.925096 26464 leader_election.cc:290] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.929811 26448 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.933446 26448 ts_tablet_manager.cc:1403] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.006s
I20260709 13:10:33.916414 26458 consensus_queue.cc:237] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.936656 26448 raft_consensus.cc:359] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.937403 26448 raft_consensus.cc:385] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.937680 26448 raft_consensus.cc:740] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.938426 26448 consensus_queue.cc:260] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.940639 26448 ts_tablet_manager.cc:1434] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:33.941695 26448 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.932380 26153 raft_consensus.cc:2468] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:33.945320 26464 raft_consensus.cc:493] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.945873 26464 raft_consensus.cc:515] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.947976 26464 leader_election.cc:290] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:33.948508 26447 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.949127 26447 ts_tablet_manager.cc:1403] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.021s
I20260709 13:10:33.949566 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:33.951361 26448 tablet_bootstrap.cc:654] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:33.952168 26270 leader_election.cc:343] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:33.952468 26447 raft_consensus.cc:359] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.953122 26267 leader_election.cc:304] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:33.953388 26447 raft_consensus.cc:385] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.954219 26447 raft_consensus.cc:740] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.955080 26447 consensus_queue.cc:260] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.955479 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:33.957690 26447 ts_tablet_manager.cc:1434] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:10:33.958877 26447 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
I20260709 13:10:33.959110 26459 raft_consensus.cc:2804] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:33.959642 26459 raft_consensus.cc:697] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:33.959358 26052 catalog_manager.cc:5697] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.960451 26459 consensus_queue.cc:237] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.956187 26153 raft_consensus.cc:2468] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:33.963939 26267 leader_election.cc:304] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:33.965605 26436 raft_consensus.cc:2804] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:33.966147 26436 raft_consensus.cc:493] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.966645 26436 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.978689 26447 tablet_bootstrap.cc:654] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.982905 26448 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:33.983376 26448 ts_tablet_manager.cc:1403] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.006s
I20260709 13:10:33.984822 26436 raft_consensus.cc:515] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.985924 26448 raft_consensus.cc:359] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.986665 26448 raft_consensus.cc:385] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.986936 26448 raft_consensus.cc:740] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:33.987792 26448 consensus_queue.cc:260] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.989028 26447 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:33.989578 26447 ts_tablet_manager.cc:1403] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.000s
I20260709 13:10:33.990002 26448 ts_tablet_manager.cc:1434] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:33.991010 26448 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:33.991478 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:33.992233 26153 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:33.996615 26447 raft_consensus.cc:359] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:33.998422 26447 raft_consensus.cc:385] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:33.998804 26448 tablet_bootstrap.cc:654] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:33.998721 26447 raft_consensus.cc:740] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.000376 26447 consensus_queue.cc:260] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.001672 26052 catalog_manager.cc:5697] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.005539 26436 leader_election.cc:290] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:34.005927 26447 ts_tablet_manager.cc:1434] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:34.006690 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.006969 26447 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: Bootstrap starting.
W20260709 13:10:34.008136 26270 leader_election.cc:343] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:34.010671 26153 raft_consensus.cc:2468] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:34.012400 26267 leader_election.cc:304] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:34.014045 26436 raft_consensus.cc:2804] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.014806 26436 raft_consensus.cc:697] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.015717 26450 tablet_bootstrap.cc:492] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.015671 26436 consensus_queue.cc:237] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.016379 26450 ts_tablet_manager.cc:1403] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.109s	user 0.026s	sys 0.019s
I20260709 13:10:34.016654 26447 tablet_bootstrap.cc:654] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.025784 26448 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:34.026497 26448 ts_tablet_manager.cc:1403] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.036s	user 0.002s	sys 0.008s
I20260709 13:10:34.020201 26450 raft_consensus.cc:359] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.027357 26450 raft_consensus.cc:385] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.027710 26450 raft_consensus.cc:740] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.028534 26450 consensus_queue.cc:260] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.029307 26448 raft_consensus.cc:359] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.029995 26448 raft_consensus.cc:385] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.030248 26448 raft_consensus.cc:740] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.031073 26450 ts_tablet_manager.cc:1434] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:34.030908 26448 consensus_queue.cc:260] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.031983 26447 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: No bootstrap required, opened a new log
I20260709 13:10:34.032281 26450 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:34.032536 26447 ts_tablet_manager.cc:1403] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.003s
I20260709 13:10:34.033231 26448 ts_tablet_manager.cc:1434] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:34.034155 26448 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: Bootstrap starting.
I20260709 13:10:34.039556 26450 tablet_bootstrap.cc:654] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.039970 26448 tablet_bootstrap.cc:654] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.041502 26447 raft_consensus.cc:359] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.042302 26447 raft_consensus.cc:385] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.042652 26447 raft_consensus.cc:740] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.043637 26447 consensus_queue.cc:260] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.046845 26447 ts_tablet_manager.cc:1434] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:34.051611 26450 tablet_bootstrap.cc:492] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.052201 26450 ts_tablet_manager.cc:1403] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 13:10:34.054845 26450 raft_consensus.cc:359] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.055497 26450 raft_consensus.cc:385] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.055917 26450 raft_consensus.cc:740] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.056192 26052 catalog_manager.cc:5697] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.057090 26450 consensus_queue.cc:260] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.059965 26450 ts_tablet_manager.cc:1434] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:34.060609 26448 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: No bootstrap required, opened a new log
I20260709 13:10:34.061118 26450 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:34.061252 26448 ts_tablet_manager.cc:1403] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 13:10:34.064393 26448 raft_consensus.cc:359] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.065119 26448 raft_consensus.cc:385] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.065402 26448 raft_consensus.cc:740] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.066089 26448 consensus_queue.cc:260] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.068230 26448 ts_tablet_manager.cc:1434] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:34.073436 26450 tablet_bootstrap.cc:654] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.079651 26450 tablet_bootstrap.cc:492] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.080097 26450 ts_tablet_manager.cc:1403] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:10:34.082306 26450 raft_consensus.cc:359] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.082876 26450 raft_consensus.cc:385] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.083113 26450 raft_consensus.cc:740] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.083665 26450 consensus_queue.cc:260] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.085626 26450 ts_tablet_manager.cc:1434] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:10:34.086709 26450 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:34.092978 26450 tablet_bootstrap.cc:654] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.096455 26459 consensus_queue.cc:1048] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.099020 26450 tablet_bootstrap.cc:492] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.099664 26450 ts_tablet_manager.cc:1403] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:10:34.103104 26450 raft_consensus.cc:359] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.103847 26450 raft_consensus.cc:385] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.104151 26450 raft_consensus.cc:740] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.105043 26450 consensus_queue.cc:260] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.107425 26450 ts_tablet_manager.cc:1434] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:34.108469 26450 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:34.114872 26450 tablet_bootstrap.cc:654] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.119437 26459 consensus_queue.cc:1048] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.122872 26450 tablet_bootstrap.cc:492] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.123503 26450 ts_tablet_manager.cc:1403] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:10:34.125712 26450 raft_consensus.cc:359] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.126225 26450 raft_consensus.cc:385] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.126502 26450 raft_consensus.cc:740] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.127210 26450 consensus_queue.cc:260] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.129276 26450 ts_tablet_manager.cc:1434] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:10:34.130128 26450 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: Bootstrap starting.
I20260709 13:10:34.135504 26450 tablet_bootstrap.cc:654] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:34.140947 26450 tablet_bootstrap.cc:492] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: No bootstrap required, opened a new log
I20260709 13:10:34.141510 26450 ts_tablet_manager.cc:1403] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:10:34.144315 26450 raft_consensus.cc:359] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.144904 26450 raft_consensus.cc:385] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:34.145148 26450 raft_consensus.cc:740] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Initialized, Role: FOLLOWER
I20260709 13:10:34.145710 26450 consensus_queue.cc:260] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.147238 26450 ts_tablet_manager.cc:1434] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:34.189432 26379 raft_consensus.cc:493] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.190009 26379 raft_consensus.cc:515] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.191752 26379 leader_election.cc:290] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.192579 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:34.192797 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:34.193271 26228 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 0.
I20260709 13:10:34.193583 26302 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 0.
I20260709 13:10:34.194444 26121 leader_election.cc:304] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.195289 26379 raft_consensus.cc:2804] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.195583 26379 raft_consensus.cc:493] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.195866 26379 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.201139 26379 raft_consensus.cc:515] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.202725 26379 leader_election.cc:290] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.203531 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.203824 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.204031 26228 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.204500 26302 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.209169 26228 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:34.209730 26302 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 1.
I20260709 13:10:34.210263 26121 leader_election.cc:304] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.211143 26379 raft_consensus.cc:2804] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.211688 26379 raft_consensus.cc:697] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:34.212502 26379 consensus_queue.cc:237] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.219470 26052 catalog_manager.cc:5697] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 1 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.234462 26433 raft_consensus.cc:493] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.235061 26433 raft_consensus.cc:515] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.237161 26433 leader_election.cc:290] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.237874 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.238189 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:34.238796 26153 raft_consensus.cc:2393] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37b7ac6292c746b38781ce11b74917db in current term 1: Already voted for candidate 34bd6ed366aa48a99dd05b93a3e2819f in this term.
I20260709 13:10:34.239789 26193 leader_election.cc:304] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.240401 26433 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.245924 26433 raft_consensus.cc:2749] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.262036 26433 raft_consensus.cc:493] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.262548 26433 raft_consensus.cc:515] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.263860 26228 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.265446 26433 leader_election.cc:290] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.265627 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.266454 26153 raft_consensus.cc:2393] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37b7ac6292c746b38781ce11b74917db in current term 1: Already voted for candidate 34bd6ed366aa48a99dd05b93a3e2819f in this term.
I20260709 13:10:34.268304 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:34.269210 26459 consensus_queue.cc:1048] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.269838 26194 leader_election.cc:304] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.271198 26433 raft_consensus.cc:2749] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.272084 26459 consensus_queue.cc:1048] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.282502 26500 consensus_queue.cc:1048] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.289350 26500 consensus_queue.cc:1048] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.335388 26230 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.341429 26500 consensus_queue.cc:1048] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.353407 26459 consensus_queue.cc:1048] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.361393 26500 raft_consensus.cc:493] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.361902 26500 raft_consensus.cc:515] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.364022 26500 leader_election.cc:290] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:34.364732 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.365095 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:34.365469 26153 raft_consensus.cc:2468] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:34.365767 26230 raft_consensus.cc:2468] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:34.366611 26267 leader_election.cc:304] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.367430 26500 raft_consensus.cc:2804] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.367764 26500 raft_consensus.cc:493] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.368068 26500 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.374703 26500 raft_consensus.cc:515] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.376600 26500 leader_election.cc:290] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:34.377512 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:34.377599 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.378358 26153 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.378443 26230 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.385027 26153 raft_consensus.cc:2468] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:34.385067 26230 raft_consensus.cc:2468] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:34.386237 26267 leader_election.cc:304] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.386988 26500 raft_consensus.cc:2804] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.387506 26500 raft_consensus.cc:697] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.388387 26500 consensus_queue.cc:237] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.391454 26500 raft_consensus.cc:493] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.391944 26500 raft_consensus.cc:515] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.393977 26500 leader_election.cc:290] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:34.394630 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.395108 26433 raft_consensus.cc:493] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.395530 26153 raft_consensus.cc:2468] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 0.
I20260709 13:10:34.395638 26433 raft_consensus.cc:515] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.396782 26267 leader_election.cc:304] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.396385 26050 catalog_manager.cc:5697] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.397627 26500 raft_consensus.cc:2804] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:34.397913 26433 leader_election.cc:290] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.398028 26500 raft_consensus.cc:493] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.398634 26500 raft_consensus.cc:3060] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.398811 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.399616 26153 raft_consensus.cc:2393] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37b7ac6292c746b38781ce11b74917db in current term 1: Already voted for candidate 34bd6ed366aa48a99dd05b93a3e2819f in this term.
I20260709 13:10:34.401176 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:34.404840 26433 raft_consensus.cc:493] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.405375 26433 raft_consensus.cc:515] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.406517 26500 raft_consensus.cc:515] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.407397 26433 leader_election.cc:290] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.408319 26194 leader_election.cc:304] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.409032 26500 leader_election.cc:290] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:34.409649 26506 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.409878 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:34.410509 26153 raft_consensus.cc:3060] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.410792 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" is_pre_election: true
I20260709 13:10:34.412068 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.412640 26228 raft_consensus.cc:3060] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:34.413446 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" is_pre_election: true
I20260709 13:10:34.414242 26303 raft_consensus.cc:2393] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 37b7ac6292c746b38781ce11b74917db in current term 1: Already voted for candidate 34bd6ed366aa48a99dd05b93a3e2819f in this term.
I20260709 13:10:34.417008 26506 raft_consensus.cc:2749] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.417521 26193 leader_election.cc:304] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db; no voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.417656 26153 raft_consensus.cc:2468] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:34.395066 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f5f0fdeaf0b4e4091702d26ee49c341" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37b7ac6292c746b38781ce11b74917db" is_pre_election: true
I20260709 13:10:34.419013 26267 leader_election.cc:304] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.419816 26500 raft_consensus.cc:2804] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:34.420297 26500 raft_consensus.cc:697] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.421283 26228 raft_consensus.cc:2468] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 1.
I20260709 13:10:34.421135 26500 consensus_queue.cc:237] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.421811 26506 raft_consensus.cc:2749] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:34.428212 26500 consensus_queue.cc:1048] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.430655 26050 catalog_manager.cc:5697] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 0 to 1, leader changed from <none> to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 1 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.439355 26500 consensus_queue.cc:1048] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.470691 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.471333 26302 raft_consensus.cc:606] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.476738 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.477429 26302 raft_consensus.cc:606] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.478243 26436 consensus_queue.cc:1048] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.483348 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.483842 26302 raft_consensus.cc:606] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.490125 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.490758 26302 raft_consensus.cc:606] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.490515 26459 consensus_queue.cc:1048] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.498147 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.498741 26302 raft_consensus.cc:606] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:34.506695 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.507334 26302 raft_consensus.cc:606] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:34.512740 26155 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:34932
I20260709 13:10:34.513278 26155 raft_consensus.cc:606] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:34.518103 26302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
mode: GRACEFUL
new_leader_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:60862
I20260709 13:10:34.518606 26302 raft_consensus.cc:606] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Received request to transfer leadership to TS 37b7ac6292c746b38781ce11b74917db
I20260709 13:10:34.551010 26459 raft_consensus.cc:993] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.551538 26500 raft_consensus.cc:1081] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.553247 26155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:34.553733 26155 raft_consensus.cc:493] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.554046 26155 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.559190 26155 raft_consensus.cc:515] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.561600 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.561704 26155 leader_election.cc:290] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.561933 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7329e11d5f4704a7c18d0d5dd15218" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.562217 26228 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.562652 26302 raft_consensus.cc:3055] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.563022 26302 raft_consensus.cc:740] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.563895 26302 consensus_queue.cc:260] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.565284 26302 raft_consensus.cc:3060] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.568415 26228 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.570674 26121 leader_election.cc:304] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.571544 26379 raft_consensus.cc:2804] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.572041 26379 raft_consensus.cc:697] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:34.572587 26302 raft_consensus.cc:2468] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.572980 26379 consensus_queue.cc:237] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.580950 26051 catalog_manager.cc:5697] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.748417 26500 raft_consensus.cc:993] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.749359 26436 raft_consensus.cc:1081] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.751411 26155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:34.752163 26155 raft_consensus.cc:493] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.752528 26155 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.761010 26155 raft_consensus.cc:515] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.762688 26155 leader_election.cc:290] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.764009 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.764744 26230 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.764595 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd98a793a05c40deb19393eb2fd98cf6" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.765383 26302 raft_consensus.cc:3055] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.765657 26302 raft_consensus.cc:740] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.766542 26302 consensus_queue.cc:260] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.767741 26302 raft_consensus.cc:3060] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.771798 26230 raft_consensus.cc:2468] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.773255 26121 leader_election.cc:304] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.774322 26379 raft_consensus.cc:2804] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.774766 26379 raft_consensus.cc:697] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:34.774869 26302 raft_consensus.cc:2468] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.776316 26379 consensus_queue.cc:237] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.788169 26051 catalog_manager.cc:5697] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.802839 26436 consensus_queue.cc:1048] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.810735 26500 raft_consensus.cc:993] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:34.811357 26500 raft_consensus.cc:1081] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:34.814942 26228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:10:34.815518 26228 raft_consensus.cc:493] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.815899 26228 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.818646 26436 consensus_queue.cc:1048] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.824361 26228 raft_consensus.cc:515] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.827679 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:34.828181 26228 leader_election.cc:290] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.828393 26302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c8f4c5c14d4d938c27eacdc27f0c21" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.829140 26302 raft_consensus.cc:3055] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.829494 26302 raft_consensus.cc:740] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.830569 26302 consensus_queue.cc:260] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.831900 26302 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.835672 26379 consensus_queue.cc:1048] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.839124 26302 raft_consensus.cc:2468] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:34.840535 26194 leader_election.cc:304] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 6cdb83b3d7be4f21b426daee419bcfe4
I20260709 13:10:34.841427 26506 raft_consensus.cc:2804] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.841928 26506 raft_consensus.cc:697] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:34.843164 26506 consensus_queue.cc:237] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.844709 26379 consensus_queue.cc:1048] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:34.854210 26516 raft_consensus.cc:993] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:34.854830 26516 raft_consensus.cc:1081] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:34.856880 26051 catalog_manager.cc:5697] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.858132 26228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53878
I20260709 13:10:34.859053 26228 raft_consensus.cc:493] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.859469 26228 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.879691 26228 raft_consensus.cc:515] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.882937 26228 leader_election.cc:290] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.883625 26155 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:34.884289 26155 raft_consensus.cc:3055] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.884588 26155 raft_consensus.cc:740] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:34.885202 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783071ecb7344b7c8da936e4d130b3cb" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.885504 26155 consensus_queue.cc:260] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.885878 26303 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.886716 26155 raft_consensus.cc:3060] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.894794 26155 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:34.894805 26303 raft_consensus.cc:2468] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:34.895901 26194 leader_election.cc:304] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:34.896589 26506 raft_consensus.cc:2804] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.897018 26506 raft_consensus.cc:697] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:34.897990 26506 consensus_queue.cc:237] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.904080 26051 catalog_manager.cc:5697] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.918923 26459 raft_consensus.cc:993] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.919641 26459 raft_consensus.cc:1081] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.921913 26155 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:34.922505 26155 raft_consensus.cc:493] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.922832 26155 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.928257 26436 consensus_queue.cc:1048] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.928979 26155 raft_consensus.cc:515] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.930749 26155 leader_election.cc:290] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.931392 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.931838 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76810b43da7144fbb0bfdd79693a0e2a" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.932040 26230 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.932452 26303 raft_consensus.cc:3055] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.932848 26303 raft_consensus.cc:740] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.933688 26303 consensus_queue.cc:260] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.935120 26303 raft_consensus.cc:3060] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.942974 26303 raft_consensus.cc:2468] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.944344 26119 leader_election.cc:304] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.945451 26457 raft_consensus.cc:2804] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.945982 26457 raft_consensus.cc:697] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:34.947439 26230 raft_consensus.cc:2468] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.947057 26457 consensus_queue.cc:237] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.953413 26464 raft_consensus.cc:993] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.953835 26464 raft_consensus.cc:1081] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 6cdb83b3d7be4f21b426daee419bcfe4 to start an election
I20260709 13:10:34.955345 26464 consensus_queue.cc:1048] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:34.955648 26153 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
 from {username='slave'} at 127.0.0.1:34912
I20260709 13:10:34.956423 26153 raft_consensus.cc:493] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:34.956842 26153 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.963927 26053 catalog_manager.cc:5697] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.973670 26153 raft_consensus.cc:515] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.975987 26153 leader_election.cc:290] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Requested vote from peers 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:34.977329 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:34.978021 26303 raft_consensus.cc:3055] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.979185 26303 raft_consensus.cc:740] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:34.979571 26230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0af6bcc892d74e578b1a7595b83a85c2" candidate_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:34.980250 26230 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.980285 26303 consensus_queue.cc:260] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:34.981521 26228 raft_consensus.cc:1275] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.981904 26303 raft_consensus.cc:3060] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.983175 26457 consensus_queue.cc:1048] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.987958 26230 raft_consensus.cc:2468] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.989243 26121 leader_election.cc:304] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:34.990823 26457 raft_consensus.cc:2804] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.990953 26303 raft_consensus.cc:2468] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cdb83b3d7be4f21b426daee419bcfe4 in term 2.
I20260709 13:10:34.994292 26303 raft_consensus.cc:1275] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.995595 26516 consensus_queue.cc:1048] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.000890 26457 raft_consensus.cc:697] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Leader. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:35.002643 26457 consensus_queue.cc:237] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.012356 26053 catalog_manager.cc:5697] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65). New cstate: current_term: 2 leader_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.044445 26464 raft_consensus.cc:993] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:35.044981 26436 raft_consensus.cc:1081] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:35.046586 26230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:10:35.047187 26230 raft_consensus.cc:493] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.047547 26230 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.052904 26230 raft_consensus.cc:515] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.054260 26230 leader_election.cc:290] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:35.055332 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:35.055481 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "262b161b97674fdabce1d7b3e572c578" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:35.056002 26303 raft_consensus.cc:3055] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.056069 26153 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.056398 26303 raft_consensus.cc:740] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:35.057325 26303 consensus_queue.cc:260] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.058701 26303 raft_consensus.cc:3060] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.061780 26153 raft_consensus.cc:2468] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:35.062831 26193 leader_election.cc:304] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:35.063272 26303 raft_consensus.cc:2468] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:35.063558 26506 raft_consensus.cc:2804] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:35.064121 26506 raft_consensus.cc:697] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:35.065042 26506 consensus_queue.cc:237] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.071244 26051 catalog_manager.cc:5697] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.114425 26464 raft_consensus.cc:993] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: : Instructing follower 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:35.114915 26436 raft_consensus.cc:1081] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Signalling peer 37b7ac6292c746b38781ce11b74917db to start an election
I20260709 13:10:35.116238 26230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
 from {username='slave'} at 127.0.0.1:53868
I20260709 13:10:35.116621 26230 raft_consensus.cc:493] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.116882 26230 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.121241 26230 raft_consensus.cc:515] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.122563 26230 leader_election.cc:290] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67:38621)
I20260709 13:10:35.123327 26153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:35.123525 26303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab4f3a3593541528b67044e2c186a37" candidate_uuid: "37b7ac6292c746b38781ce11b74917db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
I20260709 13:10:35.124063 26303 raft_consensus.cc:3055] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.124017 26153 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.124528 26303 raft_consensus.cc:740] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:35.125293 26303 consensus_queue.cc:260] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.126261 26303 raft_consensus.cc:3060] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.129534 26153 raft_consensus.cc:2468] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:35.130652 26193 leader_election.cc:304] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37b7ac6292c746b38781ce11b74917db, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:35.131222 26303 raft_consensus.cc:2468] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37b7ac6292c746b38781ce11b74917db in term 2.
I20260709 13:10:35.131472 26506 raft_consensus.cc:2804] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:35.131964 26506 raft_consensus.cc:697] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Leader. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:35.132999 26506 consensus_queue.cc:237] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:35.139297 26051 catalog_manager.cc:5697] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db reported cstate change: term changed from 1 to 2, leader changed from 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67) to 37b7ac6292c746b38781ce11b74917db (127.14.246.66). New cstate: current_term: 2 leader_uuid: "37b7ac6292c746b38781ce11b74917db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:35.175414 26230 raft_consensus.cc:1275] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.176573 26379 consensus_queue.cc:1048] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.179919 26303 raft_consensus.cc:1275] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.181356 26379 consensus_queue.cc:1048] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.266029 26153 raft_consensus.cc:3060] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.271034 26153 raft_consensus.cc:1275] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.272415 26506 consensus_queue.cc:1048] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.281620 26303 raft_consensus.cc:1275] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.283291 26522 consensus_queue.cc:1048] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:35.382697 26155 raft_consensus.cc:1275] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.384192 26522 consensus_queue.cc:1048] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.391934 26303 raft_consensus.cc:1275] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.393339 26506 consensus_queue.cc:1048] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:35.453379 26155 raft_consensus.cc:1275] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.456353 26303 raft_consensus.cc:1275] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.456436 26506 consensus_queue.cc:1048] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.457677 26521 consensus_queue.cc:1048] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.472010 26230 raft_consensus.cc:1275] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.473304 26302 raft_consensus.cc:1275] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.473510 26521 consensus_queue.cc:1048] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.483106 26522 consensus_queue.cc:1048] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.525985 26155 raft_consensus.cc:1275] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.527243 26522 consensus_queue.cc:1048] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.537058 26302 raft_consensus.cc:1275] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 37b7ac6292c746b38781ce11b74917db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.539067 26529 consensus_queue.cc:1048] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.550414 26230 raft_consensus.cc:1275] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.551575 26521 consensus_queue.cc:1048] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:35.561600 26302 raft_consensus.cc:1275] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Refusing update from remote peer 6cdb83b3d7be4f21b426daee419bcfe4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.563172 26379 consensus_queue.cc:1048] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.524597 26050 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53218:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:37.542912 26050 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53218:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:37.655375 15321 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:37.688498 26194 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.67:38621, user_credentials={real_user=slave}} blocked reactor thread for 48112.1us
I20260709 13:10:37.795256 26577 tablet.cc:1724] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:37.821201 26193 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.246.65:43643, user_credentials={real_user=slave}} blocked reactor thread for 95988.1us
I20260709 13:10:37.851836 26587 tablet.cc:1724] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.907661 26591 tablet.cc:1724] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:37.941659 26585 log.cc:927] Time spent T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.005s
I20260709 13:10:37.925979 26602 tablet.cc:1724] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.889853 26586 tablet.cc:1724] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.929270 26594 tablet.cc:1724] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.925189 26592 tablet.cc:1724] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.926693 26597 tablet.cc:1724] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.974699 26229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d"
dest_uuid: "37b7ac6292c746b38781ce11b74917db"
mode: GRACEFUL
new_leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:48224
I20260709 13:10:37.979632 26229 raft_consensus.cc:606] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Received request to transfer leadership to TS 34bd6ed366aa48a99dd05b93a3e2819f
I20260709 13:10:37.998622 26600 tablet.cc:1724] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.000957 26577 tablet.cc:1724] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:37.997030 26606 tablet.cc:1724] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.000015 26602 tablet.cc:1724] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.007723 26596 tablet.cc:1724] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.015146 26602 tablet.cc:1724] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.002444 26586 tablet.cc:1724] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.019083 26577 tablet.cc:1724] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.027014 26602 tablet.cc:1724] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.030129 26594 tablet.cc:1724] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.036527 26600 tablet.cc:1724] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.074867 26605 tablet.cc:1724] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.056383 26587 tablet.cc:1724] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.083323 26597 tablet.cc:1724] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.097211 26606 tablet.cc:1724] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.092185 26577 tablet.cc:1724] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.110231 26154 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f"
dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
mode: GRACEFUL
new_leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:39976
I20260709 13:10:38.110088 26594 tablet.cc:1724] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.111042 26154 raft_consensus.cc:606] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Received request to transfer leadership to TS 34bd6ed366aa48a99dd05b93a3e2819f
I20260709 13:10:38.108965 26591 tablet.cc:1724] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.116457 15321 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:38.117187 15321 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:38.106930 26586 tablet.cc:1724] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:38.150605 26053 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: soft_deleted_table [id=e8ea7398e8654b23a27468aa1fe6be85] alter complete (version 1)
I20260709 13:10:38.170706 26579 raft_consensus.cc:993] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: : Instructing follower 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:38.171221 26534 raft_consensus.cc:1081] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Signalling peer 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:38.172736 26297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:60840
I20260709 13:10:38.173271 26297 raft_consensus.cc:493] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.173623 26297 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.178987 26297 raft_consensus.cc:515] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.180647 26297 leader_election.cc:290] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 3 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:38.181509 26154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:38.181697 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ecba4da8f04d858fe6223bea97c85d" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:38.182277 26154 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.182309 26228 raft_consensus.cc:3055] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.182852 26228 raft_consensus.cc:740] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 37b7ac6292c746b38781ce11b74917db, State: Running, Role: LEADER
I20260709 13:10:38.183765 26228 consensus_queue.cc:260] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.185081 26228 raft_consensus.cc:3060] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.189962 26154 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 3.
I20260709 13:10:38.191335 26267 leader_election.cc:304] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 6cdb83b3d7be4f21b426daee419bcfe4; no voters: 
I20260709 13:10:38.192020 26228 raft_consensus.cc:2468] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 3.
I20260709 13:10:38.192217 26527 raft_consensus.cc:2804] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.192824 26527 raft_consensus.cc:697] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:38.193715 26527 consensus_queue.cc:237] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.201587 26050 catalog_manager.cc:5697] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 2 to 3, leader changed from 37b7ac6292c746b38781ce11b74917db (127.14.246.66) to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 3 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.282258 26574 raft_consensus.cc:993] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: : Instructing follower 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:38.282939 26560 raft_consensus.cc:1081] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Signalling peer 34bd6ed366aa48a99dd05b93a3e2819f to start an election
I20260709 13:10:38.284382 26297 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f"
dest_uuid: "34bd6ed366aa48a99dd05b93a3e2819f"
 from {username='slave'} at 127.0.0.1:60848
I20260709 13:10:38.284935 26297 raft_consensus.cc:493] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:38.285252 26297 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.290479 26297 raft_consensus.cc:515] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.292165 26297 leader_election.cc:290] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 3 election: Requested vote from peers 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643), 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947)
I20260709 13:10:38.293015 26154 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cdb83b3d7be4f21b426daee419bcfe4"
I20260709 13:10:38.293150 26228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e47c79eadaad407c86a85cc76539943f" candidate_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "37b7ac6292c746b38781ce11b74917db"
I20260709 13:10:38.293787 26154 raft_consensus.cc:3055] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.293876 26228 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.294116 26154 raft_consensus.cc:740] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cdb83b3d7be4f21b426daee419bcfe4, State: Running, Role: LEADER
I20260709 13:10:38.295022 26154 consensus_queue.cc:260] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.296301 26154 raft_consensus.cc:3060] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.299539 26228 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 3.
I20260709 13:10:38.300678 26270 leader_election.cc:304] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34bd6ed366aa48a99dd05b93a3e2819f, 37b7ac6292c746b38781ce11b74917db; no voters: 
I20260709 13:10:38.301445 26527 raft_consensus.cc:2804] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.301851 26527 raft_consensus.cc:697] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 LEADER]: Becoming Leader. State: Replica: 34bd6ed366aa48a99dd05b93a3e2819f, State: Running, Role: LEADER
I20260709 13:10:38.302348 26154 raft_consensus.cc:2468] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34bd6ed366aa48a99dd05b93a3e2819f in term 3.
I20260709 13:10:38.302709 26527 consensus_queue.cc:237] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } }
I20260709 13:10:38.310783 26050 catalog_manager.cc:5697] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f reported cstate change: term changed from 2 to 3, leader changed from 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65) to 34bd6ed366aa48a99dd05b93a3e2819f (127.14.246.67). New cstate: current_term: 3 leader_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34bd6ed366aa48a99dd05b93a3e2819f" member_type: VOTER last_known_addr { host: "127.14.246.67" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.624640 26154 raft_consensus.cc:1275] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.625993 26566 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.638254 26228 raft_consensus.cc:1275] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.640013 26616 consensus_queue.cc:1048] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.783033 26228 raft_consensus.cc:1275] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.784075 26616 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "37b7ac6292c746b38781ce11b74917db" member_type: VOTER last_known_addr { host: "127.14.246.66" port: 43947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:38.795647 26154 raft_consensus.cc:1275] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Refusing update from remote peer 34bd6ed366aa48a99dd05b93a3e2819f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:38.797122 26527 consensus_queue.cc:1048] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cdb83b3d7be4f21b426daee419bcfe4" member_type: VOTER last_known_addr { host: "127.14.246.65" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.173171 15321 tablet_server.cc:179] TabletServer@127.14.246.65:0 shutting down...
W20260709 13:10:39.174556 26267 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:10:39.182696 26267 consensus_peers.cc:597] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.183645 26193 consensus_peers.cc:597] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.192694 26193 consensus_peers.cc:597] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.205659 26267 consensus_peers.cc:597] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.207089 26193 consensus_peers.cc:597] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.218967 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:39.219777 15321 tablet_replica.cc:333] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.220572 15321 raft_consensus.cc:2243] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.221123 15321 raft_consensus.cc:2272] T 783071ecb7344b7c8da936e4d130b3cb P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.223320 15321 tablet_replica.cc:333] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.223906 15321 raft_consensus.cc:2243] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.224326 15321 raft_consensus.cc:2272] T 262b161b97674fdabce1d7b3e572c578 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.226408 15321 tablet_replica.cc:333] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.227003 15321 raft_consensus.cc:2243] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.227432 15321 raft_consensus.cc:2272] T 9ab4f3a3593541528b67044e2c186a37 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.229516 15321 tablet_replica.cc:333] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.230141 15321 raft_consensus.cc:2243] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.230890 15321 raft_consensus.cc:2272] T 0af6bcc892d74e578b1a7595b83a85c2 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.232990 15321 tablet_replica.cc:333] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.233577 15321 raft_consensus.cc:2243] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.234004 15321 raft_consensus.cc:2272] T ed04677ca4544014a160876e304b6fed P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.236081 15321 tablet_replica.cc:333] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.236742 15321 raft_consensus.cc:2243] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.237214 15321 raft_consensus.cc:2272] T 01ecba4da8f04d858fe6223bea97c85d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.239713 15321 tablet_replica.cc:333] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.240228 15321 raft_consensus.cc:2243] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.241008 15321 raft_consensus.cc:2272] T 0d7329e11d5f4704a7c18d0d5dd15218 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.243527 15321 tablet_replica.cc:333] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.244112 15321 raft_consensus.cc:2243] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.245076 15321 raft_consensus.cc:2272] T 76810b43da7144fbb0bfdd79693a0e2a P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.247202 15321 tablet_replica.cc:333] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.247690 15321 raft_consensus.cc:2243] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.248067 15321 raft_consensus.cc:2272] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.250468 15321 tablet_replica.cc:333] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.251003 15321 raft_consensus.cc:2243] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.251495 15321 raft_consensus.cc:2272] T fa01dddbf9f54f318bff64aafc28a008 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.253918 15321 tablet_replica.cc:333] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.254627 15321 raft_consensus.cc:2243] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.255414 15321 raft_consensus.cc:2272] T cd98a793a05c40deb19393eb2fd98cf6 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.258153 15321 tablet_replica.cc:333] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.258893 15321 raft_consensus.cc:2243] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.259706 15321 raft_consensus.cc:2272] T edfeaebc4f8942379cec35617f35c50d P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.262255 15321 tablet_replica.cc:333] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.262929 15321 raft_consensus.cc:2243] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.263392 15321 raft_consensus.cc:2272] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.266165 15321 tablet_replica.cc:333] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.267079 15321 raft_consensus.cc:2243] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.267727 15321 raft_consensus.cc:2272] T cf04949c6a9c4f32902c05199aa81aa1 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.270109 15321 tablet_replica.cc:333] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.270680 15321 raft_consensus.cc:2243] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.271145 15321 raft_consensus.cc:2272] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.273140 15321 tablet_replica.cc:333] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.273686 15321 raft_consensus.cc:2243] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.274564 15321 raft_consensus.cc:2272] T 7bf046f457e3473492627a8b7bbe4ea9 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.276893 15321 tablet_replica.cc:333] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.277521 15321 raft_consensus.cc:2243] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.278393 15321 raft_consensus.cc:2272] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 6cdb83b3d7be4f21b426daee419bcfe4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.280961 15321 tablet_replica.cc:333] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4: stopping tablet replica
I20260709 13:10:39.281443 15321 raft_consensus.cc:2243] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.281883 15321 raft_consensus.cc:2272] T e47c79eadaad407c86a85cc76539943f P 6cdb83b3d7be4f21b426daee419bcfe4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.301478 26193 consensus_peers.cc:597] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.323882 26193 consensus_peers.cc:597] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.325230 15321 tablet_server.cc:196] TabletServer@127.14.246.65:0 shutdown complete.
W20260709 13:10:39.357437 26193 consensus_peers.cc:597] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.360100 15321 tablet_server.cc:179] TabletServer@127.14.246.66:0 shutting down...
I20260709 13:10:39.384594 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:39.385398 15321 tablet_replica.cc:333] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.386413 15321 raft_consensus.cc:2243] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.387351 15321 raft_consensus.cc:2272] T 9ab4f3a3593541528b67044e2c186a37 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.389510 15321 tablet_replica.cc:333] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.390040 15321 raft_consensus.cc:2243] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.390727 15321 raft_consensus.cc:2272] T 262b161b97674fdabce1d7b3e572c578 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.392834 15321 tablet_replica.cc:333] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.393482 15321 raft_consensus.cc:2243] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.394213 15321 raft_consensus.cc:2272] T 783071ecb7344b7c8da936e4d130b3cb P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.396539 15321 tablet_replica.cc:333] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.397480 15321 raft_consensus.cc:2243] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.398088 15321 raft_consensus.cc:2272] T 0af6bcc892d74e578b1a7595b83a85c2 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.400171 26193 consensus_peers.cc:597] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db -> Peer 6cdb83b3d7be4f21b426daee419bcfe4 (127.14.246.65:43643): Couldn't send request to peer 6cdb83b3d7be4f21b426daee419bcfe4. Status: Network error: Client connection negotiation failed: client connection to 127.14.246.65:43643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.401053 15321 tablet_replica.cc:333] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.401952 15321 raft_consensus.cc:2243] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.402494 15321 raft_consensus.cc:2272] T edfeaebc4f8942379cec35617f35c50d P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.404582 15321 tablet_replica.cc:333] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.405169 15321 raft_consensus.cc:2243] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.405611 15321 raft_consensus.cc:2272] T cd98a793a05c40deb19393eb2fd98cf6 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.407622 15321 tablet_replica.cc:333] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.408188 15321 raft_consensus.cc:2243] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.408633 15321 raft_consensus.cc:2272] T ed04677ca4544014a160876e304b6fed P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.410727 15321 tablet_replica.cc:333] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.411298 15321 raft_consensus.cc:2243] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.411724 15321 raft_consensus.cc:2272] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 37b7ac6292c746b38781ce11b74917db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.413712 15321 tablet_replica.cc:333] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.414273 15321 raft_consensus.cc:2243] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.414820 15321 raft_consensus.cc:2272] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.417656 15321 tablet_replica.cc:333] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.418368 15321 raft_consensus.cc:2243] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.418870 15321 raft_consensus.cc:2272] T 7bf046f457e3473492627a8b7bbe4ea9 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.421597 15321 tablet_replica.cc:333] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.422163 15321 raft_consensus.cc:2243] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.422577 15321 raft_consensus.cc:2272] T 01ecba4da8f04d858fe6223bea97c85d P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:39.423451 26270 consensus_peers.cc:597] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f -> Peer 37b7ac6292c746b38781ce11b74917db (127.14.246.66:43947): Couldn't send request to peer 37b7ac6292c746b38781ce11b74917db. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.425293 15321 tablet_replica.cc:333] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.425925 15321 raft_consensus.cc:2243] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.426342 15321 raft_consensus.cc:2272] T 0d7329e11d5f4704a7c18d0d5dd15218 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.428236 15321 tablet_replica.cc:333] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.428853 15321 raft_consensus.cc:2243] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.429277 15321 raft_consensus.cc:2272] T 76810b43da7144fbb0bfdd79693a0e2a P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.431079 15321 tablet_replica.cc:333] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.431600 15321 raft_consensus.cc:2243] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.432371 15321 raft_consensus.cc:2272] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.434286 15321 tablet_replica.cc:333] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.434880 15321 raft_consensus.cc:2243] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.435626 15321 raft_consensus.cc:2272] T fa01dddbf9f54f318bff64aafc28a008 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.437629 15321 tablet_replica.cc:333] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.438105 15321 raft_consensus.cc:2243] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.438836 15321 raft_consensus.cc:2272] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.440653 15321 tablet_replica.cc:333] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.441183 15321 raft_consensus.cc:2243] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.442018 15321 raft_consensus.cc:2272] T cf04949c6a9c4f32902c05199aa81aa1 P 37b7ac6292c746b38781ce11b74917db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.444046 15321 tablet_replica.cc:333] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db: stopping tablet replica
I20260709 13:10:39.444526 15321 raft_consensus.cc:2243] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.445004 15321 raft_consensus.cc:2272] T e47c79eadaad407c86a85cc76539943f P 37b7ac6292c746b38781ce11b74917db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.486902 15321 tablet_server.cc:196] TabletServer@127.14.246.66:0 shutdown complete.
I20260709 13:10:39.521073 15321 tablet_server.cc:179] TabletServer@127.14.246.67:0 shutting down...
I20260709 13:10:39.552379 15321 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:39.553251 15321 tablet_replica.cc:333] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.554297 15321 raft_consensus.cc:2243] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.554977 15321 raft_consensus.cc:2272] T 783071ecb7344b7c8da936e4d130b3cb P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.557018 15321 tablet_replica.cc:333] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.557533 15321 raft_consensus.cc:2243] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.557914 15321 raft_consensus.cc:2272] T 262b161b97674fdabce1d7b3e572c578 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.559798 15321 tablet_replica.cc:333] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.560325 15321 raft_consensus.cc:2243] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.560696 15321 raft_consensus.cc:2272] T 9ab4f3a3593541528b67044e2c186a37 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.562638 15321 tablet_replica.cc:333] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.563114 15321 raft_consensus.cc:2243] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.563478 15321 raft_consensus.cc:2272] T 0af6bcc892d74e578b1a7595b83a85c2 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.565339 15321 tablet_replica.cc:333] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.565834 15321 raft_consensus.cc:2243] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.566566 15321 raft_consensus.cc:2272] T ed04677ca4544014a160876e304b6fed P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.568476 15321 tablet_replica.cc:333] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.569000 15321 raft_consensus.cc:2243] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.569391 15321 raft_consensus.cc:2272] T c2bbbc80ec2342d4893b3ff2e474a8f5 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.571350 15321 tablet_replica.cc:333] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.571837 15321 raft_consensus.cc:2243] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.572206 15321 raft_consensus.cc:2272] T 76810b43da7144fbb0bfdd79693a0e2a P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.574064 15321 tablet_replica.cc:333] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.574568 15321 raft_consensus.cc:2243] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.574949 15321 raft_consensus.cc:2272] T 0d7329e11d5f4704a7c18d0d5dd15218 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.576742 15321 tablet_replica.cc:333] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.577245 15321 raft_consensus.cc:2243] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.577905 15321 raft_consensus.cc:2272] T 01ecba4da8f04d858fe6223bea97c85d P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.580199 15321 tablet_replica.cc:333] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.580680 15321 raft_consensus.cc:2243] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.581411 15321 raft_consensus.cc:2272] T 3f5f0fdeaf0b4e4091702d26ee49c341 P 34bd6ed366aa48a99dd05b93a3e2819f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.583305 15321 tablet_replica.cc:333] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.583755 15321 raft_consensus.cc:2243] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.584122 15321 raft_consensus.cc:2272] T 7bf046f457e3473492627a8b7bbe4ea9 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.586040 15321 tablet_replica.cc:333] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.586496 15321 raft_consensus.cc:2243] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.586874 15321 raft_consensus.cc:2272] T 996fc0d8b9e54101b9d7dd4b438d8d62 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.588799 15321 tablet_replica.cc:333] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.589241 15321 raft_consensus.cc:2243] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.589926 15321 raft_consensus.cc:2272] T e47c79eadaad407c86a85cc76539943f P 34bd6ed366aa48a99dd05b93a3e2819f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.592360 15321 tablet_replica.cc:333] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.592937 15321 raft_consensus.cc:2243] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.593406 15321 raft_consensus.cc:2272] T fa01dddbf9f54f318bff64aafc28a008 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.595433 15321 tablet_replica.cc:333] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.595912 15321 raft_consensus.cc:2243] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.596336 15321 raft_consensus.cc:2272] T 65c8f4c5c14d4d938c27eacdc27f0c21 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.598300 15321 tablet_replica.cc:333] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.598768 15321 raft_consensus.cc:2243] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.599190 15321 raft_consensus.cc:2272] T cf04949c6a9c4f32902c05199aa81aa1 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.601082 15321 tablet_replica.cc:333] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.601542 15321 raft_consensus.cc:2243] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.602005 15321 raft_consensus.cc:2272] T cd98a793a05c40deb19393eb2fd98cf6 P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.603794 15321 tablet_replica.cc:333] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f: stopping tablet replica
I20260709 13:10:39.604171 15321 raft_consensus.cc:2243] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:39.604526 15321 raft_consensus.cc:2272] T edfeaebc4f8942379cec35617f35c50d P 34bd6ed366aa48a99dd05b93a3e2819f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.642659 15321 tablet_server.cc:196] TabletServer@127.14.246.67:0 shutdown complete.
I20260709 13:10:39.680264 15321 master.cc:562] Master@127.14.246.126:41945 shutting down...
I20260709 13:10:39.705890 15321 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:39.706452 15321 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:39.706805 15321 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a97ca84e7374773a1cc943b7eb9300e: stopping tablet replica
I20260709 13:10:39.727807 15321 master.cc:584] Master@127.14.246.126:41945 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11409 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24995 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (313523 ms total)
[  PASSED  ] 8 tests.
I20260709 13:10:39.783428 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 428 messages since previous log ~15 seconds ago
I20260709 13:10:39.783687 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 428 messages since previous log ~15 seconds ago
I20260709 13:10:39.783875 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 424 messages since previous log ~15 seconds ago
I20260709 13:10:39.784087 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:39.784297 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:39.784536 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~148 seconds ago
I20260709 13:10:39.784862 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:10:39.785224 15321 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
